Started by upstream project "osmo-gsm-tester_build-osmo-stp" build number 9261 originally caused by: Started by upstream project "master-libosmo-sccp" build number 9132 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-sgsn" build number 30102 originally caused by: Started by upstream project "master-osmo-sgsn" build number 37277 originally caused by: Started by upstream project "master-osmo-iuh" build number 12879 originally caused by: Started by upstream project "master-libasn1c" build number 1810 originally caused by: Started by timer Started by upstream project "master-osmo-sgsn" build number 37278 originally caused by: Started by upstream project "master-libosmo-sccp" build number 9132 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-msc" build number 29316 originally caused by: Started by upstream project "master-osmo-msc" build number 34283 originally caused by: Started by upstream project "master-osmo-iuh" build number 12879 originally caused by: Started by upstream project "master-libasn1c" build number 1810 originally caused by: Started by timer Started by upstream project "master-osmo-msc" build number 34284 originally caused by: Started by upstream project "master-libosmo-sccp" build number 9132 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-bsc" build number 17687 originally caused by: Started by upstream project "master-osmo-bsc" build number 20151 originally caused by: Started by upstream project "master-libosmo-sccp" build number 9132 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-sgsn" build number 30103 originally caused by: Started by upstream project "master-osmo-sgsn" build number 37279 originally caused by: Started by upstream project "master-osmo-iuh" build number 12880 originally caused by: Started by upstream project "master-libosmo-sccp" build number 9132 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-msc" build number 29317 originally caused by: Started by upstream project "master-osmo-msc" build number 34285 originally caused by: Started by upstream project "master-osmo-iuh" build number 12880 originally caused by: Started by upstream project "master-libosmo-sccp" build number 9132 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-bsc" build number 17688 originally caused by: Started by upstream project "master-osmo-bsc" build number 20152 originally caused by: Started by timer Running as SYSTEM Building remotely on osmo-gsm-tester-prod (osmo-gsm-tester) in workspace /home/jenkins/workspace/osmo-gsm-tester_run-prod The recommended git tool is: NONE No credentials specified > git rev-parse --resolve-git-dir /home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/.git # timeout=10 Fetching changes from the remote Git repository > git config remote.origin.url https://gerrit.osmocom.org/osmo-gsm-tester # timeout=10 Fetching upstream changes from https://gerrit.osmocom.org/osmo-gsm-tester > git --version # timeout=10 > git --version # 'git version 2.20.1' > git fetch --tags --force --progress -- https://gerrit.osmocom.org/osmo-gsm-tester +refs/heads/*:refs/remotes/origin/* # timeout=10 > git rev-parse refs/remotes/origin/master^{commit} # timeout=10 Checking out Revision bfc438bb2b17f4129018768a1f7bab52f1e96750 (refs/remotes/origin/master) > git config core.sparsecheckout # timeout=10 > git checkout -f bfc438bb2b17f4129018768a1f7bab52f1e96750 # timeout=10 Commit message: "templates: osmo-msc: modernize" > git rev-list --no-walk bfc438bb2b17f4129018768a1f7bab52f1e96750 # timeout=10 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bsc" build number 17688 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bts" build number 7515 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-ggsn" build number 6694 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-hlr" build number 8719 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-mgw" build number 8964 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-hnbgw" build number 2997 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-msc" build number 29317 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-pcu" build number 5156 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-sgsn" build number 30103 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-trx" build number 4686 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-nitb" build number 12995 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-stp" build number 9261 Copied 2 artifacts from "osmo-gsm-tester_build-osmocom-bb" build number 4714 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bts-sysmo" build number 8046 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-pcu-sysmo" build number 5195 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bts-oc2g" build number 5542 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-pcu-oc2g" build number 3912 Copied 2 artifacts from "osmo-gsm-tester_build-open5gs" build number 8 Copied 2 artifacts from "osmo-gsm-tester_build-srslte" build number 19 [osmo-gsm-tester_run-prod] $ /bin/sh /tmp/jenkins9389522889573418099.sh + unlink osmo-gsm-tester/sysmocom/resources.conf + ln -s resources.conf.prod osmo-gsm-tester/sysmocom/resources.conf + PATH=/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src:/usr/local/bin:/usr/bin:/bin:/usr/games ./osmo-gsm-tester/contrib/jenkins-run.sh + base=/home/jenkins/workspace/osmo-gsm-tester_run-prod + dirname -- ./osmo-gsm-tester/contrib/jenkins-run.sh + CDPATH= cd -- ./osmo-gsm-tester/contrib + pwd -P + SCRIPT_DIR=/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/contrib + OSMO_GSM_TESTER_CONF=/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/contrib/../sysmocom/main.conf + date +%F %T + time_start=2022-12-14 08:25:10 + trial_dir_prefix=trial- + rm -rf trial-2401 trial-2401-bin.tgz trial-2401-run.tgz + trial_dir=trial-2402 + mkdir -p trial-2402 + mv open5gs.build-8.tgz osmo-bsc.build-17688.tgz osmo-bts-oc2g.build-5542.tgz osmo-bts-sysmo.build-8046.tgz osmo-bts.build-7515.tgz osmo-ggsn.build-6694.tgz osmo-hlr.build-8719.tgz osmo-hnbgw.build-2997.tgz osmo-mgw.build-8964.tgz osmo-msc.build-29317.tgz osmo-nitb.build-12995.tgz osmo-pcu-oc2g.build-3912.tgz osmo-pcu-sysmo.build-5195.tgz osmo-pcu.build-5156.tgz osmo-sgsn.build-30103.tgz osmo-stp.build-9261.tgz osmo-trx.build-4686.tgz osmocom-bb.build-4714.tgz srslte.build-19.tgz trial-2402 + cat open5gs.build-8.md5 osmo-bsc.build-17688.md5 osmo-bts-oc2g.build-5542.md5 osmo-bts-sysmo.build-8046.md5 osmo-bts.build-7515.md5 osmo-ggsn.build-6694.md5 osmo-hlr.build-8719.md5 osmo-hnbgw.build-2997.md5 osmo-mgw.build-8964.md5 osmo-msc.build-29317.md5 osmo-nitb.build-12995.md5 osmo-pcu-oc2g.build-3912.md5 osmo-pcu-sysmo.build-5195.md5 osmo-pcu.build-5156.md5 osmo-sgsn.build-30103.md5 osmo-stp.build-9261.md5 osmo-trx.build-4686.md5 osmocom-bb.build-4714.md5 srslte.build-19.md5 + rm open5gs.build-8.md5 osmo-bsc.build-17688.md5 osmo-bts-oc2g.build-5542.md5 osmo-bts-sysmo.build-8046.md5 osmo-bts.build-7515.md5 osmo-ggsn.build-6694.md5 osmo-hlr.build-8719.md5 osmo-hnbgw.build-2997.md5 osmo-mgw.build-8964.md5 osmo-msc.build-29317.md5 osmo-nitb.build-12995.md5 osmo-pcu-oc2g.build-3912.md5 osmo-pcu-sysmo.build-5195.md5 osmo-pcu.build-5156.md5 osmo-sgsn.build-30103.md5 osmo-stp.build-9261.md5 osmo-trx.build-4686.md5 osmocom-bb.build-4714.md5 srslte.build-19.md5 + exit_code=1 + which osmo-gsm-tester.py + python3 -u /home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo-gsm-tester.py -c /home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/contrib/../sysmocom/main.conf trial-2402 combinations: None trial: 'trial-2402' tests: None Running default suites: nitb_sms:sysmo sms:sysmo nitb_ussd:sysmo ussd:sysmo voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:sysmo+mod-bts0-dynts-osmo emergency:sysmo gprs:sysmo gprs:sysmo+mod-bts0-egprs gprs:sysmo+mod-bts0-dynts-ipa gprs:sysmo+mod-bts0-dynts-osmo dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:sysmo+mod-bts0-dynts67-osmo nitb_sms:oc2g sms:oc2g nitb_ussd:oc2g ussd:oc2g voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:oc2g+mod-bts0-dynts-osmo emergency:oc2g gprs:oc2g gprs:oc2g+mod-bts0-egprs gprs:oc2g+mod-bts0-dynts-ipa gprs:oc2g+mod-bts0-dynts-osmo dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:oc2g+mod-bts0-dynts67-osmo nitb_sms:trx-b200 sms:trx-b200 nitb_ussd:trx-b200 ussd:trx-b200 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-b200+mod-bts0-dynts-osmo voice:trx-b200+mod-bts0-trxdversion0 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend emergency:trx-b200 gprs:trx-b200 gprs:trx-b200+mod-bts0-egprs gprs:trx-b200+mod-bts0-dynts-ipa gprs:trx-b200+mod-bts0-dynts-osmo gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-b200+mod-bts0-dynts67-osmo nitb_sms:trx-sysmocell5000 sms:trx-sysmocell5000 nitb_ussd:trx-sysmocell5000 ussd:trx-sysmocell5000 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-sysmocell5000+mod-bts0-dynts-osmo emergency:trx-sysmocell5000 gprs:trx-sysmocell5000 gprs:trx-sysmocell5000+mod-bts0-egprs gprs:trx-sysmocell5000+mod-bts0-dynts-ipa gprs:trx-sysmocell5000+mod-bts0-dynts-osmo dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo nitb_sms:trx-umtrx sms:trx-umtrx nitb_ussd:trx-umtrx ussd:trx-umtrx voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-umtrx+mod-bts0-dynts-osmo voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend emergency:trx-umtrx gprs:trx-umtrx gprs:trx-umtrx+mod-bts0-egprs gprs:trx-umtrx+mod-bts0-dynts-ipa gprs:trx-umtrx+mod-bts0-dynts-osmo gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-umtrx+mod-bts0-dynts67-osmo nitb_sms:trx-lms sms:trx-lms nitb_ussd:trx-lms ussd:trx-lms voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-lms+mod-bts0-dynts-osmo emergency:trx-lms gprs:trx-lms gprs:trx-lms+mod-bts0-egprs gprs:trx-lms+mod-bts0-dynts-ipa gprs:trx-lms+mod-bts0-dynts-osmo dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-lms+mod-bts0-dynts67-osmo nitb_sms:trx-lms-limenet-micro sms:trx-lms-limenet-micro nitb_ussd:trx-lms-limenet-micro ussd:trx-lms-limenet-micro voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo emergency:trx-lms-limenet-micro gprs:trx-lms-limenet-micro gprs:trx-lms-limenet-micro+mod-bts0-egprs gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo nitb_sms:nanobts sms:nanobts+band-1900 nitb_ussd:nanobts+band-1900 ussd:nanobts+band-1900 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any emergency:nanobts+band-1900 gprs:nanobts+band-1900 gprs:nanobts+band-1900+mod-bts0-egprs gprs:nanobts+band-1900+mod-bts0-dynts-ipa dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any sms:nanobts+band-900 nitb_ussd:nanobts+band-900 ussd:nanobts+band-900 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend emergency:nanobts+band-900 gprs:nanobts+band-900 gprs:nanobts+band-900+mod-bts0-egprs gprs:nanobts+band-900+mod-bts0-dynts-ipa gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any nitb_smpp smpp encryption 4g:srsenb-rftype@zmq+srsue-rftype@zmq handover_2G:nanobts+bts1-oc2g handover_2G:nanobts+bts1-octphy handover_2G:nanobts+bts1-trx-lms handover_2G:nanobts+bts1-trx-lms-limenet-micro handover_2G:nanobts+bts1-trx-sysmocell5000 handover_2G:nanobts+bts1-sysmo handover_2G:nanobts+bts1-trx-b200 handover_2G:nanobts+bts1-trx-umtrx handover_2G:oc2g+bts1-octphy handover_2G:oc2g+bts1-trx-lms handover_2G:oc2g+bts1-trx-lms-limenet-micro handover_2G:oc2g+bts1-trx-sysmocell5000 handover_2G:oc2g+bts1-sysmo handover_2G:oc2g+bts1-trx-b200 handover_2G:oc2g+bts1-trx-umtrx handover_2G:octphy+bts1-trx-lms handover_2G:octphy+bts1-trx-lms-limenet-micro handover_2G:octphy+bts1-trx-sysmocell5000 handover_2G:octphy+bts1-sysmo handover_2G:octphy+bts1-trx-b200 handover_2G:octphy+bts1-trx-umtrx handover_2G:trx-lms+bts1-trx-lms-limenet-micro handover_2G:trx-lms+bts1-trx-sysmocell5000 handover_2G:trx-lms+bts1-sysmo handover_2G:trx-lms+bts1-trx-b200 handover_2G:trx-lms+bts1-trx-umtrx handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 handover_2G:trx-lms-limenet-micro+bts1-sysmo handover_2G:trx-lms-limenet-micro+bts1-trx-b200 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx handover_2G:trx-sysmocell5000+bts1-sysmo handover_2G:trx-sysmocell5000+bts1-trx-b200 handover_2G:trx-sysmocell5000+bts1-trx-umtrx handover_2G:sysmo+bts1-trx-b200 handover_2G:sysmo+bts1-trx-umtrx handover_2G:trx-b200+bts1-trx-umtrx -------------------------------------------------------------------------------------------- trial-2402 -------------------------------------------------------------------------------------------- 08:25:21.943465 tst trial-2402: Detailed log at /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/log --------------------------------------------------------------------- trial-2402 nitb_sms:sysmo --------------------------------------------------------------------- 08:27:28.148196 tst nitb_sms:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:27:28.152597 tst nitb_sms:sysmo: Verifying 1 x bts (candidates: 11) 08:27:28.173554 tst nitb_sms:sysmo: Verifying 1 x ip_address (candidates: 9) 08:27:28.180617 tst nitb_sms:sysmo: Verifying 2 x modem (candidates: 12) 08:27:28.237636 tst nitb_sms:sysmo: Reserving 1 x bts (candidates: 11) 08:27:28.258522 tst nitb_sms:sysmo: Reserving 1 x ip_address (candidates: 9) 08:27:28.265452 tst nitb_sms:sysmo: Reserving 2 x modem (candidates: 12) 08:27:28.802719 tst nitb_sms:sysmo: RESERVED RESOURCES for nitb_sms: bts sysmoBTS 1002 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2402 nitb_sms:sysmo mo_mt_sms.py ---------------------------------------------- 08:27:28.807939 tst nitb_sms:sysmo: Using 1 x ip_address (candidates: 1) 08:27:28.819007 tst nitb_sms:sysmo: Using 1 x bts (candidates: 1) 08:27:29.190651 tst mo_mt_sms.py: using LAC 39657 08:27:29.427001 tst mo_mt_sms.py: using RAC 132 08:27:29.542429 tst mo_mt_sms.py: using CellId 39657 08:27:29.657205 tst mo_mt_sms.py: using BVCI 39658 08:27:29.763291 tst nitb_sms:sysmo: Using 1 x modem (candidates: 2) 08:27:29.943155 tst nitb_sms:sysmo: Using 1 x modem (candidates: 2) 08:27:30.061215 tst mo_mt_sms.py:9: start nitb and bts... 08:27:30.276526 run osmo-nitb_10.42.42.2: Starting osmo-nitb 08:27:32.696485 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=28235): Launched 08:27:33.003195 run osmo-nitb_10.42.42.2(pid=28236): Launched 08:27:33.169692 run osmo-nitb_10.42.42.2(pid=28236): ERR: Terminated: ERROR {rc=2} [trial-2402↪nitb_sms:sysmo↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=28236)] 08:27:33.294477 run osmo-nitb_10.42.42.2(pid=28236): stdout: | (launched: 2022-12-14_08:27:32.946296) 08:27:33.421434 run osmo-nitb_10.42.42.2(pid=28236): stderr: | (launched: 2022-12-14_08:27:32.991158) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 08:27:33.548136 run osmo-nitb_10.42.42.2(pid=28236): stdout: | (launched: 2022-12-14_08:27:32.946296) 08:27:33.667837 run osmo-nitb_10.42.42.2(pid=28236): stderr: | (launched: 2022-12-14_08:27:32.991158) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 08:27:33.811238 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=28236): Process ended prematurely: osmo-nitb_10.42.42.2(pid=28236) [trial-2402↪nitb_sms:sysmo↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=28236)] [trial-2402↪nitb_sms:sysmo↪mo_mt_sms.py:11] 08:27:33.819608 tst mo_mt_sms.py:11: Test FAILED (5.0 sec) 08:27:33.826219 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=28235): Terminating (SIGTERM) 08:27:34.035516 --- ParallelTerminationStrategy: PID 28235 died... 08:27:34.056236 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=28235): Terminated: ok {rc=0} 08:27:34.144209 bus /sierra_3: Setting Powered False 08:27:35.245382 bus /sierra_3: Setting Powered False 08:27:36.363833 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2402 nitb_sms:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 sms:sysmo --------------------------------------------------------------------- 08:27:37.543335 tst sms:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:27:37.547354 tst sms:sysmo: Verifying 1 x bts (candidates: 11) 08:27:37.568156 tst sms:sysmo: Verifying 6 x ip_address (candidates: 9) 08:27:37.595945 tst sms:sysmo: Verifying 2 x modem (candidates: 12) 08:27:37.650980 tst sms:sysmo: Reserving 1 x bts (candidates: 11) 08:27:37.672618 tst sms:sysmo: Reserving 6 x ip_address (candidates: 9) 08:27:37.699772 tst sms:sysmo: Reserving 2 x modem (candidates: 12) 08:27:38.242313 tst sms:sysmo: RESERVED RESOURCES for sms: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2402 sms:sysmo mo_mt_sms.py ---------------------------------------------- 08:27:38.247280 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 08:27:38.257911 tst sms:sysmo: Using 1 x bts (candidates: 1) 08:27:38.291165 tst mo_mt_sms.py: using LAC 39658 08:27:38.410684 tst mo_mt_sms.py: using RAC 133 08:27:38.530803 tst mo_mt_sms.py: using CellId 39658 08:27:38.650478 tst mo_mt_sms.py: using BVCI 39659 08:27:38.761559 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 08:27:38.772151 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 08:27:38.782662 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 08:27:38.793052 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 08:27:38.803743 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 08:27:38.815379 tst sms:sysmo: Using 1 x modem (candidates: 2) 08:27:38.930639 tst sms:sysmo: Using 1 x modem (candidates: 2) 08:27:39.052352 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:27:40.807821 run create_hlr_db(pid=28241): Launched 08:27:40.940170 bus /sierra_2: Setting Powered False 08:27:42.003980 run create_hlr_db(pid=28241): Terminated: ok {rc=0} 08:27:42.437933 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28243): Launched 08:27:42.743900 run osmo-hlr_10.42.42.2(pid=28244): Launched 08:27:42.862367 run osmo-stp_10.42.42.5: Starting osmo-stp 08:27:45.369679 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28246): Launched 08:27:45.674220 run osmo-stp_10.42.42.5(pid=28247): Launched 08:27:45.790937 run osmo-msc_10.42.42.6: Starting osmo-msc 08:27:51.317989 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28249): Launched 08:27:51.640441 run osmo-msc_10.42.42.6(pid=28250): Launched 08:27:51.820091 run osmo-stp_10.42.42.5(pid=28247): ERR: Terminated: ERROR {rc=1} [trial-2402↪sms:sysmo↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28247)] 08:27:51.955360 run osmo-stp_10.42.42.5(pid=28247): stdout: | (launched: 2022-12-14_08:27:45.616678) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:27:52.091599 run osmo-stp_10.42.42.5(pid=28247): stderr: | 20221214082745789 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214082745789 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214082745789 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214082745790 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214082745792 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214082745792 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214082745792 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:27:52.226922 run osmo-stp_10.42.42.5(pid=28247): stdout: | (launched: 2022-12-14_08:27:45.616678) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:27:52.354317 run osmo-stp_10.42.42.5(pid=28247): stderr: | 20221214082745789 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214082745789 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214082745789 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214082745790 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214082745792 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214082745792 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214082745792 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:27:52.506874 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=28247): Process ended prematurely: osmo-stp_10.42.42.5(pid=28247) [trial-2402↪sms:sysmo↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28247)] [trial-2402↪sms:sysmo↪mo_mt_sms.py:16] 08:27:52.515799 tst mo_mt_sms.py:16: Test FAILED (14.3 sec) 08:27:52.543378 run osmo-hlr_10.42.42.2(pid=28244): ERR: Terminated: ERROR {rc=237} [trial-2402↪sms:sysmo↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28244)] 08:27:52.593861 run osmo-hlr_10.42.42.2(pid=28244): stdout: | (launched: 2022-12-14_08:27:42.686471) 08:27:52.646174 run osmo-hlr_10.42.42.2(pid=28244): stderr: | 20221214082742865 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214082742865 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214082742865 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214082742865 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214082742865 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214082742865 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214082742877 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/sms:sysmo/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214082742886 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214082742886 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214082742886 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:27:52.718579 run osmo-msc_10.42.42.6(pid=28250): ERR: Terminated: ERROR {rc=2} [trial-2402↪sms:sysmo↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28250)] 08:27:52.769070 run osmo-msc_10.42.42.6(pid=28250): stdout: | (launched: 2022-12-14_08:27:51.579951) 08:27:52.821159 run osmo-msc_10.42.42.6(pid=28250): stderr: | 20221214082751905 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214082751905 DLGLOBAL DEBUG validating counter group 0x7f157fbeac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214082751905 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214082751905 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214082751905 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214082751906 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214082751907 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214082751907 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214082751908 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214082751908 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:27:52.873667 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28243): Terminating (SIGTERM) 08:27:52.916249 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28246): Terminating (SIGTERM) 08:27:52.958564 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28249): Terminating (SIGTERM) 08:27:53.000768 --- ParallelTerminationStrategy: PID 28243 died... 08:27:53.021057 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28243): Terminated: ok {rc=0} 08:27:53.067604 --- ParallelTerminationStrategy: PID 28246 died... 08:27:53.087582 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28246): Terminated: ok {rc=0} 08:27:53.134149 --- ParallelTerminationStrategy: PID 28249 died... 08:27:53.153773 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28249): Terminated: ok {rc=0} 08:27:53.242148 bus /sierra_3: Setting Powered False 08:27:54.342989 bus /sierra_3: Setting Powered False 08:27:55.460363 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2402 sms:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 nitb_ussd:sysmo --------------------------------------------------------------------- 08:27:56.692377 tst nitb_ussd:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:27:56.697311 tst nitb_ussd:sysmo: Verifying 1 x bts (candidates: 11) 08:27:56.719369 tst nitb_ussd:sysmo: Verifying 1 x ip_address (candidates: 9) 08:27:56.726461 tst nitb_ussd:sysmo: Verifying 1 x modem (candidates: 12) 08:27:56.769448 tst nitb_ussd:sysmo: Reserving 1 x bts (candidates: 11) 08:27:56.791823 tst nitb_ussd:sysmo: Reserving 1 x ip_address (candidates: 9) 08:27:56.798810 tst nitb_ussd:sysmo: Reserving 1 x modem (candidates: 12) 08:27:57.311154 tst nitb_ussd:sysmo: RESERVED RESOURCES for nitb_ussd: bts sysmoBTS 1002 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2402 nitb_ussd:sysmo assert_extension.py ---------------------------------------------- 08:27:57.317331 tst nitb_ussd:sysmo: Using 1 x ip_address (candidates: 1) 08:27:57.328213 tst nitb_ussd:sysmo: Using 1 x bts (candidates: 1) 08:27:57.362444 tst assert_extension.py: using LAC 39659 08:27:57.483544 tst assert_extension.py: using RAC 134 08:27:57.606698 tst assert_extension.py: using CellId 39659 08:27:57.724746 tst assert_extension.py: using BVCI 39660 08:27:57.833907 tst nitb_ussd:sysmo: Using 1 x modem (candidates: 1) 08:27:57.952776 tst assert_extension.py:10: start nitb and bts... 08:27:58.155530 run osmo-nitb_10.42.42.2: Starting osmo-nitb 08:27:58.772245 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=28257): Launched 08:27:59.074744 run osmo-nitb_10.42.42.2(pid=28258): Launched 08:27:59.243577 run osmo-nitb_10.42.42.2(pid=28258): ERR: Terminated: ERROR {rc=2} [trial-2402↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=28258)] 08:27:59.378808 run osmo-nitb_10.42.42.2(pid=28258): stdout: | (launched: 2022-12-14_08:27:59.017393) 08:27:59.515448 run osmo-nitb_10.42.42.2(pid=28258): stderr: | (launched: 2022-12-14_08:27:59.062199) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 08:27:59.651999 run osmo-nitb_10.42.42.2(pid=28258): stdout: | (launched: 2022-12-14_08:27:59.017393) 08:27:59.783213 run osmo-nitb_10.42.42.2(pid=28258): stderr: | (launched: 2022-12-14_08:27:59.062199) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fe4ae4b0268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=28258): Process ended prematurely: osmo-nitb_10.42.42.2(pid=28258) [trial-2402↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=28258)] 08:28:00.190662 tst osmo-nitb_10.42.42.2(pid=28258): stdout: | (launched: 2022-12-14_08:27:59.017393) 08:28:00.313112 tst osmo-nitb_10.42.42.2(pid=28258): stderr: | (launched: 2022-12-14_08:27:59.062199) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 08:28:00.456555 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=28258): Process ended prematurely: osmo-nitb_10.42.42.2(pid=28258) [trial-2402↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=28258)] [trial-2402↪nitb_ussd:sysmo↪assert_extension.py:12] 08:28:00.465165 tst assert_extension.py:12: Test FAILED (3.1 sec) 08:28:00.471801 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=28257): Terminating (SIGTERM) 08:28:00.681296 --- ParallelTerminationStrategy: PID 28257 died... 08:28:00.701770 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=28257): Terminated: ok {rc=0} 08:28:00.785934 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2402 nitb_ussd:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 ussd:sysmo --------------------------------------------------------------------- 08:28:01.971288 tst ussd:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:28:01.979331 tst ussd:sysmo: Verifying 1 x bts (candidates: 11) 08:28:02.004783 tst ussd:sysmo: Verifying 6 x ip_address (candidates: 9) 08:28:02.039105 tst ussd:sysmo: Verifying 1 x modem (candidates: 12) 08:28:02.081713 tst ussd:sysmo: Reserving 1 x bts (candidates: 11) 08:28:02.105472 tst ussd:sysmo: Reserving 6 x ip_address (candidates: 9) 08:28:02.136370 tst ussd:sysmo: Reserving 1 x modem (candidates: 12) 08:28:02.656829 tst ussd:sysmo: RESERVED RESOURCES for ussd: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2402 ussd:sysmo assert_extension.py ---------------------------------------------- 08:28:02.662193 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 08:28:02.673386 tst ussd:sysmo: Using 1 x bts (candidates: 1) 08:28:02.710574 tst assert_extension.py: using LAC 39660 08:28:02.830907 tst assert_extension.py: using RAC 135 08:28:02.948188 tst assert_extension.py: using CellId 39660 08:28:03.068327 tst assert_extension.py: using BVCI 39661 08:28:03.179707 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 08:28:03.190506 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 08:28:03.201041 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 08:28:03.211405 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 08:28:03.222447 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 08:28:03.233371 tst ussd:sysmo: Using 1 x modem (candidates: 1) 08:28:03.351674 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:28:03.873468 run create_hlr_db(pid=28262): Launched 08:28:03.994347 bus /sierra_2: Setting Powered False 08:28:05.053856 run create_hlr_db(pid=28262): Terminated: ok {rc=0} 08:28:05.476198 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28264): Launched 08:28:05.781082 run osmo-hlr_10.42.42.2(pid=28265): Launched 08:28:05.897944 run osmo-stp_10.42.42.5: Starting osmo-stp 08:28:06.418364 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28267): Launched 08:28:06.721438 run osmo-stp_10.42.42.5(pid=28268): Launched 08:28:06.837883 run osmo-msc_10.42.42.6: Starting osmo-msc 08:28:07.384304 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28270): Launched 08:28:07.689683 run osmo-msc_10.42.42.6(pid=28271): Launched 08:28:07.859838 run osmo-stp_10.42.42.5(pid=28268): ERR: Terminated: ERROR {rc=1} [trial-2402↪ussd:sysmo↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28268)] 08:28:07.988333 run osmo-stp_10.42.42.5(pid=28268): stdout: | (launched: 2022-12-14_08:28:06.663872) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:28:08.116761 run osmo-stp_10.42.42.5(pid=28268): stderr: | 20221214082806837 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214082806838 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214082806838 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214082806838 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214082806841 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214082806841 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214082806841 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:28:08.243365 run osmo-stp_10.42.42.5(pid=28268): stdout: | (launched: 2022-12-14_08:28:06.663872) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:28:08.363336 run osmo-stp_10.42.42.5(pid=28268): stderr: | 20221214082806837 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214082806838 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214082806838 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214082806838 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214082806841 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214082806841 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214082806841 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:28:08.506781 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=28268): Process ended prematurely: osmo-stp_10.42.42.5(pid=28268) [trial-2402↪ussd:sysmo↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28268)] [trial-2402↪ussd:sysmo↪assert_extension.py:17] 08:28:08.515269 tst assert_extension.py:17: Test FAILED (5.8 sec) 08:28:08.541444 run osmo-hlr_10.42.42.2(pid=28265): ERR: Terminated: ERROR {rc=237} [trial-2402↪ussd:sysmo↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28265)] 08:28:08.590384 run osmo-hlr_10.42.42.2(pid=28265): stdout: | (launched: 2022-12-14_08:28:05.723713) 08:28:08.640359 run osmo-hlr_10.42.42.2(pid=28265): stderr: | 20221214082805903 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214082805903 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214082805903 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214082805903 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214082805903 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214082805903 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214082805962 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/ussd:sysmo/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214082805971 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214082805972 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214082805972 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:28:08.710208 run osmo-msc_10.42.42.6(pid=28271): ERR: Terminated: ERROR {rc=2} [trial-2402↪ussd:sysmo↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28271)] 08:28:08.758355 run osmo-msc_10.42.42.6(pid=28271): stdout: | (launched: 2022-12-14_08:28:07.632060) 08:28:08.808316 run osmo-msc_10.42.42.6(pid=28271): stderr: | 20221214082807905 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214082807906 DLGLOBAL DEBUG validating counter group 0x7f090d168c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214082807906 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214082807906 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214082807906 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214082807906 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214082807908 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214082807908 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214082807908 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214082807908 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:28:08.858685 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28264): Terminating (SIGTERM) 08:28:08.898914 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28267): Terminating (SIGTERM) 08:28:08.939095 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28270): Terminating (SIGTERM) 08:28:08.979502 --- ParallelTerminationStrategy: PID 28264 died... 08:28:08.999027 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28264): Terminated: ok {rc=0} 08:28:09.043579 --- ParallelTerminationStrategy: PID 28267 died... 08:28:09.062725 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28267): Terminated: ok {rc=0} 08:28:09.107356 --- ParallelTerminationStrategy: PID 28270 died... 08:28:09.126401 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28270): Terminated: ok {rc=0} 08:28:09.212888 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2402 ussd:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 08:28:10.406479 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:28:10.412940 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 08:28:10.433489 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 08:28:10.460537 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 08:28:10.512102 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 08:28:10.532805 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 08:28:10.559953 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 08:28:11.109911 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2402 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 08:28:11.162359 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:28:11.173589 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 08:28:11.232606 tst mo_mt_call.py: using LAC 39661 08:28:11.357389 tst mo_mt_call.py: using RAC 136 08:28:11.481742 tst mo_mt_call.py: using CellId 39661 08:28:11.603033 tst mo_mt_call.py: using BVCI 39662 08:28:11.716805 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:28:11.728150 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:28:11.739065 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:28:11.750118 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:28:11.761394 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:28:11.772688 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 08:28:11.892854 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 08:28:12.009879 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:28:12.491049 run create_hlr_db(pid=28276): Launched 08:28:12.609917 bus /sierra_2: Setting Powered False 08:28:13.671246 run create_hlr_db(pid=28276): Terminated: ok {rc=0} 08:28:14.147532 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28278): Launched 08:28:14.480199 run osmo-hlr_10.42.42.2(pid=28279): Launched 08:28:14.608709 run osmo-stp_10.42.42.5: Starting osmo-stp 08:28:15.184183 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28281): Launched 08:28:15.514474 run osmo-stp_10.42.42.5(pid=28282): Launched 08:28:15.639619 run osmo-msc_10.42.42.6: Starting osmo-msc 08:28:16.265733 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28284): Launched 08:28:16.592512 run osmo-msc_10.42.42.6(pid=28285): Launched 08:28:17.041791 run osmo-stp_10.42.42.5(pid=28282): ERR: Terminated: ERROR {rc=1} [trial-2402↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28282)] 08:28:17.367926 run osmo-stp_10.42.42.5(pid=28282): stdout: | (launched: 2022-12-14_08:28:15.452669) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:28:17.514215 run osmo-stp_10.42.42.5(pid=28282): stderr: | 20221214082815650 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214082815650 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214082815651 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214082815651 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214082815651 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214082815652 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214082815652 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:28:17.651299 run osmo-stp_10.42.42.5(pid=28282): stdout: | (launched: 2022-12-14_08:28:15.452669) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:28:17.782355 run osmo-stp_10.42.42.5(pid=28282): stderr: | 20221214082815650 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214082815650 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214082815651 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214082815651 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214082815651 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214082815652 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214082815652 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:28:17.938717 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28282): Process ended prematurely: osmo-stp_10.42.42.5(pid=28282) [trial-2402↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28282)] [trial-2402↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 08:28:17.948209 tst mo_mt_call.py:8: Test FAILED (6.8 sec) 08:28:17.976080 run osmo-hlr_10.42.42.2(pid=28279): ERR: Terminated: ERROR {rc=237} [trial-2402↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28279)] 08:28:18.026465 run osmo-hlr_10.42.42.2(pid=28279): stdout: | (launched: 2022-12-14_08:28:14.418492) 08:28:18.078490 run osmo-hlr_10.42.42.2(pid=28279): stderr: | 20221214082814622 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214082814622 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214082814622 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214082814622 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214082814622 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214082814622 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214082814635 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214082814643 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214082814643 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214082814643 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:28:18.151656 run osmo-msc_10.42.42.6(pid=28285): ERR: Terminated: ERROR {rc=2} [trial-2402↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28285)] 08:28:18.201741 run osmo-msc_10.42.42.6(pid=28285): stdout: | (launched: 2022-12-14_08:28:16.532057) 08:28:18.253671 run osmo-msc_10.42.42.6(pid=28285): stderr: | 20221214082817025 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214082817026 DLGLOBAL DEBUG validating counter group 0x7f20ca0abc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214082817026 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214082817026 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214082817026 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214082817027 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214082817030 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214082817032 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214082817032 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214082817032 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:28:18.306002 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28278): Terminating (SIGTERM) 08:28:18.347940 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28281): Terminating (SIGTERM) 08:28:18.390004 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28284): Terminating (SIGTERM) 08:28:18.432084 --- ParallelTerminationStrategy: PID 28278 died... 08:28:18.452201 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28278): Terminated: ok {rc=0} 08:28:18.498604 --- ParallelTerminationStrategy: PID 28281 died... 08:28:18.518242 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28281): Terminated: ok {rc=0} 08:28:18.564570 --- ParallelTerminationStrategy: PID 28284 died... 08:28:18.584362 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28284): Terminated: ok {rc=0} 08:28:18.672780 bus /sierra_3: Setting Powered False 08:28:19.777794 bus /sierra_3: Setting Powered False 08:28:20.894295 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2402 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 08:28:22.046090 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:28:22.058382 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 08:28:22.115796 tst mo_mt_call_osmux.py: using LAC 39662 08:28:22.248224 tst mo_mt_call_osmux.py: using RAC 137 08:28:22.376682 tst mo_mt_call_osmux.py: using CellId 39662 08:28:22.503923 tst mo_mt_call_osmux.py: using BVCI 39663 08:28:22.623550 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:28:22.635265 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:28:22.646746 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:28:22.658160 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:28:22.669754 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:28:22.681343 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 08:28:22.799383 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 08:28:22.921987 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:28:23.403703 run create_hlr_db(pid=28287): Launched 08:28:23.524184 bus /sierra_2: Setting Powered False 08:28:24.588301 run create_hlr_db(pid=28287): Terminated: ok {rc=0} 08:28:25.055685 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28289): Launched 08:28:25.394117 run osmo-hlr_10.42.42.2(pid=28290): Launched 08:28:25.520360 run osmo-stp_10.42.42.5: Starting osmo-stp 08:28:26.091706 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28292): Launched 08:28:26.423485 run osmo-stp_10.42.42.5(pid=28293): Launched 08:28:26.550927 run osmo-msc_10.42.42.6: Starting osmo-msc 08:28:27.149236 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28295): Launched 08:28:27.481617 run osmo-msc_10.42.42.6(pid=28296): Launched 08:28:27.666312 run osmo-stp_10.42.42.5(pid=28293): ERR: Terminated: ERROR {rc=1} [trial-2402↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28293)] 08:28:27.804539 run osmo-stp_10.42.42.5(pid=28293): stdout: | (launched: 2022-12-14_08:28:26.361465) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:28:27.943300 run osmo-stp_10.42.42.5(pid=28293): stderr: | 20221214082826555 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214082826555 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214082826555 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214082826556 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214082826556 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214082826556 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214082826556 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:28:28.081106 run osmo-stp_10.42.42.5(pid=28293): stdout: | (launched: 2022-12-14_08:28:26.361465) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:28:28.212511 run osmo-stp_10.42.42.5(pid=28293): stderr: | 20221214082826555 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214082826555 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214082826555 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214082826556 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214082826556 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214082826556 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214082826556 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:28:28.368786 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28293): Process ended prematurely: osmo-stp_10.42.42.5(pid=28293) [trial-2402↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28293)] [trial-2402↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 08:28:28.378479 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 08:28:28.406501 run osmo-hlr_10.42.42.2(pid=28290): ERR: Terminated: ERROR {rc=237} [trial-2402↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28290)] 08:28:28.457458 run osmo-hlr_10.42.42.2(pid=28290): stdout: | (launched: 2022-12-14_08:28:25.332037) 08:28:28.509856 run osmo-hlr_10.42.42.2(pid=28290): stderr: | 20221214082825534 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214082825534 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214082825534 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214082825534 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214082825534 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214082825534 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214082825547 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214082825555 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214082825556 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214082825556 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:28:28.583175 run osmo-msc_10.42.42.6(pid=28296): ERR: Terminated: ERROR {rc=2} [trial-2402↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28296)] 08:28:28.633938 run osmo-msc_10.42.42.6(pid=28296): stdout: | (launched: 2022-12-14_08:28:27.419571) 08:28:28.686465 run osmo-msc_10.42.42.6(pid=28296): stderr: | 20221214082827748 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214082827749 DLGLOBAL DEBUG validating counter group 0x7ff1dd8a4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214082827749 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214082827749 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214082827749 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214082827749 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214082827752 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214082827752 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214082827752 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214082827752 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:28:28.739051 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28289): Terminating (SIGTERM) 08:28:28.781197 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28292): Terminating (SIGTERM) 08:28:28.823247 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28295): Terminating (SIGTERM) 08:28:28.865568 --- ParallelTerminationStrategy: PID 28289 died... 08:28:28.885776 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28289): Terminated: ok {rc=0} 08:28:28.932333 --- ParallelTerminationStrategy: PID 28292 died... 08:28:28.952126 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28292): Terminated: ok {rc=0} 08:28:28.998366 --- ParallelTerminationStrategy: PID 28295 died... 08:28:29.017978 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28295): Terminated: ok {rc=0} 08:28:29.105731 bus /sierra_3: Setting Powered False 08:28:30.204104 bus /sierra_3: Setting Powered False 08:28:31.319397 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2402 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 08:28:32.559141 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:28:32.566120 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 08:28:32.587616 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 08:28:32.615349 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 08:28:32.674073 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 08:28:32.695976 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 08:28:32.723516 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 08:28:33.273508 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2402 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 08:28:33.326375 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:28:33.338132 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 08:28:33.395364 tst mo_mt_call.py: using LAC 39663 08:28:33.523395 tst mo_mt_call.py: using RAC 138 08:28:33.650694 tst mo_mt_call.py: using CellId 39663 08:28:33.776725 tst mo_mt_call.py: using BVCI 39664 08:28:33.891561 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:28:33.902975 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:28:33.913833 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:28:33.924779 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:28:33.936749 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:28:33.948515 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 08:28:34.069072 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 08:28:34.189699 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:28:34.702554 run create_hlr_db(pid=28301): Launched 08:28:34.838583 bus /sierra_2: Setting Powered False 08:28:35.904032 run create_hlr_db(pid=28301): Terminated: ok {rc=0} 08:28:36.363135 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28303): Launched 08:28:36.695770 run osmo-hlr_10.42.42.2(pid=28304): Launched 08:28:36.823147 run osmo-stp_10.42.42.5: Starting osmo-stp 08:28:37.391215 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28306): Launched 08:28:37.722216 run osmo-stp_10.42.42.5(pid=28307): Launched 08:28:37.848868 run osmo-msc_10.42.42.6: Starting osmo-msc 08:28:38.448884 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28309): Launched 08:28:38.781512 run osmo-msc_10.42.42.6(pid=28310): Launched 08:28:38.966388 run osmo-stp_10.42.42.5(pid=28307): ERR: Terminated: ERROR {rc=1} [trial-2402↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28307)] 08:28:39.105301 run osmo-stp_10.42.42.5(pid=28307): stdout: | (launched: 2022-12-14_08:28:37.660129) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:28:39.244355 run osmo-stp_10.42.42.5(pid=28307): stderr: | 20221214082837857 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214082837857 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214082837857 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214082837858 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214082837858 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214082837858 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214082837858 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:28:39.382206 run osmo-stp_10.42.42.5(pid=28307): stdout: | (launched: 2022-12-14_08:28:37.660129) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:28:39.513093 run osmo-stp_10.42.42.5(pid=28307): stderr: | 20221214082837857 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214082837857 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214082837857 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214082837858 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214082837858 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214082837858 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214082837858 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:28:39.669631 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28307): Process ended prematurely: osmo-stp_10.42.42.5(pid=28307) [trial-2402↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28307)] [trial-2402↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 08:28:39.679144 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 08:28:39.706898 run osmo-hlr_10.42.42.2(pid=28304): ERR: Terminated: ERROR {rc=237} [trial-2402↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28304)] 08:28:39.757587 run osmo-hlr_10.42.42.2(pid=28304): stdout: | (launched: 2022-12-14_08:28:36.634024) 08:28:39.809978 run osmo-hlr_10.42.42.2(pid=28304): stderr: | 20221214082836836 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214082836836 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214082836836 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214082836836 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214082836836 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214082836836 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214082836866 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214082836875 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214082836876 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214082836876 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:28:39.882910 run osmo-msc_10.42.42.6(pid=28310): ERR: Terminated: ERROR {rc=2} [trial-2402↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28310)] 08:28:39.933705 run osmo-msc_10.42.42.6(pid=28310): stdout: | (launched: 2022-12-14_08:28:38.719629) 08:28:39.985992 run osmo-msc_10.42.42.6(pid=28310): stderr: | 20221214082839046 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214082839046 DLGLOBAL DEBUG validating counter group 0x7fda59a6ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214082839046 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214082839046 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214082839046 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214082839047 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214082839048 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214082839049 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214082839049 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214082839049 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:28:40.038601 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28303): Terminating (SIGTERM) 08:28:40.080668 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28306): Terminating (SIGTERM) 08:28:40.123132 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28309): Terminating (SIGTERM) 08:28:40.165408 --- ParallelTerminationStrategy: PID 28303 died... 08:28:40.185492 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28303): Terminated: ok {rc=0} 08:28:40.232092 --- ParallelTerminationStrategy: PID 28306 died... 08:28:40.251691 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28306): Terminated: ok {rc=0} 08:28:40.297825 --- ParallelTerminationStrategy: PID 28309 died... 08:28:40.317414 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28309): Terminated: ok {rc=0} 08:28:40.405269 bus /sierra_3: Setting Powered False 08:28:41.504140 bus /sierra_3: Setting Powered False 08:28:42.617737 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2402 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 08:28:43.762526 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:28:43.774519 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 08:28:43.831128 tst mo_mt_call_osmux.py: using LAC 39664 08:28:43.953232 tst mo_mt_call_osmux.py: using RAC 139 08:28:44.076359 tst mo_mt_call_osmux.py: using CellId 39664 08:28:44.199082 tst mo_mt_call_osmux.py: using BVCI 39665 08:28:44.313080 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:28:44.324363 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:28:44.335476 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:28:44.346454 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:28:44.358021 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:28:44.369578 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 08:28:44.490776 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 08:28:44.609478 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:28:45.089869 run create_hlr_db(pid=28312): Launched 08:28:45.209829 bus /sierra_2: Setting Powered False 08:28:46.293011 run create_hlr_db(pid=28312): Terminated: ok {rc=0} 08:28:46.778738 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28314): Launched 08:28:47.096892 run osmo-hlr_10.42.42.2(pid=28315): Launched 08:28:47.326537 run osmo-stp_10.42.42.5: Starting osmo-stp 08:28:47.895713 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28317): Launched 08:28:48.228722 run osmo-stp_10.42.42.5(pid=28318): Launched 08:28:48.356291 run osmo-msc_10.42.42.6: Starting osmo-msc 08:28:48.953207 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28321): Launched 08:28:49.286018 run osmo-msc_10.42.42.6(pid=28322): Launched 08:28:49.472080 run osmo-stp_10.42.42.5(pid=28318): ERR: Terminated: ERROR {rc=1} [trial-2402↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28318)] 08:28:49.610544 run osmo-stp_10.42.42.5(pid=28318): stdout: | (launched: 2022-12-14_08:28:48.166999) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:28:49.749907 run osmo-stp_10.42.42.5(pid=28318): stderr: | 20221214082848361 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214082848362 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214082848362 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214082848362 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214082848363 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214082848363 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214082848363 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:28:49.887998 run osmo-stp_10.42.42.5(pid=28318): stdout: | (launched: 2022-12-14_08:28:48.166999) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:28:50.019263 run osmo-stp_10.42.42.5(pid=28318): stderr: | 20221214082848361 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214082848362 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214082848362 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214082848362 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214082848363 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214082848363 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214082848363 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:28:50.176583 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28318): Process ended prematurely: osmo-stp_10.42.42.5(pid=28318) [trial-2402↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28318)] [trial-2402↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 08:28:50.186511 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 08:28:50.214174 run osmo-hlr_10.42.42.2(pid=28315): ERR: Terminated: ERROR {rc=237} [trial-2402↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28315)] 08:28:50.264210 run osmo-hlr_10.42.42.2(pid=28315): stdout: | (launched: 2022-12-14_08:28:47.037244) 08:28:50.316079 run osmo-hlr_10.42.42.2(pid=28315): stderr: | 20221214082847276 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214082847276 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214082847276 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214082847276 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214082847276 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214082847276 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214082847289 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214082847297 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214082847297 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214082847297 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:28:50.388084 run osmo-msc_10.42.42.6(pid=28322): ERR: Terminated: ERROR {rc=2} [trial-2402↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28322)] 08:28:50.438083 run osmo-msc_10.42.42.6(pid=28322): stdout: | (launched: 2022-12-14_08:28:49.223682) 08:28:50.490036 run osmo-msc_10.42.42.6(pid=28322): stderr: | 20221214082849549 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214082849549 DLGLOBAL DEBUG validating counter group 0x7fa6a7c02c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214082849549 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214082849549 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214082849549 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214082849549 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214082849551 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214082849551 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214082849551 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214082849552 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:28:50.541936 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28314): Terminating (SIGTERM) 08:28:50.583454 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28317): Terminating (SIGTERM) 08:28:50.625164 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28321): Terminating (SIGTERM) 08:28:50.666885 --- ParallelTerminationStrategy: PID 28314 died... 08:28:50.686840 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28314): Terminated: ok {rc=0} 08:28:50.732864 --- ParallelTerminationStrategy: PID 28317 died... 08:28:50.752559 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28317): Terminated: ok {rc=0} 08:28:50.798527 --- ParallelTerminationStrategy: PID 28321 died... 08:28:50.818187 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28321): Terminated: ok {rc=0} 08:28:50.906129 bus /sierra_3: Setting Powered False 08:28:52.005646 bus /sierra_3: Setting Powered False 08:28:53.122136 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2402 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 08:28:54.362990 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:28:54.370279 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 08:28:54.392911 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 08:28:54.421534 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 08:28:54.476092 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 08:28:54.497992 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 08:28:54.525522 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 08:28:55.075969 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2402 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 08:28:55.127648 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:28:55.138934 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 08:28:55.194078 tst mo_mt_call.py: using LAC 39665 08:28:55.314396 tst mo_mt_call.py: using RAC 140 08:28:55.436480 tst mo_mt_call.py: using CellId 39665 08:28:55.555900 tst mo_mt_call.py: using BVCI 39666 08:28:55.668732 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:28:55.679939 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:28:55.690847 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:28:55.701717 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:28:55.712789 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:28:55.724129 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 08:28:55.843127 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 08:28:55.961286 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:28:56.443615 run create_hlr_db(pid=28327): Launched 08:28:56.562166 bus /sierra_2: Setting Powered False 08:28:57.623438 run create_hlr_db(pid=28327): Terminated: ok {rc=0} 08:28:58.075502 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28329): Launched 08:28:58.409429 run osmo-hlr_10.42.42.2(pid=28330): Launched 08:28:58.536696 run osmo-stp_10.42.42.5: Starting osmo-stp 08:28:59.141208 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28332): Launched 08:28:59.460918 run osmo-stp_10.42.42.5(pid=28346): Launched 08:28:59.581698 run osmo-msc_10.42.42.6: Starting osmo-msc 08:29:00.147476 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28348): Launched 08:29:00.459394 run osmo-msc_10.42.42.6(pid=28349): Launched 08:29:00.634530 run osmo-stp_10.42.42.5(pid=28346): ERR: Terminated: ERROR {rc=1} [trial-2402↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28346)] 08:29:00.764644 run osmo-stp_10.42.42.5(pid=28346): stdout: | (launched: 2022-12-14_08:28:59.400443) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:29:00.900897 run osmo-stp_10.42.42.5(pid=28346): stderr: | 20221214082859575 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214082859576 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214082859576 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214082859576 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214082859577 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214082859577 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214082859577 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:29:01.035134 run osmo-stp_10.42.42.5(pid=28346): stdout: | (launched: 2022-12-14_08:28:59.400443) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:29:01.171612 run osmo-stp_10.42.42.5(pid=28346): stderr: | 20221214082859575 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214082859576 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214082859576 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214082859576 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214082859577 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214082859577 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214082859577 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:29:01.334092 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28346): Process ended prematurely: osmo-stp_10.42.42.5(pid=28346) [trial-2402↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28346)] [trial-2402↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 08:29:01.344500 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 08:29:01.373648 run osmo-hlr_10.42.42.2(pid=28330): ERR: Terminated: ERROR {rc=237} [trial-2402↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28330)] 08:29:01.428123 run osmo-hlr_10.42.42.2(pid=28330): stdout: | (launched: 2022-12-14_08:28:58.347458) 08:29:01.482097 run osmo-hlr_10.42.42.2(pid=28330): stderr: | 20221214082858551 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214082858551 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214082858551 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214082858551 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214082858551 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214082858551 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214082858563 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214082858572 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214082858573 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214082858573 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:29:01.557321 run osmo-msc_10.42.42.6(pid=28349): ERR: Terminated: ERROR {rc=2} [trial-2402↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28349)] 08:29:01.610515 run osmo-msc_10.42.42.6(pid=28349): stdout: | (launched: 2022-12-14_08:29:00.400941) 08:29:01.664526 run osmo-msc_10.42.42.6(pid=28349): stderr: | 20221214082900674 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214082900674 DLGLOBAL DEBUG validating counter group 0x7fbf791aec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214082900674 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214082900674 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214082900675 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214082900675 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214082900676 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214082900677 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214082900677 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214082900677 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:29:01.718357 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28329): Terminating (SIGTERM) 08:29:01.761630 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28332): Terminating (SIGTERM) 08:29:01.807764 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28348): Terminating (SIGTERM) 08:29:01.851709 --- ParallelTerminationStrategy: PID 28329 died... 08:29:01.872425 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28329): Terminated: ok {rc=0} 08:29:01.921630 --- ParallelTerminationStrategy: PID 28332 died... 08:29:01.941902 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28332): Terminated: ok {rc=0} 08:29:01.989335 --- ParallelTerminationStrategy: PID 28348 died... 08:29:02.010759 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28348): Terminated: ok {rc=0} 08:29:02.118229 bus /sierra_3: Setting Powered False 08:29:03.232070 bus /sierra_3: Setting Powered False 08:29:04.348218 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2402 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 08:29:05.499749 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:29:05.512141 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 08:29:05.570441 tst mo_mt_call_osmux.py: using LAC 39666 08:29:05.699849 tst mo_mt_call_osmux.py: using RAC 141 08:29:05.827818 tst mo_mt_call_osmux.py: using CellId 39666 08:29:05.950044 tst mo_mt_call_osmux.py: using BVCI 39667 08:29:06.065759 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:29:06.076715 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:29:06.087994 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:29:06.099328 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:29:06.111245 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:29:06.122995 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 08:29:06.245816 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 08:29:06.366423 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:29:06.882965 run create_hlr_db(pid=28351): Launched 08:29:07.019460 bus /sierra_2: Setting Powered False 08:29:08.080595 run create_hlr_db(pid=28351): Terminated: ok {rc=0} 08:29:08.540645 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28353): Launched 08:29:08.873289 run osmo-hlr_10.42.42.2(pid=28354): Launched 08:29:09.000470 run osmo-stp_10.42.42.5: Starting osmo-stp 08:29:09.575255 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28356): Launched 08:29:09.905474 run osmo-stp_10.42.42.5(pid=28357): Launched 08:29:10.031507 run osmo-msc_10.42.42.6: Starting osmo-msc 08:29:10.630344 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28359): Launched 08:29:10.963172 run osmo-msc_10.42.42.6(pid=28360): Launched 08:29:11.149891 run osmo-stp_10.42.42.5(pid=28357): ERR: Terminated: ERROR {rc=1} [trial-2402↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28357)] 08:29:11.287822 run osmo-stp_10.42.42.5(pid=28357): stdout: | (launched: 2022-12-14_08:29:09.843597) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:29:11.427249 run osmo-stp_10.42.42.5(pid=28357): stderr: | 20221214082910038 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214082910039 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214082910039 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214082910039 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214082910040 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214082910040 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214082910040 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:29:11.564936 run osmo-stp_10.42.42.5(pid=28357): stdout: | (launched: 2022-12-14_08:29:09.843597) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:29:11.695543 run osmo-stp_10.42.42.5(pid=28357): stderr: | 20221214082910038 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214082910039 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214082910039 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214082910039 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214082910040 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214082910040 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214082910040 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:29:11.851852 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28357): Process ended prematurely: osmo-stp_10.42.42.5(pid=28357) [trial-2402↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28357)] [trial-2402↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 08:29:11.861607 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 08:29:11.889340 run osmo-hlr_10.42.42.2(pid=28354): ERR: Terminated: ERROR {rc=237} [trial-2402↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28354)] 08:29:11.940052 run osmo-hlr_10.42.42.2(pid=28354): stdout: | (launched: 2022-12-14_08:29:08.811316) 08:29:11.992493 run osmo-hlr_10.42.42.2(pid=28354): stderr: | 20221214082909016 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214082909016 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214082909016 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214082909016 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214082909016 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214082909016 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214082909029 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214082909037 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214082909037 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214082909037 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:29:12.064698 run osmo-msc_10.42.42.6(pid=28360): ERR: Terminated: ERROR {rc=2} [trial-2402↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28360)] 08:29:12.114878 run osmo-msc_10.42.42.6(pid=28360): stdout: | (launched: 2022-12-14_08:29:10.900570) 08:29:12.167707 run osmo-msc_10.42.42.6(pid=28360): stderr: | 20221214082911228 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214082911229 DLGLOBAL DEBUG validating counter group 0x7f6b4bcb6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214082911229 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214082911229 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214082911229 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214082911229 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214082911231 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214082911231 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214082911231 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214082911231 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:29:12.220001 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28353): Terminating (SIGTERM) 08:29:12.261850 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28356): Terminating (SIGTERM) 08:29:12.303403 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28359): Terminating (SIGTERM) 08:29:12.345893 --- ParallelTerminationStrategy: PID 28353 died... 08:29:12.365815 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28353): Terminated: ok {rc=0} 08:29:12.411624 --- ParallelTerminationStrategy: PID 28356 died... 08:29:12.431158 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28356): Terminated: ok {rc=0} 08:29:12.476876 --- ParallelTerminationStrategy: PID 28359 died... 08:29:12.496772 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28359): Terminated: ok {rc=0} 08:29:12.584203 bus /sierra_3: Setting Powered False 08:29:13.679979 bus /sierra_3: Setting Powered False 08:29:14.793269 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2402 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 08:29:16.062167 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:29:16.070094 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 08:29:16.093257 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 08:29:16.122912 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 08:29:16.180004 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 08:29:16.213652 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 08:29:16.242445 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 08:29:16.776333 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2402 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 08:29:16.845663 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 08:29:16.860874 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 08:29:16.928332 tst mo_mt_call.py: using LAC 39667 08:29:17.061742 tst mo_mt_call.py: using RAC 142 08:29:17.189918 tst mo_mt_call.py: using CellId 39667 08:29:17.312895 tst mo_mt_call.py: using BVCI 39668 08:29:17.428515 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 08:29:17.439856 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 08:29:17.451035 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 08:29:17.462098 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 08:29:17.473292 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 08:29:17.484645 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 08:29:17.606579 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 08:29:17.726796 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:29:18.240433 run create_hlr_db(pid=28366): Launched 08:29:18.375241 bus /sierra_2: Setting Powered False 08:29:19.440104 run create_hlr_db(pid=28366): Terminated: ok {rc=0} 08:29:19.897317 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28368): Launched 08:29:20.229976 run osmo-hlr_10.42.42.2(pid=28369): Launched 08:29:20.354949 run osmo-stp_10.42.42.5: Starting osmo-stp 08:29:20.920622 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28371): Launched 08:29:21.252306 run osmo-stp_10.42.42.5(pid=28372): Launched 08:29:21.381366 run osmo-msc_10.42.42.6: Starting osmo-msc 08:29:21.978056 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28374): Launched 08:29:22.311605 run osmo-msc_10.42.42.6(pid=28375): Launched 08:29:22.496313 run osmo-stp_10.42.42.5(pid=28372): ERR: Terminated: ERROR {rc=1} [trial-2402↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28372)] 08:29:22.634190 run osmo-stp_10.42.42.5(pid=28372): stdout: | (launched: 2022-12-14_08:29:21.190823) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:29:22.772473 run osmo-stp_10.42.42.5(pid=28372): stderr: | 20221214082921385 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214082921385 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214082921385 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214082921385 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214082921388 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214082921388 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214082921388 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:29:22.910205 run osmo-stp_10.42.42.5(pid=28372): stdout: | (launched: 2022-12-14_08:29:21.190823) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:29:23.041084 run osmo-stp_10.42.42.5(pid=28372): stderr: | 20221214082921385 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214082921385 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214082921385 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214082921385 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214082921388 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214082921388 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214082921388 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:29:23.197930 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28372): Process ended prematurely: osmo-stp_10.42.42.5(pid=28372) [trial-2402↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28372)] [trial-2402↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 08:29:23.207521 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 08:29:23.235102 run osmo-hlr_10.42.42.2(pid=28369): ERR: Terminated: ERROR {rc=237} [trial-2402↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28369)] 08:29:23.285733 run osmo-hlr_10.42.42.2(pid=28369): stdout: | (launched: 2022-12-14_08:29:20.167536) 08:29:23.337461 run osmo-hlr_10.42.42.2(pid=28369): stderr: | 20221214082920369 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214082920369 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214082920369 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214082920369 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214082920369 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214082920369 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214082920382 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214082920390 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214082920390 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214082920391 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:29:23.409388 run osmo-msc_10.42.42.6(pid=28375): ERR: Terminated: ERROR {rc=2} [trial-2402↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28375)] 08:29:23.459279 run osmo-msc_10.42.42.6(pid=28375): stdout: | (launched: 2022-12-14_08:29:22.249807) 08:29:23.510919 run osmo-msc_10.42.42.6(pid=28375): stderr: | 20221214082922573 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214082922574 DLGLOBAL DEBUG validating counter group 0x7f34ce018c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214082922574 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214082922574 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214082922574 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214082922574 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214082922576 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214082922576 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214082922576 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214082922576 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:29:23.562880 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28368): Terminating (SIGTERM) 08:29:23.604441 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28371): Terminating (SIGTERM) 08:29:23.646112 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28374): Terminating (SIGTERM) 08:29:23.687942 --- ParallelTerminationStrategy: PID 28368 died... 08:29:23.707500 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28368): Terminated: ok {rc=0} 08:29:23.753952 --- ParallelTerminationStrategy: PID 28371 died... 08:29:23.773471 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28371): Terminated: ok {rc=0} 08:29:23.819397 --- ParallelTerminationStrategy: PID 28374 died... 08:29:23.838859 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28374): Terminated: ok {rc=0} 08:29:23.926534 bus /sierra_3: Setting Powered False 08:29:25.024909 bus /sierra_3: Setting Powered False 08:29:26.139693 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2402 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 08:29:27.293219 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 08:29:27.305759 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 08:29:27.364673 tst mo_mt_call_osmux.py: using LAC 39668 08:29:27.495751 tst mo_mt_call_osmux.py: using RAC 143 08:29:27.624942 tst mo_mt_call_osmux.py: using CellId 39668 08:29:27.755289 tst mo_mt_call_osmux.py: using BVCI 39669 08:29:27.877160 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 08:29:27.888700 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 08:29:27.900144 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 08:29:27.911540 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 08:29:27.923018 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 08:29:27.934489 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 08:29:28.054726 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 08:29:28.172472 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:29:28.654142 run create_hlr_db(pid=28377): Launched 08:29:28.775376 bus /sierra_2: Setting Powered False 08:29:29.837267 run create_hlr_db(pid=28377): Terminated: ok {rc=0} 08:29:30.289462 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28379): Launched 08:29:30.623842 run osmo-hlr_10.42.42.2(pid=28380): Launched 08:29:30.752277 run osmo-stp_10.42.42.5: Starting osmo-stp 08:29:31.394089 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28382): Launched 08:29:31.728757 run osmo-stp_10.42.42.5(pid=28383): Launched 08:29:32.035155 run osmo-msc_10.42.42.6: Starting osmo-msc 08:29:32.676448 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28385): Launched 08:29:32.988875 run osmo-msc_10.42.42.6(pid=28386): Launched 08:29:33.162823 run osmo-stp_10.42.42.5(pid=28383): ERR: Terminated: ERROR {rc=1} [trial-2402↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28383)] 08:29:33.293421 run osmo-stp_10.42.42.5(pid=28383): stdout: | (launched: 2022-12-14_08:29:31.669010) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:29:33.424012 run osmo-stp_10.42.42.5(pid=28383): stderr: | 20221214082931954 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214082931954 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214082931955 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214082931955 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214082931957 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214082931958 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214082931958 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:29:33.552717 run osmo-stp_10.42.42.5(pid=28383): stdout: | (launched: 2022-12-14_08:29:31.669010) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:29:33.675271 run osmo-stp_10.42.42.5(pid=28383): stderr: | 20221214082931954 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214082931954 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214082931955 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214082931955 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214082931957 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214082931958 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214082931958 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:29:33.822144 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28383): Process ended prematurely: osmo-stp_10.42.42.5(pid=28383) [trial-2402↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28383)] [trial-2402↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 08:29:33.831177 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 08:29:33.857711 run osmo-hlr_10.42.42.2(pid=28380): ERR: Terminated: ERROR {rc=237} [trial-2402↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28380)] 08:29:33.906548 run osmo-hlr_10.42.42.2(pid=28380): stdout: | (launched: 2022-12-14_08:29:30.561728) 08:29:33.956746 run osmo-hlr_10.42.42.2(pid=28380): stderr: | 20221214082930763 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214082930763 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214082930763 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214082930763 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214082930763 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214082930763 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214082930775 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214082930784 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214082930784 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214082930784 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:29:34.027019 run osmo-msc_10.42.42.6(pid=28386): ERR: Terminated: ERROR {rc=2} [trial-2402↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28386)] 08:29:34.074936 run osmo-msc_10.42.42.6(pid=28386): stdout: | (launched: 2022-12-14_08:29:32.930467) 08:29:34.125450 run osmo-msc_10.42.42.6(pid=28386): stderr: | 20221214082933206 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214082933206 DLGLOBAL DEBUG validating counter group 0x7f8ea5488c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214082933207 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214082933207 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214082933207 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214082933207 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214082933210 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214082933211 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214082933211 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214082933211 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:29:34.176057 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28379): Terminating (SIGTERM) 08:29:34.216189 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28382): Terminating (SIGTERM) 08:29:34.256292 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28385): Terminating (SIGTERM) 08:29:34.296428 --- ParallelTerminationStrategy: PID 28379 died... 08:29:34.316126 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28379): Terminated: ok {rc=0} 08:29:34.361059 --- ParallelTerminationStrategy: PID 28382 died... 08:29:34.380162 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28382): Terminated: ok {rc=0} 08:29:34.424546 --- ParallelTerminationStrategy: PID 28385 died... 08:29:34.443508 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28385): Terminated: ok {rc=0} 08:29:34.528478 bus /sierra_3: Setting Powered False 08:29:35.627316 bus /sierra_3: Setting Powered False 08:29:36.746054 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2402 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 08:29:37.985514 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:29:37.992902 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 08:29:38.014616 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 08:29:38.042667 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 08:29:38.095393 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 08:29:38.117146 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 08:29:38.144632 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 08:29:38.693452 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2402 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 08:29:38.743878 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:29:38.755036 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 08:29:38.812084 tst mo_mt_call.py: using LAC 39669 08:29:38.934356 tst mo_mt_call.py: using RAC 144 08:29:39.058087 tst mo_mt_call.py: using CellId 39669 08:29:39.181648 tst mo_mt_call.py: using BVCI 39670 08:29:39.294163 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:29:39.305361 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:29:39.316220 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:29:39.327130 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:29:39.338401 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:29:39.349666 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 08:29:39.469652 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 08:29:39.587974 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:29:40.071149 run create_hlr_db(pid=28391): Launched 08:29:40.189791 bus /sierra_2: Setting Powered False 08:29:41.251337 run create_hlr_db(pid=28391): Terminated: ok {rc=0} 08:29:41.701868 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28393): Launched 08:29:42.034619 run osmo-hlr_10.42.42.2(pid=28394): Launched 08:29:42.163169 run osmo-stp_10.42.42.5: Starting osmo-stp 08:29:42.733351 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28396): Launched 08:29:43.066817 run osmo-stp_10.42.42.5(pid=28397): Launched 08:29:43.194293 run osmo-msc_10.42.42.6: Starting osmo-msc 08:29:43.794630 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28399): Launched 08:29:44.128500 run osmo-msc_10.42.42.6(pid=28400): Launched 08:29:44.314880 run osmo-stp_10.42.42.5(pid=28397): ERR: Terminated: ERROR {rc=1} [trial-2402↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28397)] 08:29:44.454327 run osmo-stp_10.42.42.5(pid=28397): stdout: | (launched: 2022-12-14_08:29:43.004535) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:29:44.593350 run osmo-stp_10.42.42.5(pid=28397): stderr: | 20221214082943201 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214082943202 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214082943202 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214082943202 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214082943203 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214082943203 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214082943203 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:29:44.730856 run osmo-stp_10.42.42.5(pid=28397): stdout: | (launched: 2022-12-14_08:29:43.004535) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:29:44.861961 run osmo-stp_10.42.42.5(pid=28397): stderr: | 20221214082943201 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214082943202 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214082943202 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214082943202 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214082943203 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214082943203 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214082943203 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:29:45.018783 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28397): Process ended prematurely: osmo-stp_10.42.42.5(pid=28397) [trial-2402↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28397)] [trial-2402↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 08:29:45.028357 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 08:29:45.056282 run osmo-hlr_10.42.42.2(pid=28394): ERR: Terminated: ERROR {rc=237} [trial-2402↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28394)] 08:29:45.107010 run osmo-hlr_10.42.42.2(pid=28394): stdout: | (launched: 2022-12-14_08:29:41.972401) 08:29:45.159690 run osmo-hlr_10.42.42.2(pid=28394): stderr: | 20221214082942175 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214082942175 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214082942175 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214082942175 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214082942175 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214082942175 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214082942187 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214082942198 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214082942198 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214082942198 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:29:45.232113 run osmo-msc_10.42.42.6(pid=28400): ERR: Terminated: ERROR {rc=2} [trial-2402↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28400)] 08:29:45.282557 run osmo-msc_10.42.42.6(pid=28400): stdout: | (launched: 2022-12-14_08:29:44.066316) 08:29:45.334848 run osmo-msc_10.42.42.6(pid=28400): stderr: | 20221214082944390 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214082944390 DLGLOBAL DEBUG validating counter group 0x7fa4036d9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214082944390 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214082944390 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214082944390 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214082944391 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214082944392 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214082944393 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214082944393 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214082944393 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:29:45.387413 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28393): Terminating (SIGTERM) 08:29:45.429576 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28396): Terminating (SIGTERM) 08:29:45.471655 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28399): Terminating (SIGTERM) 08:29:45.513834 --- ParallelTerminationStrategy: PID 28393 died... 08:29:45.534005 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28393): Terminated: ok {rc=0} 08:29:45.580716 --- ParallelTerminationStrategy: PID 28396 died... 08:29:45.600594 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28396): Terminated: ok {rc=0} 08:29:45.646902 --- ParallelTerminationStrategy: PID 28399 died... 08:29:45.666715 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28399): Terminated: ok {rc=0} 08:29:45.755189 bus /sierra_3: Setting Powered False 08:29:46.853019 bus /sierra_3: Setting Powered False 08:29:47.972758 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2402 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 08:29:49.120179 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:29:49.132006 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 08:29:49.188216 tst mo_mt_call_osmux.py: using LAC 39670 08:29:49.311513 tst mo_mt_call_osmux.py: using RAC 145 08:29:49.434121 tst mo_mt_call_osmux.py: using CellId 39670 08:29:49.557629 tst mo_mt_call_osmux.py: using BVCI 39671 08:29:49.670201 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:29:49.681342 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:29:49.692295 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:29:49.703162 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:29:49.714374 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:29:49.725650 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 08:29:49.842246 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 08:29:49.965436 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:29:50.480604 run create_hlr_db(pid=28402): Launched 08:29:50.616810 bus /sierra_2: Setting Powered False 08:29:51.681208 run create_hlr_db(pid=28402): Terminated: ok {rc=0} 08:29:52.122139 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28404): Launched 08:29:52.431200 run osmo-hlr_10.42.42.2(pid=28405): Launched 08:29:52.551064 run osmo-stp_10.42.42.5: Starting osmo-stp 08:29:53.083789 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28407): Launched 08:29:53.394848 run osmo-stp_10.42.42.5(pid=28408): Launched 08:29:53.514648 run osmo-msc_10.42.42.6: Starting osmo-msc 08:29:54.073681 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28410): Launched 08:29:54.385263 run osmo-msc_10.42.42.6(pid=28411): Launched 08:29:54.558295 run osmo-stp_10.42.42.5(pid=28408): ERR: Terminated: ERROR {rc=1} [trial-2402↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28408)] 08:29:54.688794 run osmo-stp_10.42.42.5(pid=28408): stdout: | (launched: 2022-12-14_08:29:53.336488) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:29:54.819226 run osmo-stp_10.42.42.5(pid=28408): stderr: | 20221214082953510 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214082953511 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214082953511 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214082953511 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214082953512 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214082953512 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214082953512 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:29:54.947789 run osmo-stp_10.42.42.5(pid=28408): stdout: | (launched: 2022-12-14_08:29:53.336488) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:29:55.070529 run osmo-stp_10.42.42.5(pid=28408): stderr: | 20221214082953510 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214082953511 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214082953511 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214082953511 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214082953512 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214082953512 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214082953512 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:29:55.217268 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28408): Process ended prematurely: osmo-stp_10.42.42.5(pid=28408) [trial-2402↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28408)] [trial-2402↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 08:29:55.226428 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 08:29:55.253020 run osmo-hlr_10.42.42.2(pid=28405): ERR: Terminated: ERROR {rc=237} [trial-2402↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28405)] 08:29:55.301571 run osmo-hlr_10.42.42.2(pid=28405): stdout: | (launched: 2022-12-14_08:29:52.373118) 08:29:55.351471 run osmo-hlr_10.42.42.2(pid=28405): stderr: | 20221214082952553 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214082952553 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214082952553 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214082952553 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214082952553 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214082952553 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214082952571 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214082952582 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214082952583 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214082952583 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:29:55.421258 run osmo-msc_10.42.42.6(pid=28411): ERR: Terminated: ERROR {rc=2} [trial-2402↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28411)] 08:29:55.469139 run osmo-msc_10.42.42.6(pid=28411): stdout: | (launched: 2022-12-14_08:29:54.326537) 08:29:55.518911 run osmo-msc_10.42.42.6(pid=28411): stderr: | 20221214082954603 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214082954603 DLGLOBAL DEBUG validating counter group 0x7f4a2a566c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214082954603 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214082954603 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214082954603 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214082954603 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214082954605 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214082954606 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214082954607 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214082954607 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:29:55.569101 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28404): Terminating (SIGTERM) 08:29:55.609374 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28407): Terminating (SIGTERM) 08:29:55.649586 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28410): Terminating (SIGTERM) 08:29:55.689955 --- ParallelTerminationStrategy: PID 28404 died... 08:29:55.709558 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28404): Terminated: ok {rc=0} 08:29:55.753834 --- ParallelTerminationStrategy: PID 28407 died... 08:29:55.772742 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28407): Terminated: ok {rc=0} 08:29:55.817176 --- ParallelTerminationStrategy: PID 28410 died... 08:29:55.836001 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28410): Terminated: ok {rc=0} 08:29:55.921681 bus /sierra_3: Setting Powered False 08:29:57.020931 bus /sierra_3: Setting Powered False 08:29:58.136592 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2402 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 08:29:59.369337 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:29:59.375754 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 08:29:59.396403 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 08:29:59.424537 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 08:29:59.476726 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 08:29:59.498652 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 08:29:59.526256 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 08:30:00.073558 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2402 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 08:30:00.124887 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:30:00.136246 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 08:30:00.193641 tst mo_mt_call.py: using LAC 39671 08:30:00.316485 tst mo_mt_call.py: using RAC 146 08:30:00.438948 tst mo_mt_call.py: using CellId 39671 08:30:00.562850 tst mo_mt_call.py: using BVCI 39672 08:30:00.676871 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:30:00.688067 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:30:00.698976 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:30:00.710022 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:30:00.721198 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:30:00.732465 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 08:30:00.856401 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 08:30:00.991760 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:30:01.518155 run create_hlr_db(pid=28419): Launched 08:30:01.694962 bus /sierra_2: Setting Powered False 08:30:02.756079 run create_hlr_db(pid=28419): Terminated: ok {rc=0} 08:30:03.218677 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28421): Launched 08:30:03.551581 run osmo-hlr_10.42.42.2(pid=28422): Launched 08:30:03.679287 run osmo-stp_10.42.42.5: Starting osmo-stp 08:30:04.251369 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28424): Launched 08:30:04.583343 run osmo-stp_10.42.42.5(pid=28425): Launched 08:30:04.711095 run osmo-msc_10.42.42.6: Starting osmo-msc 08:30:05.311358 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28427): Launched 08:30:05.643446 run osmo-msc_10.42.42.6(pid=28428): Launched 08:30:05.828230 run osmo-stp_10.42.42.5(pid=28425): ERR: Terminated: ERROR {rc=1} [trial-2402↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28425)] 08:30:05.966899 run osmo-stp_10.42.42.5(pid=28425): stdout: | (launched: 2022-12-14_08:30:04.520916) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:30:06.106765 run osmo-stp_10.42.42.5(pid=28425): stderr: | 20221214083004719 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214083004720 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214083004720 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214083004720 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214083004721 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214083004721 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214083004721 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:30:06.245696 run osmo-stp_10.42.42.5(pid=28425): stdout: | (launched: 2022-12-14_08:30:04.520916) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:30:06.377045 run osmo-stp_10.42.42.5(pid=28425): stderr: | 20221214083004719 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214083004720 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214083004720 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214083004720 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214083004721 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214083004721 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214083004721 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:30:06.534275 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28425): Process ended prematurely: osmo-stp_10.42.42.5(pid=28425) [trial-2402↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28425)] [trial-2402↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 08:30:06.544145 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 08:30:06.572551 run osmo-hlr_10.42.42.2(pid=28422): ERR: Terminated: ERROR {rc=237} [trial-2402↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28422)] 08:30:06.623422 run osmo-hlr_10.42.42.2(pid=28422): stdout: | (launched: 2022-12-14_08:30:03.489482) 08:30:06.675726 run osmo-hlr_10.42.42.2(pid=28422): stderr: | 20221214083003691 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214083003691 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214083003691 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214083003691 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214083003691 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214083003691 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214083003704 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214083003714 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214083003714 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214083003714 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:30:06.748303 run osmo-msc_10.42.42.6(pid=28428): ERR: Terminated: ERROR {rc=2} [trial-2402↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28428)] 08:30:06.798808 run osmo-msc_10.42.42.6(pid=28428): stdout: | (launched: 2022-12-14_08:30:05.581530) 08:30:06.850876 run osmo-msc_10.42.42.6(pid=28428): stderr: | 20221214083005909 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214083005909 DLGLOBAL DEBUG validating counter group 0x7f1f311f5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214083005909 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214083005909 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214083005909 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214083005909 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214083005911 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214083005911 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214083005911 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214083005912 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:30:06.902991 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28421): Terminating (SIGTERM) 08:30:06.944925 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28424): Terminating (SIGTERM) 08:30:06.987603 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28427): Terminating (SIGTERM) 08:30:07.030074 --- ParallelTerminationStrategy: PID 28421 died... 08:30:07.050270 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28421): Terminated: ok {rc=0} 08:30:07.096807 --- ParallelTerminationStrategy: PID 28424 died... 08:30:07.116723 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28424): Terminated: ok {rc=0} 08:30:07.163472 --- ParallelTerminationStrategy: PID 28427 died... 08:30:07.183239 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28427): Terminated: ok {rc=0} 08:30:07.271735 bus /sierra_3: Setting Powered False 08:30:08.371101 bus /sierra_3: Setting Powered False 08:30:09.487158 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2402 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 08:30:10.637959 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:30:10.650602 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 08:30:10.713974 tst mo_mt_call_osmux.py: using LAC 39672 08:30:10.842965 tst mo_mt_call_osmux.py: using RAC 147 08:30:10.971390 tst mo_mt_call_osmux.py: using CellId 39672 08:30:11.099842 tst mo_mt_call_osmux.py: using BVCI 39673 08:30:11.220092 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:30:11.231904 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:30:11.243513 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:30:11.255165 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:30:11.266745 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:30:11.278461 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 08:30:11.398614 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 08:30:11.516707 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:30:11.998894 run create_hlr_db(pid=28430): Launched 08:30:12.119115 bus /sierra_2: Setting Powered False 08:30:13.180278 run create_hlr_db(pid=28430): Terminated: ok {rc=0} 08:30:13.632515 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28432): Launched 08:30:13.966302 run osmo-hlr_10.42.42.2(pid=28433): Launched 08:30:14.092784 run osmo-stp_10.42.42.5: Starting osmo-stp 08:30:14.668431 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28435): Launched 08:30:15.002054 run osmo-stp_10.42.42.5(pid=28436): Launched 08:30:15.127472 run osmo-msc_10.42.42.6: Starting osmo-msc 08:30:15.726651 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28438): Launched 08:30:16.092479 run osmo-msc_10.42.42.6(pid=28439): Launched 08:30:16.588681 run osmo-stp_10.42.42.5(pid=28436): ERR: Terminated: ERROR {rc=1} [trial-2402↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28436)] 08:30:16.951952 run osmo-stp_10.42.42.5(pid=28436): stdout: | (launched: 2022-12-14_08:30:14.939791) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:30:17.085698 run osmo-stp_10.42.42.5(pid=28436): stderr: | 20221214083015138 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214083015138 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214083015138 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214083015139 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214083015139 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214083015139 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214083015139 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:30:17.220928 run osmo-stp_10.42.42.5(pid=28436): stdout: | (launched: 2022-12-14_08:30:14.939791) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:30:17.370947 run osmo-stp_10.42.42.5(pid=28436): stderr: | 20221214083015138 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214083015138 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214083015138 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214083015139 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214083015139 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214083015139 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214083015139 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:30:17.523589 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28436): Process ended prematurely: osmo-stp_10.42.42.5(pid=28436) [trial-2402↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28436)] [trial-2402↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 08:30:17.532936 tst mo_mt_call_osmux.py:8: Test FAILED (6.9 sec) 08:30:17.559864 run osmo-hlr_10.42.42.2(pid=28433): ERR: Terminated: ERROR {rc=237} [trial-2402↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28433)] 08:30:17.609016 run osmo-hlr_10.42.42.2(pid=28433): stdout: | (launched: 2022-12-14_08:30:13.904147) 08:30:17.659287 run osmo-hlr_10.42.42.2(pid=28433): stderr: | 20221214083014107 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214083014107 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214083014107 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214083014107 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214083014107 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214083014107 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214083014120 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214083014130 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214083014130 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214083014130 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:30:17.729528 run osmo-msc_10.42.42.6(pid=28439): ERR: Terminated: ERROR {rc=2} [trial-2402↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28439)] 08:30:17.777545 run osmo-msc_10.42.42.6(pid=28439): stdout: | (launched: 2022-12-14_08:30:16.022129) 08:30:17.827622 run osmo-msc_10.42.42.6(pid=28439): stderr: | 20221214083016554 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214083016555 DLGLOBAL DEBUG validating counter group 0x7fb1439dac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214083016555 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214083016555 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214083016555 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214083016555 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214083016560 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214083016561 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214083016562 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214083016562 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:30:17.877981 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28432): Terminating (SIGTERM) 08:30:17.918324 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28435): Terminating (SIGTERM) 08:30:17.958530 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28438): Terminating (SIGTERM) 08:30:17.998892 --- ParallelTerminationStrategy: PID 28432 died... 08:30:18.018755 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28432): Terminated: ok {rc=0} 08:30:18.063618 --- ParallelTerminationStrategy: PID 28435 died... 08:30:18.082569 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28435): Terminated: ok {rc=0} 08:30:18.127047 --- ParallelTerminationStrategy: PID 28438 died... 08:30:18.146249 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28438): Terminated: ok {rc=0} 08:30:18.231391 bus /sierra_3: Setting Powered False 08:30:19.330395 bus /sierra_3: Setting Powered False 08:30:20.448663 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2402 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 voice:sysmo+mod-bts0-dynts-osmo --------------------------------------------------------------------- 08:30:21.687695 tst voice:sysmo+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:30:21.693996 tst voice:sysmo+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 08:30:21.715529 tst voice:sysmo+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 08:30:21.743513 tst voice:sysmo+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 08:30:21.797132 tst voice:sysmo+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 08:30:21.818505 tst voice:sysmo+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 08:30:21.845675 tst voice:sysmo+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 08:30:22.395209 tst voice:sysmo+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2402 voice:sysmo+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 08:30:22.447849 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 08:30:22.459403 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 08:30:22.517993 tst mo_mt_call.py: using LAC 39673 08:30:22.647712 tst mo_mt_call.py: using RAC 148 08:30:22.779694 tst mo_mt_call.py: using CellId 39673 08:30:22.909042 tst mo_mt_call.py: using BVCI 39674 08:30:23.029615 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 08:30:23.040942 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 08:30:23.052137 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 08:30:23.063300 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 08:30:23.074543 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 08:30:23.085823 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 08:30:23.203987 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 08:30:23.326336 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:30:23.840614 run create_hlr_db(pid=28444): Launched 08:30:23.975333 bus /sierra_2: Setting Powered False 08:30:25.040275 run create_hlr_db(pid=28444): Terminated: ok {rc=0} 08:30:25.480161 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28446): Launched 08:30:25.791389 run osmo-hlr_10.42.42.2(pid=28447): Launched 08:30:25.909094 run osmo-stp_10.42.42.5: Starting osmo-stp 08:30:26.457400 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28449): Launched 08:30:26.770240 run osmo-stp_10.42.42.5(pid=28450): Launched 08:30:26.888664 run osmo-msc_10.42.42.6: Starting osmo-msc 08:30:27.464937 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28452): Launched 08:30:27.777150 run osmo-msc_10.42.42.6(pid=28453): Launched 08:30:27.950996 run osmo-stp_10.42.42.5(pid=28450): ERR: Terminated: ERROR {rc=1} [trial-2402↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28450)] 08:30:28.081877 run osmo-stp_10.42.42.5(pid=28450): stdout: | (launched: 2022-12-14_08:30:26.711351) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:30:28.212426 run osmo-stp_10.42.42.5(pid=28450): stderr: | 20221214083026888 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214083026888 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214083026889 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214083026889 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214083026890 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214083026890 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214083026890 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:30:28.341280 run osmo-stp_10.42.42.5(pid=28450): stdout: | (launched: 2022-12-14_08:30:26.711351) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:30:28.464152 run osmo-stp_10.42.42.5(pid=28450): stderr: | 20221214083026888 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214083026888 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214083026889 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214083026889 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214083026890 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214083026890 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214083026890 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:30:28.610806 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28450): Process ended prematurely: osmo-stp_10.42.42.5(pid=28450) [trial-2402↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28450)] [trial-2402↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 08:30:28.620001 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 08:30:28.646236 run osmo-hlr_10.42.42.2(pid=28447): ERR: Terminated: ERROR {rc=237} [trial-2402↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28447)] 08:30:28.695016 run osmo-hlr_10.42.42.2(pid=28447): stdout: | (launched: 2022-12-14_08:30:25.733154) 08:30:28.744449 run osmo-hlr_10.42.42.2(pid=28447): stderr: | 20221214083025911 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214083025911 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214083025911 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214083025911 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214083025911 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214083025911 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214083025923 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/voice:sysmo+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214083025931 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214083025932 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214083025932 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:30:28.814374 run osmo-msc_10.42.42.6(pid=28453): ERR: Terminated: ERROR {rc=2} [trial-2402↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28453)] 08:30:28.861862 run osmo-msc_10.42.42.6(pid=28453): stdout: | (launched: 2022-12-14_08:30:27.718778) 08:30:28.911226 run osmo-msc_10.42.42.6(pid=28453): stderr: | 20221214083027995 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214083027995 DLGLOBAL DEBUG validating counter group 0x7fbddec2ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214083027995 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214083027995 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214083027995 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214083027996 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214083027997 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214083027998 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214083027998 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214083027998 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:30:28.960876 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28446): Terminating (SIGTERM) 08:30:29.000800 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28449): Terminating (SIGTERM) 08:30:29.040696 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28452): Terminating (SIGTERM) 08:30:29.080772 --- ParallelTerminationStrategy: PID 28446 died... 08:30:29.100406 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28446): Terminated: ok {rc=0} 08:30:29.144893 --- ParallelTerminationStrategy: PID 28449 died... 08:30:29.164079 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28449): Terminated: ok {rc=0} 08:30:29.207990 --- ParallelTerminationStrategy: PID 28452 died... 08:30:29.226891 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28452): Terminated: ok {rc=0} 08:30:29.314306 bus /sierra_3: Setting Powered False 08:30:30.414453 bus /sierra_3: Setting Powered False 08:30:31.530319 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2402 voice:sysmo+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 08:30:32.675537 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 08:30:32.687256 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 08:30:32.744672 tst mo_mt_call_osmux.py: using LAC 39674 08:30:32.868396 tst mo_mt_call_osmux.py: using RAC 149 08:30:32.989351 tst mo_mt_call_osmux.py: using CellId 39674 08:30:33.115663 tst mo_mt_call_osmux.py: using BVCI 39675 08:30:33.229228 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 08:30:33.240168 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 08:30:33.250920 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 08:30:33.262142 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 08:30:33.273108 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 08:30:33.284164 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 08:30:33.406292 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 08:30:33.530198 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:30:34.044454 run create_hlr_db(pid=28455): Launched 08:30:34.180295 bus /sierra_2: Setting Powered False 08:30:35.244704 run create_hlr_db(pid=28455): Terminated: ok {rc=0} 08:30:35.684780 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28457): Launched 08:30:35.996404 run osmo-hlr_10.42.42.2(pid=28458): Launched 08:30:36.115959 run osmo-stp_10.42.42.5: Starting osmo-stp 08:30:36.653209 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28460): Launched 08:30:36.963854 run osmo-stp_10.42.42.5(pid=28461): Launched 08:30:37.082508 run osmo-msc_10.42.42.6: Starting osmo-msc 08:30:37.642674 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28463): Launched 08:30:37.952369 run osmo-msc_10.42.42.6(pid=28464): Launched 08:30:38.126451 run osmo-stp_10.42.42.5(pid=28461): ERR: Terminated: ERROR {rc=1} [trial-2402↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28461)] 08:30:38.257260 run osmo-stp_10.42.42.5(pid=28461): stdout: | (launched: 2022-12-14_08:30:36.905523) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:30:38.387689 run osmo-stp_10.42.42.5(pid=28461): stderr: | 20221214083037078 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214083037078 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214083037078 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214083037079 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214083037079 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214083037079 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214083037079 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:30:38.516371 run osmo-stp_10.42.42.5(pid=28461): stdout: | (launched: 2022-12-14_08:30:36.905523) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:30:38.639136 run osmo-stp_10.42.42.5(pid=28461): stderr: | 20221214083037078 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214083037078 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214083037078 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214083037079 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214083037079 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214083037079 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214083037079 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:30:38.786101 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28461): Process ended prematurely: osmo-stp_10.42.42.5(pid=28461) [trial-2402↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28461)] [trial-2402↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 08:30:38.795148 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 08:30:38.821526 run osmo-hlr_10.42.42.2(pid=28458): ERR: Terminated: ERROR {rc=237} [trial-2402↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28458)] 08:30:38.870622 run osmo-hlr_10.42.42.2(pid=28458): stdout: | (launched: 2022-12-14_08:30:35.938003) 08:30:38.920185 run osmo-hlr_10.42.42.2(pid=28458): stderr: | 20221214083036118 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214083036118 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214083036118 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214083036118 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214083036118 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214083036118 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214083036130 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/voice:sysmo+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214083036139 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214083036139 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214083036140 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:30:38.989507 run osmo-msc_10.42.42.6(pid=28464): ERR: Terminated: ERROR {rc=2} [trial-2402↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28464)] 08:30:39.037245 run osmo-msc_10.42.42.6(pid=28464): stdout: | (launched: 2022-12-14_08:30:37.893968) 08:30:39.086835 run osmo-msc_10.42.42.6(pid=28464): stderr: | 20221214083038170 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214083038171 DLGLOBAL DEBUG validating counter group 0x7f668d08ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214083038171 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214083038171 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214083038171 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214083038171 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214083038174 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214083038175 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214083038175 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214083038175 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:30:39.137022 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28457): Terminating (SIGTERM) 08:30:39.177289 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28460): Terminating (SIGTERM) 08:30:39.217332 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28463): Terminating (SIGTERM) 08:30:39.257968 --- ParallelTerminationStrategy: PID 28457 died... 08:30:39.277580 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28457): Terminated: ok {rc=0} 08:30:39.321887 --- ParallelTerminationStrategy: PID 28460 died... 08:30:39.340980 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28460): Terminated: ok {rc=0} 08:30:39.385054 --- ParallelTerminationStrategy: PID 28463 died... 08:30:39.403734 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28463): Terminated: ok {rc=0} 08:30:39.490764 bus /sierra_3: Setting Powered False 08:30:40.589730 bus /sierra_3: Setting Powered False 08:30:41.702826 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2402 voice:sysmo+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 emergency:sysmo --------------------------------------------------------------------- 08:30:42.937969 tst emergency:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:30:42.942762 tst emergency:sysmo: Verifying 1 x bts (candidates: 11) 08:30:42.964630 tst emergency:sysmo: Verifying 6 x ip_address (candidates: 9) 08:30:42.992280 tst emergency:sysmo: Verifying 4 x modem (candidates: 12) 08:30:43.078912 tst emergency:sysmo: Reserving 1 x bts (candidates: 11) 08:30:43.100336 tst emergency:sysmo: Reserving 6 x ip_address (candidates: 9) 08:30:43.127640 tst emergency:sysmo: Reserving 4 x modem (candidates: 12) 08:30:43.712358 tst emergency:sysmo: RESERVED RESOURCES for emergency: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2402 emergency:sysmo emergency_mo_mt_call.py ---------------------------------------------- 08:30:43.717816 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 08:30:43.729124 tst emergency:sysmo: Using 1 x bts (candidates: 1) 08:30:43.765579 tst emergency_mo_mt_call.py: using LAC 39675 08:30:43.894280 tst emergency_mo_mt_call.py: using RAC 150 08:30:44.021618 tst emergency_mo_mt_call.py: using CellId 39675 08:30:44.150424 tst emergency_mo_mt_call.py: using BVCI 39676 08:30:44.270282 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 08:30:44.281518 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 08:30:44.292557 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 08:30:44.303617 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 08:30:44.314892 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 08:30:44.326164 tst emergency:sysmo: Using 1 x modem (candidates: 4) 08:30:44.442852 tst emergency:sysmo: Using 1 x modem (candidates: 4) 08:30:44.563982 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:30:45.069594 run create_hlr_db(pid=28469): Launched 08:30:45.202364 bus /sierra_2: Setting Powered False 08:30:46.265773 run create_hlr_db(pid=28469): Terminated: ok {rc=0} 08:30:46.748722 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28471): Launched 08:30:47.168172 run osmo-hlr_10.42.42.2(pid=28472): Launched 08:30:47.330373 run osmo-stp_10.42.42.5: Starting osmo-stp 08:30:47.894749 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28474): Launched 08:30:48.223099 run osmo-stp_10.42.42.5(pid=28475): Launched 08:30:48.358718 tst emergency_mo_mt_call.py: using MSISDN 8595 08:30:48.526352 run osmo-msc_10.42.42.6: Starting osmo-msc 08:30:49.111412 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28477): Launched 08:30:49.439676 run osmo-msc_10.42.42.6(pid=28478): Launched 08:30:49.621362 run osmo-stp_10.42.42.5(pid=28475): ERR: Terminated: ERROR {rc=1} [trial-2402↪emergency:sysmo↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28475)] 08:30:49.757657 run osmo-stp_10.42.42.5(pid=28475): stdout: | (launched: 2022-12-14_08:30:48.161577) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:30:49.894774 run osmo-stp_10.42.42.5(pid=28475): stderr: | 20221214083048355 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214083048355 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214083048355 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214083048356 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214083048358 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214083048359 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214083048359 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:30:50.031502 run osmo-stp_10.42.42.5(pid=28475): stdout: | (launched: 2022-12-14_08:30:48.161577) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:30:50.160451 run osmo-stp_10.42.42.5(pid=28475): stderr: | 20221214083048355 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214083048355 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214083048355 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214083048356 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214083048358 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214083048359 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214083048359 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:30:50.315746 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=28475): Process ended prematurely: osmo-stp_10.42.42.5(pid=28475) [trial-2402↪emergency:sysmo↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28475)] [trial-2402↪emergency:sysmo↪emergency_mo_mt_call.py:19] 08:30:50.324898 tst emergency_mo_mt_call.py:19: Test FAILED (6.6 sec) 08:30:50.352428 run osmo-hlr_10.42.42.2(pid=28472): ERR: Terminated: ERROR {rc=237} [trial-2402↪emergency:sysmo↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28472)] 08:30:50.403289 run osmo-hlr_10.42.42.2(pid=28472): stdout: | (launched: 2022-12-14_08:30:47.101456) 08:30:50.455757 run osmo-hlr_10.42.42.2(pid=28472): stderr: | 20221214083047370 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214083047370 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214083047370 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214083047370 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214083047370 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214083047370 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214083047417 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/emergency:sysmo/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214083047427 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214083047427 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214083047427 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:30:50.529034 run osmo-msc_10.42.42.6(pid=28478): ERR: Terminated: ERROR {rc=2} [trial-2402↪emergency:sysmo↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28478)] 08:30:50.579388 run osmo-msc_10.42.42.6(pid=28478): stdout: | (launched: 2022-12-14_08:30:49.378349) 08:30:50.631413 run osmo-msc_10.42.42.6(pid=28478): stderr: | 20221214083049702 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214083049702 DLGLOBAL DEBUG validating counter group 0x7f3217799c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214083049702 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214083049702 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214083049702 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214083049702 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214083049704 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214083049705 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214083049705 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214083049705 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:30:50.684027 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28471): Terminating (SIGTERM) 08:30:50.726051 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28474): Terminating (SIGTERM) 08:30:50.768256 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28477): Terminating (SIGTERM) 08:30:50.811103 --- ParallelTerminationStrategy: PID 28471 died... 08:30:50.831485 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28471): Terminated: ok {rc=0} 08:30:50.878272 --- ParallelTerminationStrategy: PID 28474 died... 08:30:50.898221 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28474): Terminated: ok {rc=0} 08:30:50.945263 --- ParallelTerminationStrategy: PID 28477 died... 08:30:50.965250 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28477): Terminated: ok {rc=0} 08:30:51.054007 bus /sierra_3: Setting Powered False 08:30:52.153108 bus /sierra_3: Setting Powered False 08:30:53.271589 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2402 emergency:sysmo emergency_preemptive_call.py ---------------------------------------------- 08:30:54.359951 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 08:30:54.371396 tst emergency:sysmo: Using 1 x bts (candidates: 1) 08:30:54.409657 tst emergency_preemptive_call.py: using LAC 39676 08:30:54.540578 tst emergency_preemptive_call.py: using RAC 151 08:30:54.669656 tst emergency_preemptive_call.py: using CellId 39676 08:30:54.797559 tst emergency_preemptive_call.py: using BVCI 39677 08:30:54.910263 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 08:30:54.921623 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 08:30:54.932551 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 08:30:54.943582 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 08:30:54.955022 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 08:30:54.965955 tst emergency:sysmo: Using 1 x modem (candidates: 4) 08:30:55.083107 tst emergency:sysmo: Using 1 x modem (candidates: 4) 08:30:55.203963 tst emergency:sysmo: Using 1 x modem (candidates: 4) 08:30:55.320603 tst emergency:sysmo: Using 1 x modem (candidates: 4) 08:30:55.439663 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:30:55.945513 run create_hlr_db(pid=28481): Launched 08:30:56.079064 bus /sierra_2: Setting Powered False 08:30:57.143252 run create_hlr_db(pid=28481): Terminated: ok {rc=0} 08:30:57.596918 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28483): Launched 08:30:57.925508 run osmo-hlr_10.42.42.2(pid=28484): Launched 08:30:58.050426 run osmo-stp_10.42.42.5: Starting osmo-stp 08:30:58.613624 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28486): Launched 08:30:58.940548 run osmo-stp_10.42.42.5(pid=28487): Launched 08:30:59.075610 tst emergency_preemptive_call.py: using MSISDN 8596 08:30:59.241906 run osmo-msc_10.42.42.6: Starting osmo-msc 08:30:59.826119 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28489): Launched 08:31:00.153901 run osmo-msc_10.42.42.6(pid=28490): Launched 08:31:00.344398 run osmo-stp_10.42.42.5(pid=28487): ERR: Terminated: ERROR {rc=1} [trial-2402↪emergency:sysmo↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28487)] 08:31:00.481203 run osmo-stp_10.42.42.5(pid=28487): stdout: | (launched: 2022-12-14_08:30:58.879437) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:31:00.618639 run osmo-stp_10.42.42.5(pid=28487): stderr: | 20221214083059076 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214083059076 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214083059077 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214083059077 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214083059078 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214083059078 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214083059078 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:31:00.754523 run osmo-stp_10.42.42.5(pid=28487): stdout: | (launched: 2022-12-14_08:30:58.879437) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:31:00.917288 run osmo-stp_10.42.42.5(pid=28487): stderr: | 20221214083059076 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214083059076 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214083059077 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214083059077 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214083059078 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214083059078 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214083059078 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:31:01.071764 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=28487): Process ended prematurely: osmo-stp_10.42.42.5(pid=28487) [trial-2402↪emergency:sysmo↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28487)] [trial-2402↪emergency:sysmo↪emergency_preemptive_call.py:32] 08:31:01.081189 tst emergency_preemptive_call.py:32: Test FAILED (6.7 sec) 08:31:01.109169 run osmo-hlr_10.42.42.2(pid=28484): ERR: Terminated: ERROR {rc=237} [trial-2402↪emergency:sysmo↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28484)] 08:31:01.161245 run osmo-hlr_10.42.42.2(pid=28484): stdout: | (launched: 2022-12-14_08:30:57.864077) 08:31:01.215249 run osmo-hlr_10.42.42.2(pid=28484): stderr: | 20221214083058068 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214083058068 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214083058068 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214083058068 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214083058068 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214083058068 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214083058080 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/emergency:sysmo/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214083058090 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214083058090 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214083058090 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:31:01.288002 run osmo-msc_10.42.42.6(pid=28490): ERR: Terminated: ERROR {rc=2} [trial-2402↪emergency:sysmo↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28490)] 08:31:01.337445 run osmo-msc_10.42.42.6(pid=28490): stdout: | (launched: 2022-12-14_08:31:00.092574) 08:31:01.391163 run osmo-msc_10.42.42.6(pid=28490): stderr: | 20221214083100418 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214083100418 DLGLOBAL DEBUG validating counter group 0x7f5008014c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214083100418 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214083100418 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214083100419 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214083100419 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214083100421 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214083100421 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214083100421 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214083100421 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:31:01.450289 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28483): Terminating (SIGTERM) 08:31:01.505161 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28486): Terminating (SIGTERM) 08:31:01.558499 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28489): Terminating (SIGTERM) 08:31:01.611375 --- ParallelTerminationStrategy: PID 28483 died... 08:31:01.634856 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28483): Terminated: ok {rc=0} 08:31:01.695073 --- ParallelTerminationStrategy: PID 28486 died... 08:31:01.721163 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28486): Terminated: ok {rc=0} 08:31:01.780505 --- ParallelTerminationStrategy: PID 28489 died... 08:31:01.805819 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28489): Terminated: ok {rc=0} 08:31:01.918690 bus /sierra_9: Setting Powered False 08:31:03.030674 bus /sierra_9: Setting Powered False 08:31:04.146089 bus /sierra_8: Setting Powered False 08:31:05.244069 bus /sierra_8: Setting Powered False 08:31:06.358856 bus /sierra_3: Setting Powered False 08:31:07.453927 bus /sierra_3: Setting Powered False 08:31:08.566918 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2402 emergency:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 gprs:sysmo --------------------------------------------------------------------- 08:31:09.827741 tst gprs:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:31:09.832489 tst gprs:sysmo: Verifying 1 x bts (candidates: 11) 08:31:09.854019 tst gprs:sysmo: Verifying 9 x ip_address (candidates: 9) 08:31:09.893702 tst gprs:sysmo: Verifying 4 x modem (candidates: 12) 08:31:09.983188 tst gprs:sysmo: Reserving 1 x bts (candidates: 11) 08:31:10.004412 tst gprs:sysmo: Reserving 9 x ip_address (candidates: 9) 08:31:10.043759 tst gprs:sysmo: Reserving 4 x modem (candidates: 12) 08:31:10.634757 tst gprs:sysmo: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2402 gprs:sysmo cs_paging_gprs_active.py ---------------------------------------------- 08:31:10.689521 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 08:31:10.700456 tst gprs:sysmo: Using 1 x bts (candidates: 1) 08:31:10.736544 tst cs_paging_gprs_active.py: using LAC 39677 08:31:10.867807 tst cs_paging_gprs_active.py: using RAC 152 08:31:10.999942 tst cs_paging_gprs_active.py: using CellId 39677 08:31:11.130451 tst cs_paging_gprs_active.py: using BVCI 39678 08:31:11.252329 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 08:31:11.263526 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 08:31:11.274569 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 08:31:11.285555 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 08:31:11.296348 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 08:31:11.307389 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 08:31:11.318445 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 08:31:11.329391 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 08:31:11.340482 tst gprs:sysmo: Using 1 x modem (candidates: 4) 08:31:11.458072 tst gprs:sysmo: Using 1 x modem (candidates: 4) 08:31:11.575402 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 08:31:11.783029 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:31:12.095986 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28495): Launched 08:31:12.368714 run iperf3-srv_10.42.42.10(pid=28496): Launched 08:31:12.484772 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 08:31:12.691840 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:31:13.002963 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28497): Launched 08:31:13.275383 run iperf3-srv_10.42.42.10(pid=28498): Launched 08:31:13.393650 tst cs_paging_gprs_active.py:38: start network... 08:31:13.600569 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:31:14.081956 run create_hlr_db(pid=28499): Launched 08:31:14.201464 bus /sierra_2: Setting Powered False 08:31:15.262467 run create_hlr_db(pid=28499): Terminated: ok {rc=0} 08:31:15.692886 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28501): Launched 08:31:16.028383 run osmo-hlr_10.42.42.2(pid=28502): Launched 08:31:16.420112 run osmo-stp_10.42.42.5: Starting osmo-stp 08:31:17.145424 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28504): Launched 08:31:17.493491 run osmo-stp_10.42.42.5(pid=28505): Launched 08:31:17.623166 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:31:19.200103 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28507): Launched 08:31:19.328151 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:31:19.609472 run patchelf(pid=28508): Launched 08:31:19.795282 run osmo-stp_10.42.42.5(pid=28505): ERR: Terminated: ERROR {rc=1} [trial-2402↪gprs:sysmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28505)] 08:31:19.935047 run osmo-stp_10.42.42.5(pid=28505): stdout: | (launched: 2022-12-14_08:31:17.431368) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:31:20.076184 run osmo-stp_10.42.42.5(pid=28505): stderr: | 20221214083117628 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214083117628 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214083117628 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214083117628 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214083117629 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214083117629 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214083117629 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:31:20.216930 run osmo-stp_10.42.42.5(pid=28505): stdout: | (launched: 2022-12-14_08:31:17.431368) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:31:20.352598 run osmo-stp_10.42.42.5(pid=28505): stderr: | 20221214083117628 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214083117628 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214083117628 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214083117628 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214083117629 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214083117629 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214083117629 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:31:20.512938 run patchelf(pid=28508): Terminating (SIGINT) 08:31:20.696877 run patchelf(pid=28508): Terminated: ok {rc=0} 08:31:20.829610 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=28505): Process ended prematurely: osmo-stp_10.42.42.5(pid=28505) [trial-2402↪gprs:sysmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28505)] [trial-2402↪gprs:sysmo↪cs_paging_gprs_active.py:38] 08:31:20.839743 tst cs_paging_gprs_active.py:38: Test FAILED (10.2 sec) 08:31:20.868423 run osmo-hlr_10.42.42.2(pid=28502): ERR: Terminated: ERROR {rc=237} [trial-2402↪gprs:sysmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28502)] 08:31:20.918634 run osmo-hlr_10.42.42.2(pid=28502): stdout: | (launched: 2022-12-14_08:31:15.962974) 08:31:20.970496 run osmo-hlr_10.42.42.2(pid=28502): stderr: | 20221214083116301 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214083116301 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214083116301 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214083116301 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214083116302 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214083116302 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214083116322 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/gprs:sysmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214083116336 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214083116336 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214083116336 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:31:21.023005 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28495): Terminating (SIGTERM) 08:31:21.064779 run iperf3-srv_10.42.42.10(pid=28496): Terminating (SIGTERM) 08:31:21.106927 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28497): Terminating (SIGTERM) 08:31:21.149396 run iperf3-srv_10.42.42.10(pid=28498): Terminating (SIGTERM) 08:31:21.192034 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28501): Terminating (SIGTERM) 08:31:21.234407 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28504): Terminating (SIGTERM) 08:31:21.276309 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28507): Terminating (SIGTERM) 08:31:21.318015 --- ParallelTerminationStrategy: PID 28495 died... 08:31:21.341943 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28495): Terminated: ok {rc=0} 08:31:21.388113 --- ParallelTerminationStrategy: PID 28496 died... 08:31:21.407603 run iperf3-srv_10.42.42.10(pid=28496): Terminated {rc=256} 08:31:21.454085 --- ParallelTerminationStrategy: PID 28497 died... 08:31:21.474041 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28497): Terminated: ok {rc=0} 08:31:21.520577 --- ParallelTerminationStrategy: PID 28498 died... 08:31:21.540586 run iperf3-srv_10.42.42.10(pid=28498): Terminated {rc=256} 08:31:21.587017 --- ParallelTerminationStrategy: PID 28501 died... 08:31:21.607019 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28501): Terminated: ok {rc=0} 08:31:21.653649 --- ParallelTerminationStrategy: PID 28504 died... 08:31:21.673669 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28504): Terminated: ok {rc=0} 08:31:21.720108 --- ParallelTerminationStrategy: PID 28507 died... 08:31:21.740012 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28507): Terminated: ok {rc=0} 08:31:21.828634 bus /gobi_0: Setting Powered False 08:31:22.928526 bus /gobi_0: Setting Powered False 08:31:24.046232 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2402 gprs:sysmo iperf3.py ---------------------------------------------- 08:31:25.194996 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 08:31:25.206379 tst gprs:sysmo: Using 1 x bts (candidates: 1) 08:31:25.243420 tst iperf3.py: using LAC 39678 08:31:25.370673 tst iperf3.py: using RAC 153 08:31:25.492239 tst iperf3.py: using CellId 39678 08:31:25.613034 tst iperf3.py: using BVCI 39679 08:31:25.736233 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 08:31:25.747569 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 08:31:25.758832 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 08:31:25.770139 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 08:31:25.781726 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 08:31:25.793466 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 08:31:25.805389 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 08:31:25.817092 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 08:31:25.828854 tst gprs:sysmo: Using 1 x modem (candidates: 4) 08:31:25.946580 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 08:31:26.154931 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:31:26.467484 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28509): Launched 08:31:26.740335 run iperf3-srv_10.42.42.10(pid=28510): Launched 08:31:26.858562 tst iperf3.py:8: start network... 08:31:27.064727 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:31:27.545935 run create_hlr_db(pid=28511): Launched 08:31:27.666831 bus /gobi_6: Setting Powered False 08:31:28.727624 run create_hlr_db(pid=28511): Terminated: ok {rc=0} 08:31:29.178993 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28513): Launched 08:31:29.514004 run osmo-hlr_10.42.42.2(pid=28514): Launched 08:31:29.643107 run osmo-stp_10.42.42.5: Starting osmo-stp 08:31:30.218401 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28516): Launched 08:31:30.551164 run osmo-stp_10.42.42.5(pid=28517): Launched 08:31:30.677222 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:31:31.263714 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28519): Launched 08:31:31.403112 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:31:31.688469 run patchelf(pid=28520): Launched 08:31:31.888141 run osmo-stp_10.42.42.5(pid=28517): ERR: Terminated: ERROR {rc=1} [trial-2402↪gprs:sysmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28517)] 08:31:32.064373 run osmo-stp_10.42.42.5(pid=28517): stdout: | (launched: 2022-12-14_08:31:30.489008) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:31:32.211176 run osmo-stp_10.42.42.5(pid=28517): stderr: | 20221214083130685 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214083130686 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214083130686 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214083130686 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214083130687 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214083130687 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214083130687 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:31:32.352664 run osmo-stp_10.42.42.5(pid=28517): stdout: | (launched: 2022-12-14_08:31:30.489008) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:31:32.487692 run osmo-stp_10.42.42.5(pid=28517): stderr: | 20221214083130685 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214083130686 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214083130686 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214083130686 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214083130687 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214083130687 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214083130687 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:31:32.648299 run patchelf(pid=28520): Terminating (SIGINT) 08:31:32.832448 run patchelf(pid=28520): Terminated: ok {rc=0} 08:31:32.965080 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28517): Process ended prematurely: osmo-stp_10.42.42.5(pid=28517) [trial-2402↪gprs:sysmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28517)] [trial-2402↪gprs:sysmo↪iperf3.py:8] 08:31:32.975542 tst iperf3.py:8: Test FAILED (7.8 sec) 08:31:33.004325 run osmo-hlr_10.42.42.2(pid=28514): ERR: Terminated: ERROR {rc=237} [trial-2402↪gprs:sysmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28514)] 08:31:33.055054 run osmo-hlr_10.42.42.2(pid=28514): stdout: | (launched: 2022-12-14_08:31:29.451801) 08:31:33.107129 run osmo-hlr_10.42.42.2(pid=28514): stderr: | 20221214083129653 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214083129653 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214083129653 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214083129653 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214083129653 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214083129653 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214083129666 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/gprs:sysmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214083129675 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214083129675 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214083129675 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:31:33.159825 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28509): Terminating (SIGTERM) 08:31:33.202256 run iperf3-srv_10.42.42.10(pid=28510): Terminating (SIGTERM) 08:31:33.244703 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28513): Terminating (SIGTERM) 08:31:33.287542 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28516): Terminating (SIGTERM) 08:31:33.329765 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28519): Terminating (SIGTERM) 08:31:33.372090 --- ParallelTerminationStrategy: PID 28509 died... 08:31:33.392301 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28509): Terminated: ok {rc=0} 08:31:33.438885 --- ParallelTerminationStrategy: PID 28510 died... 08:31:33.458722 run iperf3-srv_10.42.42.10(pid=28510): Terminated {rc=256} 08:31:33.505050 --- ParallelTerminationStrategy: PID 28513 died... 08:31:33.524808 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28513): Terminated: ok {rc=0} 08:31:33.571410 --- ParallelTerminationStrategy: PID 28516 died... 08:31:33.591313 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28516): Terminated: ok {rc=0} 08:31:33.637814 --- ParallelTerminationStrategy: PID 28519 died... 08:31:33.657715 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28519): Terminated: ok {rc=0} 08:31:33.746524 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2402 gprs:sysmo iperf3m4.py ---------------------------------------------- 08:31:34.898069 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 08:31:34.909926 tst gprs:sysmo: Using 1 x bts (candidates: 1) 08:31:34.946550 tst iperf3m4.py: using LAC 39679 08:31:35.076716 tst iperf3m4.py: using RAC 154 08:31:35.207089 tst iperf3m4.py: using CellId 39679 08:31:35.339666 tst iperf3m4.py: using BVCI 39680 08:31:35.462457 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 08:31:35.473635 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 08:31:35.484574 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 08:31:35.495554 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 08:31:35.506402 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 08:31:35.517295 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 08:31:35.528389 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 08:31:35.539394 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 08:31:35.550511 tst gprs:sysmo: Using 1 x modem (candidates: 4) 08:31:35.668727 tst gprs:sysmo: Using 1 x modem (candidates: 4) 08:31:35.789685 tst gprs:sysmo: Using 1 x modem (candidates: 4) 08:31:35.908338 tst gprs:sysmo: Using 1 x modem (candidates: 4) 08:31:36.024934 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 08:31:36.232535 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:31:36.546362 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28521): Launched 08:31:36.819869 run iperf3-srv_10.42.42.10(pid=28522): Launched 08:31:36.937848 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 08:31:37.144604 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:31:37.458335 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28523): Launched 08:31:37.732032 run iperf3-srv_10.42.42.10(pid=28524): Launched 08:31:37.850047 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 08:31:38.056808 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:31:38.368609 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28525): Launched 08:31:38.641487 run iperf3-srv_10.42.42.10(pid=28526): Launched 08:31:38.758842 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 08:31:38.965248 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:31:39.277219 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28527): Launched 08:31:39.566955 run iperf3-srv_10.42.42.10(pid=28528): Launched 08:31:39.682976 tst iperf3m4.py:8: start network... 08:31:39.889682 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:31:40.372532 run create_hlr_db(pid=28529): Launched 08:31:40.494211 bus /gobi_6: Setting Powered False 08:31:41.555877 run create_hlr_db(pid=28529): Terminated: ok {rc=0} 08:31:41.987757 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28531): Launched 08:31:42.300135 run osmo-hlr_10.42.42.2(pid=28532): Launched 08:31:42.420774 run osmo-stp_10.42.42.5: Starting osmo-stp 08:31:42.958994 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28534): Launched 08:31:43.270434 run osmo-stp_10.42.42.5(pid=28535): Launched 08:31:43.391109 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:31:43.925497 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28537): Launched 08:31:44.045075 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:31:44.308373 run patchelf(pid=28538): Launched 08:31:44.481240 run osmo-stp_10.42.42.5(pid=28535): ERR: Terminated: ERROR {rc=1} [trial-2402↪gprs:sysmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28535)] 08:31:44.611471 run osmo-stp_10.42.42.5(pid=28535): stdout: | (launched: 2022-12-14_08:31:43.211720) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:31:44.744912 run osmo-stp_10.42.42.5(pid=28535): stderr: | 20221214083143386 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214083143386 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214083143386 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214083143386 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214083143387 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214083143387 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214083143387 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:31:44.877593 run osmo-stp_10.42.42.5(pid=28535): stdout: | (launched: 2022-12-14_08:31:43.211720) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:31:45.003811 run osmo-stp_10.42.42.5(pid=28535): stderr: | 20221214083143386 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214083143386 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214083143386 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214083143386 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214083143387 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214083143387 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214083143387 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:31:45.153581 run patchelf(pid=28538): Terminating (SIGINT) 08:31:45.325487 run patchelf(pid=28538): Terminated: ok {rc=0} 08:31:45.449810 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28535): Process ended prematurely: osmo-stp_10.42.42.5(pid=28535) [trial-2402↪gprs:sysmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28535)] [trial-2402↪gprs:sysmo↪iperf3m4.py:8] 08:31:45.459367 tst iperf3m4.py:8: Test FAILED (10.6 sec) 08:31:45.486893 run osmo-hlr_10.42.42.2(pid=28532): ERR: Terminated: ERROR {rc=237} [trial-2402↪gprs:sysmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28532)] 08:31:45.535583 run osmo-hlr_10.42.42.2(pid=28532): stdout: | (launched: 2022-12-14_08:31:42.241413) 08:31:45.585559 run osmo-hlr_10.42.42.2(pid=28532): stderr: | 20221214083142423 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214083142423 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214083142423 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214083142423 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214083142423 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214083142423 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214083142435 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/gprs:sysmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214083142443 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214083142443 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214083142443 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:31:45.635791 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28521): Terminating (SIGTERM) 08:31:45.675818 run iperf3-srv_10.42.42.10(pid=28522): Terminating (SIGTERM) 08:31:45.715518 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28523): Terminating (SIGTERM) 08:31:45.755466 run iperf3-srv_10.42.42.10(pid=28524): Terminating (SIGTERM) 08:31:45.795172 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28525): Terminating (SIGTERM) 08:31:45.835057 run iperf3-srv_10.42.42.10(pid=28526): Terminating (SIGTERM) 08:31:45.893726 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28527): Terminating (SIGTERM) 08:31:45.934891 run iperf3-srv_10.42.42.10(pid=28528): Terminating (SIGTERM) 08:31:45.975533 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28531): Terminating (SIGTERM) 08:31:46.016381 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28534): Terminating (SIGTERM) 08:31:46.057133 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28537): Terminating (SIGTERM) 08:31:46.098115 --- ParallelTerminationStrategy: PID 28521 died... 08:31:46.117839 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28521): Terminated: ok {rc=0} 08:31:46.163095 --- ParallelTerminationStrategy: PID 28522 died... 08:31:46.182776 run iperf3-srv_10.42.42.10(pid=28522): Terminated {rc=256} 08:31:46.228039 --- ParallelTerminationStrategy: PID 28523 died... 08:31:46.247820 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28523): Terminated: ok {rc=0} 08:31:46.293126 --- ParallelTerminationStrategy: PID 28524 died... 08:31:46.312597 run iperf3-srv_10.42.42.10(pid=28524): Terminated {rc=256} 08:31:46.357834 --- ParallelTerminationStrategy: PID 28525 died... 08:31:46.377739 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28525): Terminated: ok {rc=0} 08:31:46.423315 --- ParallelTerminationStrategy: PID 28526 died... 08:31:46.442861 run iperf3-srv_10.42.42.10(pid=28526): Terminated {rc=256} 08:31:46.488399 --- ParallelTerminationStrategy: PID 28527 died... 08:31:46.508214 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28527): Terminated: ok {rc=0} 08:31:46.553675 --- ParallelTerminationStrategy: PID 28528 died... 08:31:46.573429 run iperf3-srv_10.42.42.10(pid=28528): Terminated {rc=256} 08:31:46.618799 --- ParallelTerminationStrategy: PID 28531 died... 08:31:46.638596 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28531): Terminated: ok {rc=0} 08:31:46.684084 --- ParallelTerminationStrategy: PID 28534 died... 08:31:46.704006 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28534): Terminated: ok {rc=0} 08:31:46.749370 --- ParallelTerminationStrategy: PID 28537 died... 08:31:46.768736 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28537): Terminated: ok {rc=0} 08:31:46.854612 bus /gobi_4: Setting Powered False 08:31:47.953027 bus /gobi_4: Setting Powered False 08:31:49.070362 bus /gobi_1: Setting Powered False 08:31:50.167288 bus /gobi_1: Setting Powered False 08:31:51.283936 bus /gobi_0: Setting Powered False 08:31:52.382547 bus /gobi_0: Setting Powered False 08:31:53.499252 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2402 gprs:sysmo ping.py ---------------------------------------------- 08:31:54.603393 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 08:31:54.614774 tst gprs:sysmo: Using 1 x bts (candidates: 1) 08:31:54.649264 tst ping.py: using LAC 39680 08:31:54.770751 tst ping.py: using RAC 155 08:31:54.895355 tst ping.py: using CellId 39680 08:31:55.035807 tst ping.py: using BVCI 39681 08:31:55.156562 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 08:31:55.167828 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 08:31:55.179065 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 08:31:55.190172 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 08:31:55.202034 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 08:31:55.213757 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 08:31:55.225306 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 08:31:55.236735 tst gprs:sysmo: Using 1 x modem (candidates: 4) 08:31:55.354808 tst ping.py:19: start network... 08:31:55.559094 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:31:56.033294 run create_hlr_db(pid=28539): Launched 08:31:56.150623 bus /gobi_6: Setting Powered False 08:31:57.211087 run create_hlr_db(pid=28539): Terminated: ok {rc=0} 08:31:57.659299 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28541): Launched 08:31:57.987841 run osmo-hlr_10.42.42.2(pid=28542): Launched 08:31:58.113191 run osmo-stp_10.42.42.5: Starting osmo-stp 08:31:58.673159 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28544): Launched 08:31:58.999470 run osmo-stp_10.42.42.5(pid=28545): Launched 08:31:59.124316 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:31:59.687192 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28547): Launched 08:31:59.810996 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:32:00.088288 run patchelf(pid=28548): Launched 08:32:00.271255 run osmo-stp_10.42.42.5(pid=28545): ERR: Terminated: ERROR {rc=1} [trial-2402↪gprs:sysmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28545)] 08:32:00.409187 run osmo-stp_10.42.42.5(pid=28545): stdout: | (launched: 2022-12-14_08:31:58.938150) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:32:00.548034 run osmo-stp_10.42.42.5(pid=28545): stderr: | 20221214083159132 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214083159132 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214083159132 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214083159133 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214083159133 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214083159133 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214083159133 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:32:00.687517 run osmo-stp_10.42.42.5(pid=28545): stdout: | (launched: 2022-12-14_08:31:58.938150) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:32:00.820784 run osmo-stp_10.42.42.5(pid=28545): stderr: | 20221214083159132 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214083159132 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214083159132 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214083159133 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214083159133 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214083159133 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214083159133 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:32:01.006824 run patchelf(pid=28548): Terminating (SIGINT) 08:32:01.207757 run patchelf(pid=28548): Terminated: ok {rc=0} 08:32:01.340714 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=28545): Process ended prematurely: osmo-stp_10.42.42.5(pid=28545) [trial-2402↪gprs:sysmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28545)] [trial-2402↪gprs:sysmo↪ping.py:22] 08:32:01.350974 tst ping.py:22: Test FAILED (6.7 sec) 08:32:01.379926 run osmo-hlr_10.42.42.2(pid=28542): ERR: Terminated: ERROR {rc=237} [trial-2402↪gprs:sysmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28542)] 08:32:01.431735 run osmo-hlr_10.42.42.2(pid=28542): stdout: | (launched: 2022-12-14_08:31:57.926513) 08:32:01.485537 run osmo-hlr_10.42.42.2(pid=28542): stderr: | 20221214083158128 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214083158128 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214083158128 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214083158128 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214083158128 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214083158128 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214083158140 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/gprs:sysmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214083158149 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214083158149 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214083158149 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:32:01.539528 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28541): Terminating (SIGTERM) 08:32:01.582732 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28544): Terminating (SIGTERM) 08:32:01.626489 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28547): Terminating (SIGTERM) 08:32:01.671887 --- ParallelTerminationStrategy: PID 28541 died... 08:32:01.692714 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28541): Terminated: ok {rc=0} 08:32:01.740016 --- ParallelTerminationStrategy: PID 28544 died... 08:32:01.760603 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28544): Terminated: ok {rc=0} 08:32:01.808252 --- ParallelTerminationStrategy: PID 28547 died... 08:32:01.828798 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28547): Terminated: ok {rc=0} 08:32:01.918728 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2402 gprs:sysmo ping_idle_ping.py ---------------------------------------------- 08:32:03.007172 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 08:32:03.019133 tst gprs:sysmo: Using 1 x bts (candidates: 1) 08:32:03.056743 tst ping_idle_ping.py: using LAC 39681 08:32:03.186569 tst ping_idle_ping.py: using RAC 156 08:32:03.315431 tst ping_idle_ping.py: using CellId 39681 08:32:03.443862 tst ping_idle_ping.py: using BVCI 39682 08:32:03.565100 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 08:32:03.576375 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 08:32:03.587602 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 08:32:03.598766 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 08:32:03.609635 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 08:32:03.620387 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 08:32:03.631402 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 08:32:03.642492 tst gprs:sysmo: Using 1 x modem (candidates: 4) 08:32:03.767466 tst ping_idle_ping.py:24: start network... 08:32:03.971922 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:32:04.443940 run create_hlr_db(pid=28549): Launched 08:32:04.562136 bus /gobi_6: Setting Powered False 08:32:05.622047 run create_hlr_db(pid=28549): Terminated: ok {rc=0} 08:32:06.068438 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28551): Launched 08:32:06.396860 run osmo-hlr_10.42.42.2(pid=28552): Launched 08:32:06.522847 run osmo-stp_10.42.42.5: Starting osmo-stp 08:32:07.089516 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28554): Launched 08:32:07.417895 run osmo-stp_10.42.42.5(pid=28555): Launched 08:32:07.543751 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:32:08.107228 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28557): Launched 08:32:08.232243 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:32:08.510128 run patchelf(pid=28558): Launched 08:32:08.691664 run osmo-stp_10.42.42.5(pid=28555): ERR: Terminated: ERROR {rc=1} [trial-2402↪gprs:sysmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28555)] 08:32:08.829918 run osmo-stp_10.42.42.5(pid=28555): stdout: | (launched: 2022-12-14_08:32:07.356387) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:32:08.969657 run osmo-stp_10.42.42.5(pid=28555): stderr: | 20221214083207554 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214083207554 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214083207554 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214083207555 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214083207555 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214083207555 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214083207555 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:32:09.109477 run osmo-stp_10.42.42.5(pid=28555): stdout: | (launched: 2022-12-14_08:32:07.356387) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:32:09.243874 run osmo-stp_10.42.42.5(pid=28555): stderr: | 20221214083207554 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214083207554 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214083207554 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214083207555 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214083207555 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214083207555 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214083207555 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:32:09.402909 run patchelf(pid=28558): Terminating (SIGINT) 08:32:09.585654 run patchelf(pid=28558): Terminated: ok {rc=0} 08:32:09.716702 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=28555): Process ended prematurely: osmo-stp_10.42.42.5(pid=28555) [trial-2402↪gprs:sysmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28555)] [trial-2402↪gprs:sysmo↪ping_idle_ping.py:27] 08:32:09.726287 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 08:32:09.754210 run osmo-hlr_10.42.42.2(pid=28552): ERR: Terminated: ERROR {rc=237} [trial-2402↪gprs:sysmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28552)] 08:32:09.804789 run osmo-hlr_10.42.42.2(pid=28552): stdout: | (launched: 2022-12-14_08:32:06.335733) 08:32:09.856926 run osmo-hlr_10.42.42.2(pid=28552): stderr: | 20221214083206535 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214083206535 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214083206535 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214083206535 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214083206535 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214083206535 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214083206548 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/gprs:sysmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214083206557 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214083206557 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214083206557 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:32:09.909443 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28551): Terminating (SIGTERM) 08:32:09.951309 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28554): Terminating (SIGTERM) 08:32:09.993771 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28557): Terminating (SIGTERM) 08:32:10.035711 --- ParallelTerminationStrategy: PID 28551 died... 08:32:10.055758 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28551): Terminated: ok {rc=0} 08:32:10.102164 --- ParallelTerminationStrategy: PID 28554 died... 08:32:10.122100 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28554): Terminated: ok {rc=0} 08:32:10.168270 --- ParallelTerminationStrategy: PID 28557 died... 08:32:10.188023 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28557): Terminated: ok {rc=0} 08:32:10.275731 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2402 gprs:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 gprs:sysmo+mod-bts0-egprs --------------------------------------------------------------------- 08:32:11.560452 tst gprs:sysmo+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:32:11.566604 tst gprs:sysmo+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 08:32:11.587445 tst gprs:sysmo+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 08:32:11.627198 tst gprs:sysmo+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 08:32:11.714169 tst gprs:sysmo+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 08:32:11.734854 tst gprs:sysmo+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 08:32:11.773200 tst gprs:sysmo+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 08:32:12.367541 tst gprs:sysmo+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2402 gprs:sysmo+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 08:32:12.418100 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:32:12.429095 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 08:32:12.464336 tst cs_paging_gprs_active.py: using LAC 39682 08:32:12.585798 tst cs_paging_gprs_active.py: using RAC 157 08:32:12.717058 tst cs_paging_gprs_active.py: using CellId 39682 08:32:12.845808 tst cs_paging_gprs_active.py: using BVCI 39683 08:32:12.966970 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:32:12.978662 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:32:12.990082 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:32:13.001608 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:32:13.013079 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:32:13.024340 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:32:13.035860 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:32:13.047175 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:32:13.058827 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 08:32:13.176333 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 08:32:13.298500 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 08:32:13.522839 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:32:13.857385 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28562): Launched 08:32:14.148546 run iperf3-srv_10.42.42.10(pid=28563): Launched 08:32:14.275149 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 08:32:14.498526 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:32:14.832531 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28564): Launched 08:32:15.124266 run iperf3-srv_10.42.42.10(pid=28565): Launched 08:32:15.249422 tst cs_paging_gprs_active.py:38: start network... 08:32:15.473815 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:32:15.993702 run create_hlr_db(pid=28566): Launched 08:32:16.139930 bus /gobi_6: Setting Powered False 08:32:17.203524 run create_hlr_db(pid=28566): Terminated: ok {rc=0} 08:32:17.671326 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28568): Launched 08:32:18.006211 run osmo-hlr_10.42.42.2(pid=28569): Launched 08:32:18.134834 run osmo-stp_10.42.42.5: Starting osmo-stp 08:32:18.711472 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28571): Launched 08:32:19.044706 run osmo-stp_10.42.42.5(pid=28572): Launched 08:32:19.171847 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:32:19.745328 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28574): Launched 08:32:19.873273 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:32:20.154594 run patchelf(pid=28575): Launched 08:32:20.340620 run osmo-stp_10.42.42.5(pid=28572): ERR: Terminated: ERROR {rc=1} [trial-2402↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28572)] 08:32:20.480379 run osmo-stp_10.42.42.5(pid=28572): stdout: | (launched: 2022-12-14_08:32:18.982422) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:32:20.621692 run osmo-stp_10.42.42.5(pid=28572): stderr: | 20221214083219177 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214083219178 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214083219178 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214083219178 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214083219179 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214083219179 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214083219179 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:32:20.763283 run osmo-stp_10.42.42.5(pid=28572): stdout: | (launched: 2022-12-14_08:32:18.982422) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:32:20.899295 run osmo-stp_10.42.42.5(pid=28572): stderr: | 20221214083219177 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214083219178 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214083219178 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214083219178 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214083219179 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214083219179 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214083219179 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:32:21.060871 run patchelf(pid=28575): Terminating (SIGINT) 08:32:21.246633 run patchelf(pid=28575): Terminated: ok {rc=0} 08:32:21.379908 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=28572): Process ended prematurely: osmo-stp_10.42.42.5(pid=28572) [trial-2402↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28572)] [trial-2402↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 08:32:21.390333 tst cs_paging_gprs_active.py:38: Test FAILED (9.0 sec) 08:32:21.419129 run osmo-hlr_10.42.42.2(pid=28569): ERR: Terminated: ERROR {rc=237} [trial-2402↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28569)] 08:32:21.470071 run osmo-hlr_10.42.42.2(pid=28569): stdout: | (launched: 2022-12-14_08:32:17.943697) 08:32:21.522421 run osmo-hlr_10.42.42.2(pid=28569): stderr: | 20221214083218147 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214083218147 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214083218148 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214083218148 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214083218148 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214083218148 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214083218161 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/gprs:sysmo+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214083218169 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214083218169 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214083218169 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:32:21.575310 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28562): Terminating (SIGTERM) 08:32:21.617855 run iperf3-srv_10.42.42.10(pid=28563): Terminating (SIGTERM) 08:32:21.660493 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28564): Terminating (SIGTERM) 08:32:21.703235 run iperf3-srv_10.42.42.10(pid=28565): Terminating (SIGTERM) 08:32:21.745439 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28568): Terminating (SIGTERM) 08:32:21.788061 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28571): Terminating (SIGTERM) 08:32:21.830563 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28574): Terminating (SIGTERM) 08:32:21.873149 --- ParallelTerminationStrategy: PID 28562 died... 08:32:21.893527 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28562): Terminated: ok {rc=0} 08:32:21.940097 --- ParallelTerminationStrategy: PID 28563 died... 08:32:21.960027 run iperf3-srv_10.42.42.10(pid=28563): Terminated {rc=256} 08:32:22.006213 --- ParallelTerminationStrategy: PID 28564 died... 08:32:22.026201 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28564): Terminated: ok {rc=0} 08:32:22.072428 --- ParallelTerminationStrategy: PID 28565 died... 08:32:22.092327 run iperf3-srv_10.42.42.10(pid=28565): Terminated {rc=256} 08:32:22.138518 --- ParallelTerminationStrategy: PID 28568 died... 08:32:22.158354 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28568): Terminated: ok {rc=0} 08:32:22.204716 --- ParallelTerminationStrategy: PID 28571 died... 08:32:22.224897 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28571): Terminated: ok {rc=0} 08:32:22.271499 --- ParallelTerminationStrategy: PID 28574 died... 08:32:22.291385 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28574): Terminated: ok {rc=0} 08:32:22.379697 bus /gobi_0: Setting Powered False 08:32:23.478845 bus /gobi_0: Setting Powered False 08:32:24.598716 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2402 gprs:sysmo+mod-bts0-egprs iperf3.py ---------------------------------------------- 08:32:25.745867 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:32:25.757764 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 08:32:25.794000 tst iperf3.py: using LAC 39683 08:32:25.919084 tst iperf3.py: using RAC 158 08:32:26.042968 tst iperf3.py: using CellId 39683 08:32:26.166514 tst iperf3.py: using BVCI 39684 08:32:26.281274 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:32:26.291982 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:32:26.302723 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:32:26.313417 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:32:26.324208 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:32:26.335620 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:32:26.346930 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:32:26.358059 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:32:26.369316 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 08:32:26.493058 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 08:32:26.717563 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:32:27.051112 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28576): Launched 08:32:27.342098 run iperf3-srv_10.42.42.10(pid=28577): Launched 08:32:27.468359 tst iperf3.py:8: start network... 08:32:27.691613 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:32:28.207762 run create_hlr_db(pid=28578): Launched 08:32:28.344886 bus /gobi_6: Setting Powered False 08:32:29.409043 run create_hlr_db(pid=28578): Terminated: ok {rc=0} 08:32:29.869182 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28580): Launched 08:32:30.203079 run osmo-hlr_10.42.42.2(pid=28581): Launched 08:32:30.332215 run osmo-stp_10.42.42.5: Starting osmo-stp 08:32:30.909733 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28583): Launched 08:32:31.258814 run osmo-stp_10.42.42.5(pid=28584): Launched 08:32:31.521474 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:32:32.116715 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28586): Launched 08:32:32.251819 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:32:32.520430 run patchelf(pid=28587): Launched 08:32:32.694845 run osmo-stp_10.42.42.5(pid=28584): ERR: Terminated: ERROR {rc=1} [trial-2402↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28584)] 08:32:32.826103 run osmo-stp_10.42.42.5(pid=28584): stdout: | (launched: 2022-12-14_08:32:31.195507) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:32:32.958893 run osmo-stp_10.42.42.5(pid=28584): stderr: | 20221214083231405 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214083231407 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214083231407 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214083231409 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214083231409 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214083231409 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214083231409 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:32:33.092199 run osmo-stp_10.42.42.5(pid=28584): stdout: | (launched: 2022-12-14_08:32:31.195507) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:32:33.219362 run osmo-stp_10.42.42.5(pid=28584): stderr: | 20221214083231405 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214083231407 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214083231407 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214083231409 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214083231409 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214083231409 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214083231409 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:32:33.369834 run patchelf(pid=28587): Terminating (SIGINT) 08:32:33.542784 run patchelf(pid=28587): Terminated: ok {rc=0} 08:32:33.667860 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28584): Process ended prematurely: osmo-stp_10.42.42.5(pid=28584) [trial-2402↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28584)] [trial-2402↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8] 08:32:33.677727 tst iperf3.py:8: Test FAILED (8.0 sec) 08:32:33.704768 run osmo-hlr_10.42.42.2(pid=28581): ERR: Terminated: ERROR {rc=237} [trial-2402↪gprs:sysmo+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28581)] 08:32:33.754878 run osmo-hlr_10.42.42.2(pid=28581): stdout: | (launched: 2022-12-14_08:32:30.140507) 08:32:33.805434 run osmo-hlr_10.42.42.2(pid=28581): stderr: | 20221214083230344 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214083230344 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214083230344 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214083230344 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214083230344 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214083230344 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214083230356 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/gprs:sysmo+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214083230366 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214083230367 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214083230367 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:32:33.856338 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28576): Terminating (SIGTERM) 08:32:33.897279 run iperf3-srv_10.42.42.10(pid=28577): Terminating (SIGTERM) 08:32:33.937921 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28580): Terminating (SIGTERM) 08:32:33.978775 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28583): Terminating (SIGTERM) 08:32:34.019585 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28586): Terminating (SIGTERM) 08:32:34.060503 --- ParallelTerminationStrategy: PID 28576 died... 08:32:34.080653 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28576): Terminated: ok {rc=0} 08:32:34.125818 --- ParallelTerminationStrategy: PID 28577 died... 08:32:34.145468 run iperf3-srv_10.42.42.10(pid=28577): Terminated {rc=256} 08:32:34.190229 --- ParallelTerminationStrategy: PID 28580 died... 08:32:34.209856 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28580): Terminated: ok {rc=0} 08:32:34.254815 --- ParallelTerminationStrategy: PID 28583 died... 08:32:34.274578 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28583): Terminated: ok {rc=0} 08:32:34.319630 --- ParallelTerminationStrategy: PID 28586 died... 08:32:34.339335 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28586): Terminated: ok {rc=0} 08:32:34.425452 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2402 gprs:sysmo+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 08:32:35.577510 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:32:35.589753 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 08:32:35.628538 tst iperf3m4.py: using LAC 39684 08:32:35.760301 tst iperf3m4.py: using RAC 159 08:32:35.895192 tst iperf3m4.py: using CellId 39684 08:32:36.025480 tst iperf3m4.py: using BVCI 39685 08:32:36.148478 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:32:36.159978 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:32:36.171207 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:32:36.182393 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:32:36.193674 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:32:36.205027 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:32:36.216575 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:32:36.228217 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:32:36.239739 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 08:32:36.358847 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 08:32:36.480676 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 08:32:36.601545 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 08:32:36.723173 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 08:32:36.948551 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:32:37.287187 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28588): Launched 08:32:37.579595 run iperf3-srv_10.42.42.10(pid=28589): Launched 08:32:37.704010 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 08:32:37.927863 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:32:38.262744 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28590): Launched 08:32:38.552851 run iperf3-srv_10.42.42.10(pid=28591): Launched 08:32:38.679635 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 08:32:38.903192 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:32:39.238554 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28592): Launched 08:32:39.529112 run iperf3-srv_10.42.42.10(pid=28593): Launched 08:32:39.655217 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 08:32:39.879289 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:32:40.214643 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28594): Launched 08:32:40.506779 run iperf3-srv_10.42.42.10(pid=28595): Launched 08:32:40.633297 tst iperf3m4.py:8: start network... 08:32:40.856662 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:32:41.374919 run create_hlr_db(pid=28596): Launched 08:32:41.511390 bus /gobi_6: Setting Powered False 08:32:42.575973 run create_hlr_db(pid=28596): Terminated: ok {rc=0} 08:32:43.037073 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28598): Launched 08:32:43.371556 run osmo-hlr_10.42.42.2(pid=28599): Launched 08:32:43.500056 run osmo-stp_10.42.42.5: Starting osmo-stp 08:32:44.073713 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28601): Launched 08:32:44.408402 run osmo-stp_10.42.42.5(pid=28602): Launched 08:32:44.537469 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:32:45.111437 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28604): Launched 08:32:45.238463 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:32:45.520802 run patchelf(pid=28605): Launched 08:32:45.706436 run osmo-stp_10.42.42.5(pid=28602): ERR: Terminated: ERROR {rc=1} [trial-2402↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28602)] 08:32:45.849657 run osmo-stp_10.42.42.5(pid=28602): stdout: | (launched: 2022-12-14_08:32:44.345887) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:32:46.011988 run osmo-stp_10.42.42.5(pid=28602): stderr: | 20221214083244541 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214083244542 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214083244542 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214083244542 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214083244543 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214083244543 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214083244543 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:32:46.156134 run osmo-stp_10.42.42.5(pid=28602): stdout: | (launched: 2022-12-14_08:32:44.345887) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:32:46.294950 run osmo-stp_10.42.42.5(pid=28602): stderr: | 20221214083244541 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214083244542 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214083244542 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214083244542 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214083244543 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214083244543 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214083244543 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:32:46.458772 run patchelf(pid=28605): Terminating (SIGINT) 08:32:46.646577 run patchelf(pid=28605): Terminated: ok {rc=0} 08:32:46.782456 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28602): Process ended prematurely: osmo-stp_10.42.42.5(pid=28602) [trial-2402↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28602)] [trial-2402↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8] 08:32:46.794118 tst iperf3m4.py:8: Test FAILED (11.3 sec) 08:32:46.824576 run osmo-hlr_10.42.42.2(pid=28599): ERR: Terminated: ERROR {rc=237} [trial-2402↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28599)] 08:32:46.876525 run osmo-hlr_10.42.42.2(pid=28599): stdout: | (launched: 2022-12-14_08:32:43.308929) 08:32:46.929769 run osmo-hlr_10.42.42.2(pid=28599): stderr: | 20221214083243510 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214083243510 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214083243510 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214083243510 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214083243510 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214083243511 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214083243523 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/gprs:sysmo+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214083243531 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214083243532 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214083243532 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:32:46.983087 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28588): Terminating (SIGTERM) 08:32:47.025980 run iperf3-srv_10.42.42.10(pid=28589): Terminating (SIGTERM) 08:32:47.070167 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28590): Terminating (SIGTERM) 08:32:47.114376 run iperf3-srv_10.42.42.10(pid=28591): Terminating (SIGTERM) 08:32:47.156473 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28592): Terminating (SIGTERM) 08:32:47.199341 run iperf3-srv_10.42.42.10(pid=28593): Terminating (SIGTERM) 08:32:47.242374 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28594): Terminating (SIGTERM) 08:32:47.284225 run iperf3-srv_10.42.42.10(pid=28595): Terminating (SIGTERM) 08:32:47.326073 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28598): Terminating (SIGTERM) 08:32:47.368586 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28601): Terminating (SIGTERM) 08:32:47.410374 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28604): Terminating (SIGTERM) 08:32:47.453185 --- ParallelTerminationStrategy: PID 28588 died... 08:32:47.473225 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28588): Terminated: ok {rc=0} 08:32:47.519572 --- ParallelTerminationStrategy: PID 28589 died... 08:32:47.539238 run iperf3-srv_10.42.42.10(pid=28589): Terminated {rc=256} 08:32:47.585297 --- ParallelTerminationStrategy: PID 28590 died... 08:32:47.604987 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28590): Terminated: ok {rc=0} 08:32:47.651658 --- ParallelTerminationStrategy: PID 28591 died... 08:32:47.671227 run iperf3-srv_10.42.42.10(pid=28591): Terminated {rc=256} 08:32:47.717184 --- ParallelTerminationStrategy: PID 28592 died... 08:32:47.736668 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28592): Terminated: ok {rc=0} 08:32:47.783252 --- ParallelTerminationStrategy: PID 28593 died... 08:32:47.803005 run iperf3-srv_10.42.42.10(pid=28593): Terminated {rc=256} 08:32:47.849363 --- ParallelTerminationStrategy: PID 28594 died... 08:32:47.869583 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28594): Terminated: ok {rc=0} 08:32:47.916017 --- ParallelTerminationStrategy: PID 28595 died... 08:32:47.935737 run iperf3-srv_10.42.42.10(pid=28595): Terminated {rc=256} 08:32:47.981919 --- ParallelTerminationStrategy: PID 28598 died... 08:32:48.001727 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28598): Terminated: ok {rc=0} 08:32:48.047965 --- ParallelTerminationStrategy: PID 28601 died... 08:32:48.067672 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28601): Terminated: ok {rc=0} 08:32:48.114045 --- ParallelTerminationStrategy: PID 28604 died... 08:32:48.134014 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28604): Terminated: ok {rc=0} 08:32:48.222527 bus /gobi_4: Setting Powered False 08:32:49.321210 bus /gobi_4: Setting Powered False 08:32:50.436300 bus /gobi_1: Setting Powered False 08:32:51.535096 bus /gobi_1: Setting Powered False 08:32:52.652254 bus /gobi_0: Setting Powered False 08:32:53.749108 bus /gobi_0: Setting Powered False 08:32:54.862965 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2402 gprs:sysmo+mod-bts0-egprs ping.py ---------------------------------------------- 08:32:55.963180 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:32:55.975034 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 08:32:56.014844 tst ping.py: using LAC 39685 08:32:56.132749 tst ping.py: using RAC 160 08:32:56.250562 tst ping.py: using CellId 39685 08:32:56.370171 tst ping.py: using BVCI 39686 08:32:56.482996 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:32:56.493925 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:32:56.504741 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:32:56.515457 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:32:56.526460 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:32:56.537417 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:32:56.548476 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:32:56.559584 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 08:32:56.681581 tst ping.py:19: start network... 08:32:56.900653 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:32:57.408104 run create_hlr_db(pid=28607): Launched 08:32:57.543408 bus /gobi_6: Setting Powered False 08:32:58.607975 run create_hlr_db(pid=28607): Terminated: ok {rc=0} 08:32:59.043036 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28609): Launched 08:32:59.350289 run osmo-hlr_10.42.42.2(pid=28610): Launched 08:32:59.467925 run osmo-stp_10.42.42.5: Starting osmo-stp 08:32:59.991419 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28612): Launched 08:33:00.297949 run osmo-stp_10.42.42.5(pid=28613): Launched 08:33:00.414271 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:33:00.996216 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28615): Launched 08:33:01.136699 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:33:01.425689 run patchelf(pid=28617): Launched 08:33:01.613658 run osmo-stp_10.42.42.5(pid=28613): ERR: Terminated: ERROR {rc=1} [trial-2402↪gprs:sysmo+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28613)] 08:33:01.747568 run osmo-stp_10.42.42.5(pid=28613): stdout: | (launched: 2022-12-14_08:33:00.240214) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:33:01.882701 run osmo-stp_10.42.42.5(pid=28613): stderr: | 20221214083300412 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214083300413 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214083300413 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214083300413 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214083300415 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214083300415 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214083300415 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:33:02.016646 run osmo-stp_10.42.42.5(pid=28613): stdout: | (launched: 2022-12-14_08:33:00.240214) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:33:02.145331 run osmo-stp_10.42.42.5(pid=28613): stderr: | 20221214083300412 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214083300413 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214083300413 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214083300413 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214083300415 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214083300415 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214083300415 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:33:02.296184 run patchelf(pid=28617): Terminating (SIGINT) 08:33:02.466655 run patchelf(pid=28617): Terminated: ok {rc=0} 08:33:02.589265 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=28613): Process ended prematurely: osmo-stp_10.42.42.5(pid=28613) [trial-2402↪gprs:sysmo+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28613)] [trial-2402↪gprs:sysmo+mod-bts0-egprs↪ping.py:22] 08:33:02.598361 tst ping.py:22: Test FAILED (6.6 sec) 08:33:02.625714 run osmo-hlr_10.42.42.2(pid=28610): ERR: Terminated: ERROR {rc=237} [trial-2402↪gprs:sysmo+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28610)] 08:33:02.674530 run osmo-hlr_10.42.42.2(pid=28610): stdout: | (launched: 2022-12-14_08:32:59.292159) 08:33:02.724778 run osmo-hlr_10.42.42.2(pid=28610): stderr: | 20221214083259471 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214083259471 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214083259471 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214083259471 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214083259471 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214083259471 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214083259529 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/gprs:sysmo+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214083259538 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214083259539 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214083259539 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:33:02.775429 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28609): Terminating (SIGTERM) 08:33:02.816038 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28612): Terminating (SIGTERM) 08:33:02.856573 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28615): Terminating (SIGTERM) 08:33:02.897850 --- ParallelTerminationStrategy: PID 28609 died... 08:33:02.917537 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28609): Terminated: ok {rc=0} 08:33:02.962501 --- ParallelTerminationStrategy: PID 28612 died... 08:33:02.981712 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28612): Terminated: ok {rc=0} 08:33:03.026257 --- ParallelTerminationStrategy: PID 28615 died... 08:33:03.045417 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28615): Terminated: ok {rc=0} 08:33:03.132512 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2402 gprs:sysmo+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 08:33:04.220943 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:33:04.232750 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 08:33:04.271352 tst ping_idle_ping.py: using LAC 39686 08:33:04.400844 tst ping_idle_ping.py: using RAC 161 08:33:04.528833 tst ping_idle_ping.py: using CellId 39686 08:33:04.656736 tst ping_idle_ping.py: using BVCI 39687 08:33:04.776094 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:33:04.787542 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:33:04.798826 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:33:04.810124 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:33:04.821844 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:33:04.833509 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:33:04.845338 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:33:04.857044 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 08:33:04.982393 tst ping_idle_ping.py:24: start network... 08:33:05.186691 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:33:05.660779 run create_hlr_db(pid=28618): Launched 08:33:05.779432 bus /gobi_6: Setting Powered False 08:33:06.840089 run create_hlr_db(pid=28618): Terminated: ok {rc=0} 08:33:07.266808 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28620): Launched 08:33:07.574860 run osmo-hlr_10.42.42.2(pid=28621): Launched 08:33:07.691567 run osmo-stp_10.42.42.5: Starting osmo-stp 08:33:08.235164 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28623): Launched 08:33:08.542006 run osmo-stp_10.42.42.5(pid=28624): Launched 08:33:08.658241 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:33:09.186168 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28626): Launched 08:33:09.304430 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:33:09.563036 run patchelf(pid=28627): Launched 08:33:09.734177 run osmo-stp_10.42.42.5(pid=28624): ERR: Terminated: ERROR {rc=1} [trial-2402↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28624)] 08:33:09.863264 run osmo-stp_10.42.42.5(pid=28624): stdout: | (launched: 2022-12-14_08:33:08.484220) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:33:09.993260 run osmo-stp_10.42.42.5(pid=28624): stderr: | 20221214083308658 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214083308658 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214083308658 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214083308659 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214083308659 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214083308659 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214083308659 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:33:10.123314 run osmo-stp_10.42.42.5(pid=28624): stdout: | (launched: 2022-12-14_08:33:08.484220) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:33:10.248345 run osmo-stp_10.42.42.5(pid=28624): stderr: | 20221214083308658 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214083308658 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214083308658 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214083308659 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214083308659 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214083308659 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214083308659 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:33:10.395871 run patchelf(pid=28627): Terminating (SIGINT) 08:33:10.565425 run patchelf(pid=28627): Terminated: ok {rc=0} 08:33:10.687355 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=28624): Process ended prematurely: osmo-stp_10.42.42.5(pid=28624) [trial-2402↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28624)] [trial-2402↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27] 08:33:10.696499 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 08:33:10.722954 run osmo-hlr_10.42.42.2(pid=28621): ERR: Terminated: ERROR {rc=237} [trial-2402↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28621)] 08:33:10.770752 run osmo-hlr_10.42.42.2(pid=28621): stdout: | (launched: 2022-12-14_08:33:07.516597) 08:33:10.819923 run osmo-hlr_10.42.42.2(pid=28621): stderr: | 20221214083307698 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214083307698 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214083307698 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214083307698 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214083307698 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214083307698 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214083307712 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/gprs:sysmo+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214083307720 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214083307720 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214083307720 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:33:10.869739 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28620): Terminating (SIGTERM) 08:33:10.909576 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28623): Terminating (SIGTERM) 08:33:10.949266 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28626): Terminating (SIGTERM) 08:33:10.989168 --- ParallelTerminationStrategy: PID 28620 died... 08:33:11.008481 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28620): Terminated: ok {rc=0} 08:33:11.052274 --- ParallelTerminationStrategy: PID 28623 died... 08:33:11.071128 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28623): Terminated: ok {rc=0} 08:33:11.114985 --- ParallelTerminationStrategy: PID 28626 died... 08:33:11.133742 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28626): Terminated: ok {rc=0} 08:33:11.219372 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2402 gprs:sysmo+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 gprs:sysmo+mod-bts0-dynts-ipa --------------------------------------------------------------------- 08:33:12.502255 tst gprs:sysmo+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:33:12.508189 tst gprs:sysmo+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 08:33:12.528832 tst gprs:sysmo+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 08:33:12.567560 tst gprs:sysmo+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 08:33:12.654827 tst gprs:sysmo+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 08:33:12.675542 tst gprs:sysmo+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 08:33:12.714233 tst gprs:sysmo+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 08:33:13.306788 tst gprs:sysmo+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2402 gprs:sysmo+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 08:33:13.357086 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:33:13.367871 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 08:33:13.424877 tst cs_paging_gprs_active.py: using LAC 39687 08:33:13.549682 tst cs_paging_gprs_active.py: using RAC 162 08:33:13.671249 tst cs_paging_gprs_active.py: using CellId 39687 08:33:13.792432 tst cs_paging_gprs_active.py: using BVCI 39688 08:33:13.904665 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:33:13.915748 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:33:13.926570 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:33:13.937347 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:33:13.948075 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:33:13.959018 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:33:13.970180 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:33:13.981061 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:33:13.992088 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 08:33:14.111446 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 08:33:14.231663 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 08:33:14.456747 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:33:14.790950 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28633): Launched 08:33:15.079696 run iperf3-srv_10.42.42.10(pid=28634): Launched 08:33:15.204905 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 08:33:15.428328 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:33:15.761470 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28635): Launched 08:33:16.071520 run iperf3-srv_10.42.42.10(pid=28636): Launched 08:33:16.205620 tst cs_paging_gprs_active.py:38: start network... 08:33:16.420389 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:33:16.918874 run create_hlr_db(pid=28637): Launched 08:33:17.071392 bus /gobi_6: Setting Powered False 08:33:18.133205 run create_hlr_db(pid=28637): Terminated: ok {rc=0} 08:33:18.590245 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28639): Launched 08:33:18.924564 run osmo-hlr_10.42.42.2(pid=28640): Launched 08:33:19.052235 run osmo-stp_10.42.42.5: Starting osmo-stp 08:33:19.628748 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28642): Launched 08:33:19.961445 run osmo-stp_10.42.42.5(pid=28643): Launched 08:33:20.088385 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:33:20.663040 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28645): Launched 08:33:20.790963 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:33:21.072516 run patchelf(pid=28646): Launched 08:33:21.258234 run osmo-stp_10.42.42.5(pid=28643): ERR: Terminated: ERROR {rc=1} [trial-2402↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28643)] 08:33:21.397610 run osmo-stp_10.42.42.5(pid=28643): stdout: | (launched: 2022-12-14_08:33:19.899399) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:33:21.538674 run osmo-stp_10.42.42.5(pid=28643): stderr: | 20221214083320096 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214083320096 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214083320096 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214083320097 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214083320097 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214083320097 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214083320097 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:33:21.680323 run osmo-stp_10.42.42.5(pid=28643): stdout: | (launched: 2022-12-14_08:33:19.899399) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:33:21.815822 run osmo-stp_10.42.42.5(pid=28643): stderr: | 20221214083320096 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214083320096 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214083320096 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214083320097 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214083320097 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214083320097 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214083320097 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:33:21.976763 run patchelf(pid=28646): Terminating (SIGINT) 08:33:22.162063 run patchelf(pid=28646): Terminated: ok {rc=0} 08:33:22.295465 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=28643): Process ended prematurely: osmo-stp_10.42.42.5(pid=28643) [trial-2402↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28643)] [trial-2402↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 08:33:22.305805 tst cs_paging_gprs_active.py:38: Test FAILED (9.0 sec) 08:33:22.334537 run osmo-hlr_10.42.42.2(pid=28640): ERR: Terminated: ERROR {rc=237} [trial-2402↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28640)] 08:33:22.384428 run osmo-hlr_10.42.42.2(pid=28640): stdout: | (launched: 2022-12-14_08:33:18.862454) 08:33:22.436248 run osmo-hlr_10.42.42.2(pid=28640): stderr: | 20221214083319065 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214083319065 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214083319065 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214083319065 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214083319065 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214083319065 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214083319084 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/gprs:sysmo+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214083319093 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214083319093 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214083319094 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:33:22.488309 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28633): Terminating (SIGTERM) 08:33:22.530143 run iperf3-srv_10.42.42.10(pid=28634): Terminating (SIGTERM) 08:33:22.571558 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28635): Terminating (SIGTERM) 08:33:22.613146 run iperf3-srv_10.42.42.10(pid=28636): Terminating (SIGTERM) 08:33:22.654673 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28639): Terminating (SIGTERM) 08:33:22.696939 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28642): Terminating (SIGTERM) 08:33:22.738648 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28645): Terminating (SIGTERM) 08:33:22.780828 --- ParallelTerminationStrategy: PID 28633 died... 08:33:22.800790 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28633): Terminated: ok {rc=0} 08:33:22.846749 --- ParallelTerminationStrategy: PID 28634 died... 08:33:22.866041 run iperf3-srv_10.42.42.10(pid=28634): Terminated {rc=256} 08:33:22.911501 --- ParallelTerminationStrategy: PID 28635 died... 08:33:22.930932 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28635): Terminated: ok {rc=0} 08:33:22.976557 --- ParallelTerminationStrategy: PID 28636 died... 08:33:22.995876 run iperf3-srv_10.42.42.10(pid=28636): Terminated {rc=256} 08:33:23.041324 --- ParallelTerminationStrategy: PID 28639 died... 08:33:23.060720 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28639): Terminated: ok {rc=0} 08:33:23.106437 --- ParallelTerminationStrategy: PID 28642 died... 08:33:23.125947 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28642): Terminated: ok {rc=0} 08:33:23.171530 --- ParallelTerminationStrategy: PID 28645 died... 08:33:23.191051 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28645): Terminated: ok {rc=0} 08:33:23.278977 bus /gobi_0: Setting Powered False 08:33:24.377545 bus /gobi_0: Setting Powered False 08:33:25.493711 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2402 gprs:sysmo+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 08:33:26.639442 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:33:26.651126 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 08:33:26.716560 tst iperf3.py: using LAC 39688 08:33:26.848405 tst iperf3.py: using RAC 163 08:33:26.978973 tst iperf3.py: using CellId 39688 08:33:27.109904 tst iperf3.py: using BVCI 39689 08:33:27.232333 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:33:27.243954 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:33:27.255741 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:33:27.267112 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:33:27.278870 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:33:27.290649 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:33:27.302709 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:33:27.314406 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:33:27.326311 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 08:33:27.444032 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 08:33:27.651887 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:33:27.963974 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28648): Launched 08:33:28.238946 run iperf3-srv_10.42.42.10(pid=28649): Launched 08:33:28.357265 tst iperf3.py:8: start network... 08:33:28.564322 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:33:29.046273 run create_hlr_db(pid=28650): Launched 08:33:29.166381 bus /gobi_6: Setting Powered False 08:33:30.227925 run create_hlr_db(pid=28650): Terminated: ok {rc=0} 08:33:30.679113 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28652): Launched 08:33:31.023367 run osmo-hlr_10.42.42.2(pid=28653): Launched 08:33:31.169654 run osmo-stp_10.42.42.5: Starting osmo-stp 08:33:31.923014 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28655): Launched 08:33:32.309559 run osmo-stp_10.42.42.5(pid=28656): Launched 08:33:32.443610 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:33:33.016691 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28658): Launched 08:33:33.137258 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:33:33.400534 run patchelf(pid=28659): Launched 08:33:33.573243 run osmo-stp_10.42.42.5(pid=28656): ERR: Terminated: ERROR {rc=1} [trial-2402↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28656)] 08:33:33.703409 run osmo-stp_10.42.42.5(pid=28656): stdout: | (launched: 2022-12-14_08:33:32.250263) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:33:33.835507 run osmo-stp_10.42.42.5(pid=28656): stderr: | 20221214083332540 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214083332540 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214083332540 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214083332541 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214083332541 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214083332541 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214083332541 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:33:33.967672 run osmo-stp_10.42.42.5(pid=28656): stdout: | (launched: 2022-12-14_08:33:32.250263) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:33:34.094262 run osmo-stp_10.42.42.5(pid=28656): stderr: | 20221214083332540 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214083332540 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214083332540 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214083332541 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214083332541 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214083332541 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214083332541 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:33:34.244281 run patchelf(pid=28659): Terminating (SIGINT) 08:33:34.416388 run patchelf(pid=28659): Terminated: ok {rc=0} 08:33:34.540529 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28656): Process ended prematurely: osmo-stp_10.42.42.5(pid=28656) [trial-2402↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28656)] [trial-2402↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8] 08:33:34.550234 tst iperf3.py:8: Test FAILED (7.9 sec) 08:33:34.577581 run osmo-hlr_10.42.42.2(pid=28653): ERR: Terminated: ERROR {rc=237} [trial-2402↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28653)] 08:33:34.625734 run osmo-hlr_10.42.42.2(pid=28653): stdout: | (launched: 2022-12-14_08:33:30.961405) 08:33:34.675000 run osmo-hlr_10.42.42.2(pid=28653): stderr: | 20221214083331334 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214083331334 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214083331334 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214083331334 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214083331334 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214083331334 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214083331354 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/gprs:sysmo+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214083331364 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214083331364 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214083331364 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:33:34.725380 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28648): Terminating (SIGTERM) 08:33:34.765198 run iperf3-srv_10.42.42.10(pid=28649): Terminating (SIGTERM) 08:33:34.804823 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28652): Terminating (SIGTERM) 08:33:34.844908 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28655): Terminating (SIGTERM) 08:33:34.884509 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28658): Terminating (SIGTERM) 08:33:34.924218 --- ParallelTerminationStrategy: PID 28648 died... 08:33:34.943580 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28648): Terminated: ok {rc=0} 08:33:34.987393 --- ParallelTerminationStrategy: PID 28649 died... 08:33:35.006063 run iperf3-srv_10.42.42.10(pid=28649): Terminated {rc=256} 08:33:35.049720 --- ParallelTerminationStrategy: PID 28652 died... 08:33:35.068502 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28652): Terminated: ok {rc=0} 08:33:35.112199 --- ParallelTerminationStrategy: PID 28655 died... 08:33:35.130977 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28655): Terminated: ok {rc=0} 08:33:35.174614 --- ParallelTerminationStrategy: PID 28658 died... 08:33:35.193444 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28658): Terminated: ok {rc=0} 08:33:35.279232 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2402 gprs:sysmo+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 08:33:36.425447 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:33:36.436814 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 08:33:36.493807 tst iperf3m4.py: using LAC 39689 08:33:36.617044 tst iperf3m4.py: using RAC 164 08:33:36.738657 tst iperf3m4.py: using CellId 39689 08:33:36.862020 tst iperf3m4.py: using BVCI 39690 08:33:36.977490 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:33:36.988313 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:33:36.999085 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:33:37.009806 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:33:37.020733 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:33:37.031768 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:33:37.043395 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:33:37.054402 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:33:37.065594 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 08:33:37.183529 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 08:33:37.307659 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 08:33:37.426043 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 08:33:37.547346 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 08:33:37.771896 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:33:38.107346 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28660): Launched 08:33:38.399099 run iperf3-srv_10.42.42.10(pid=28661): Launched 08:33:38.524635 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 08:33:38.748312 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:33:39.082819 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28662): Launched 08:33:39.373721 run iperf3-srv_10.42.42.10(pid=28663): Launched 08:33:39.499492 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 08:33:39.722849 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:33:40.052473 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28664): Launched 08:33:40.325898 run iperf3-srv_10.42.42.10(pid=28665): Launched 08:33:40.444536 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 08:33:40.652221 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:33:40.964437 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28666): Launched 08:33:41.237397 run iperf3-srv_10.42.42.10(pid=28667): Launched 08:33:41.354004 tst iperf3m4.py:8: start network... 08:33:41.561139 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:33:42.043914 run create_hlr_db(pid=28668): Launched 08:33:42.164612 bus /gobi_6: Setting Powered False 08:33:43.226670 run create_hlr_db(pid=28668): Terminated: ok {rc=0} 08:33:43.678884 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28670): Launched 08:33:44.012670 run osmo-hlr_10.42.42.2(pid=28671): Launched 08:33:44.140577 run osmo-stp_10.42.42.5: Starting osmo-stp 08:33:44.712778 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28673): Launched 08:33:45.045672 run osmo-stp_10.42.42.5(pid=28674): Launched 08:33:45.172911 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:33:45.745995 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28676): Launched 08:33:45.897599 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:33:46.169230 run patchelf(pid=28677): Launched 08:33:46.362168 run osmo-stp_10.42.42.5(pid=28674): ERR: Terminated: ERROR {rc=1} [trial-2402↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28674)] 08:33:46.497863 run osmo-stp_10.42.42.5(pid=28674): stdout: | (launched: 2022-12-14_08:33:44.983488) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:33:46.636366 run osmo-stp_10.42.42.5(pid=28674): stderr: | 20221214083345179 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214083345179 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214083345180 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214083345180 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214083345180 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214083345181 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214083345181 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:33:46.773987 run osmo-stp_10.42.42.5(pid=28674): stdout: | (launched: 2022-12-14_08:33:44.983488) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:33:46.906620 run osmo-stp_10.42.42.5(pid=28674): stderr: | 20221214083345179 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214083345179 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214083345180 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214083345180 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214083345180 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214083345181 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214083345181 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:33:47.063357 run patchelf(pid=28677): Terminating (SIGINT) 08:33:47.240262 run patchelf(pid=28677): Terminated: ok {rc=0} 08:33:47.365688 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28674): Process ended prematurely: osmo-stp_10.42.42.5(pid=28674) [trial-2402↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28674)] [trial-2402↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8] 08:33:47.375243 tst iperf3m4.py:8: Test FAILED (11.0 sec) 08:33:47.402656 run osmo-hlr_10.42.42.2(pid=28671): ERR: Terminated: ERROR {rc=237} [trial-2402↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28671)] 08:33:47.451127 run osmo-hlr_10.42.42.2(pid=28671): stdout: | (launched: 2022-12-14_08:33:43.950495) 08:33:47.501414 run osmo-hlr_10.42.42.2(pid=28671): stderr: | 20221214083344153 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214083344153 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214083344153 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214083344153 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214083344153 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214083344153 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214083344166 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/gprs:sysmo+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214083344175 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214083344175 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214083344175 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:33:47.551532 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28660): Terminating (SIGTERM) 08:33:47.591772 run iperf3-srv_10.42.42.10(pid=28661): Terminating (SIGTERM) 08:33:47.632046 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28662): Terminating (SIGTERM) 08:33:47.672441 run iperf3-srv_10.42.42.10(pid=28663): Terminating (SIGTERM) 08:33:47.712669 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28664): Terminating (SIGTERM) 08:33:47.753118 run iperf3-srv_10.42.42.10(pid=28665): Terminating (SIGTERM) 08:33:47.793207 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28666): Terminating (SIGTERM) 08:33:47.833726 run iperf3-srv_10.42.42.10(pid=28667): Terminating (SIGTERM) 08:33:47.873734 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28670): Terminating (SIGTERM) 08:33:47.913841 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28673): Terminating (SIGTERM) 08:33:47.953860 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28676): Terminating (SIGTERM) 08:33:47.994229 --- ParallelTerminationStrategy: PID 28660 died... 08:33:48.013360 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28660): Terminated: ok {rc=0} 08:33:48.057901 --- ParallelTerminationStrategy: PID 28661 died... 08:33:48.076672 run iperf3-srv_10.42.42.10(pid=28661): Terminated {rc=256} 08:33:48.121069 --- ParallelTerminationStrategy: PID 28662 died... 08:33:48.140156 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28662): Terminated: ok {rc=0} 08:33:48.184451 --- ParallelTerminationStrategy: PID 28663 died... 08:33:48.203421 run iperf3-srv_10.42.42.10(pid=28663): Terminated {rc=256} 08:33:48.247274 --- ParallelTerminationStrategy: PID 28664 died... 08:33:48.266183 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28664): Terminated: ok {rc=0} 08:33:48.310460 --- ParallelTerminationStrategy: PID 28665 died... 08:33:48.329585 run iperf3-srv_10.42.42.10(pid=28665): Terminated {rc=256} 08:33:48.373935 --- ParallelTerminationStrategy: PID 28666 died... 08:33:48.392862 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28666): Terminated: ok {rc=0} 08:33:48.437295 --- ParallelTerminationStrategy: PID 28667 died... 08:33:48.456297 run iperf3-srv_10.42.42.10(pid=28667): Terminated {rc=256} 08:33:48.500315 --- ParallelTerminationStrategy: PID 28670 died... 08:33:48.519501 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28670): Terminated: ok {rc=0} 08:33:48.563852 --- ParallelTerminationStrategy: PID 28673 died... 08:33:48.582867 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28673): Terminated: ok {rc=0} 08:33:48.627205 --- ParallelTerminationStrategy: PID 28676 died... 08:33:48.646329 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28676): Terminated: ok {rc=0} 08:33:48.732620 bus /gobi_4: Setting Powered False 08:33:49.832334 bus /gobi_4: Setting Powered False 08:33:50.946501 bus /gobi_1: Setting Powered False 08:33:52.045172 bus /gobi_1: Setting Powered False 08:33:53.162604 bus /gobi_0: Setting Powered False 08:33:54.261810 bus /gobi_0: Setting Powered False 08:33:55.378946 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2402 gprs:sysmo+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 08:33:56.481098 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:33:56.493166 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 08:33:56.552625 tst ping.py: using LAC 39690 08:33:56.680728 tst ping.py: using RAC 165 08:33:56.824942 tst ping.py: using CellId 39690 08:33:56.959777 tst ping.py: using BVCI 39691 08:33:57.079651 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:33:57.091218 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:33:57.102612 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:33:57.113936 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:33:57.125136 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:33:57.136315 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:33:57.147808 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:33:57.159070 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 08:33:57.274735 tst ping.py:19: start network... 08:33:57.478070 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:33:57.951929 run create_hlr_db(pid=28678): Launched 08:33:58.070010 bus /gobi_6: Setting Powered False 08:33:59.130750 run create_hlr_db(pid=28678): Terminated: ok {rc=0} 08:33:59.556625 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28680): Launched 08:33:59.863318 run osmo-hlr_10.42.42.2(pid=28681): Launched 08:33:59.980515 run osmo-stp_10.42.42.5: Starting osmo-stp 08:34:00.531609 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28683): Launched 08:34:00.841241 run osmo-stp_10.42.42.5(pid=28684): Launched 08:34:01.060935 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:34:01.687595 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28686): Launched 08:34:01.818947 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:34:02.083177 run patchelf(pid=28687): Launched 08:34:02.271526 run osmo-stp_10.42.42.5(pid=28684): ERR: Terminated: ERROR {rc=1} [trial-2402↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28684)] 08:34:02.404318 run osmo-stp_10.42.42.5(pid=28684): stdout: | (launched: 2022-12-14_08:34:00.781753) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:34:02.535918 run osmo-stp_10.42.42.5(pid=28684): stderr: | 20221214083401039 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214083401039 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214083401039 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214083401040 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214083401040 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214083401040 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214083401049 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:34:02.666626 run osmo-stp_10.42.42.5(pid=28684): stdout: | (launched: 2022-12-14_08:34:00.781753) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:34:02.791524 run osmo-stp_10.42.42.5(pid=28684): stderr: | 20221214083401039 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214083401039 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214083401039 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214083401040 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214083401040 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214083401040 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214083401049 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:34:02.939319 run patchelf(pid=28687): Terminating (SIGINT) 08:34:03.109685 run patchelf(pid=28687): Terminated: ok {rc=0} 08:34:03.232222 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=28684): Process ended prematurely: osmo-stp_10.42.42.5(pid=28684) [trial-2402↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28684)] [trial-2402↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22] 08:34:03.241327 tst ping.py:22: Test FAILED (6.8 sec) 08:34:03.268411 run osmo-hlr_10.42.42.2(pid=28681): ERR: Terminated: ERROR {rc=237} [trial-2402↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28681)] 08:34:03.317825 run osmo-hlr_10.42.42.2(pid=28681): stdout: | (launched: 2022-12-14_08:33:59.805271) 08:34:03.368214 run osmo-hlr_10.42.42.2(pid=28681): stderr: | 20221214083359981 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214083359981 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214083359981 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214083359981 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214083359981 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214083359981 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214083359993 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/gprs:sysmo+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214083400001 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214083400001 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214083400001 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:34:03.418693 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28680): Terminating (SIGTERM) 08:34:03.459304 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28683): Terminating (SIGTERM) 08:34:03.499684 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28686): Terminating (SIGTERM) 08:34:03.540409 --- ParallelTerminationStrategy: PID 28680 died... 08:34:03.560116 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28680): Terminated: ok {rc=0} 08:34:03.604652 --- ParallelTerminationStrategy: PID 28683 died... 08:34:03.623885 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28683): Terminated: ok {rc=0} 08:34:03.668286 --- ParallelTerminationStrategy: PID 28686 died... 08:34:03.687380 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28686): Terminated: ok {rc=0} 08:34:03.773856 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2402 gprs:sysmo+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 08:34:04.862171 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:34:04.873861 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 08:34:04.931077 tst ping_idle_ping.py: using LAC 39691 08:34:05.052117 tst ping_idle_ping.py: using RAC 166 08:34:05.173365 tst ping_idle_ping.py: using CellId 39691 08:34:05.293272 tst ping_idle_ping.py: using BVCI 39692 08:34:05.403616 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:34:05.414638 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:34:05.425391 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:34:05.436134 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:34:05.447221 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:34:05.458198 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:34:05.469435 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:34:05.480468 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 08:34:05.599791 tst ping_idle_ping.py:24: start network... 08:34:05.819790 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:34:06.331149 run create_hlr_db(pid=28688): Launched 08:34:06.465972 bus /gobi_6: Setting Powered False 08:34:07.530847 run create_hlr_db(pid=28688): Terminated: ok {rc=0} 08:34:07.987238 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28690): Launched 08:34:08.319656 run osmo-hlr_10.42.42.2(pid=28691): Launched 08:34:08.446743 run osmo-stp_10.42.42.5: Starting osmo-stp 08:34:09.011188 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28693): Launched 08:34:09.340143 run osmo-stp_10.42.42.5(pid=28694): Launched 08:34:09.467251 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:34:10.032728 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28696): Launched 08:34:10.159560 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:34:10.438036 run patchelf(pid=28697): Launched 08:34:10.621192 run osmo-stp_10.42.42.5(pid=28694): ERR: Terminated: ERROR {rc=1} [trial-2402↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28694)] 08:34:10.758897 run osmo-stp_10.42.42.5(pid=28694): stdout: | (launched: 2022-12-14_08:34:09.278379) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:34:10.898455 run osmo-stp_10.42.42.5(pid=28694): stderr: | 20221214083409474 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214083409474 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214083409474 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214083409475 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214083409475 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214083409475 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214083409475 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:34:11.037693 run osmo-stp_10.42.42.5(pid=28694): stdout: | (launched: 2022-12-14_08:34:09.278379) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:34:11.171595 run osmo-stp_10.42.42.5(pid=28694): stderr: | 20221214083409474 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214083409474 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214083409474 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214083409475 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214083409475 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214083409475 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214083409475 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:34:11.330834 run patchelf(pid=28697): Terminating (SIGINT) 08:34:11.512546 run patchelf(pid=28697): Terminated: ok {rc=0} 08:34:11.643640 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=28694): Process ended prematurely: osmo-stp_10.42.42.5(pid=28694) [trial-2402↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28694)] [trial-2402↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 08:34:11.653338 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 08:34:11.681301 run osmo-hlr_10.42.42.2(pid=28691): ERR: Terminated: ERROR {rc=237} [trial-2402↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28691)] 08:34:11.731876 run osmo-hlr_10.42.42.2(pid=28691): stdout: | (launched: 2022-12-14_08:34:08.257486) 08:34:11.784034 run osmo-hlr_10.42.42.2(pid=28691): stderr: | 20221214083408459 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214083408459 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214083408460 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214083408460 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214083408460 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214083408460 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214083408477 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/gprs:sysmo+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214083408486 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214083408486 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214083408486 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:34:11.836536 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28690): Terminating (SIGTERM) 08:34:11.878274 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28693): Terminating (SIGTERM) 08:34:11.920098 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28696): Terminating (SIGTERM) 08:34:11.962006 --- ParallelTerminationStrategy: PID 28690 died... 08:34:11.981999 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28690): Terminated: ok {rc=0} 08:34:12.028130 --- ParallelTerminationStrategy: PID 28693 died... 08:34:12.048211 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28693): Terminated: ok {rc=0} 08:34:12.094203 --- ParallelTerminationStrategy: PID 28696 died... 08:34:12.113740 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28696): Terminated: ok {rc=0} 08:34:12.201022 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2402 gprs:sysmo+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 gprs:sysmo+mod-bts0-dynts-osmo --------------------------------------------------------------------- 08:34:13.488288 tst gprs:sysmo+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:34:13.494310 tst gprs:sysmo+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 08:34:13.514879 tst gprs:sysmo+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 08:34:13.554000 tst gprs:sysmo+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 08:34:13.643926 tst gprs:sysmo+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 08:34:13.666697 tst gprs:sysmo+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 08:34:13.707055 tst gprs:sysmo+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 08:34:14.293086 tst gprs:sysmo+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2402 gprs:sysmo+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 08:34:14.344208 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:34:14.355308 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 08:34:14.412198 tst cs_paging_gprs_active.py: using LAC 39692 08:34:14.535124 tst cs_paging_gprs_active.py: using RAC 167 08:34:14.659012 tst cs_paging_gprs_active.py: using CellId 39692 08:34:14.781190 tst cs_paging_gprs_active.py: using BVCI 39693 08:34:14.895080 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:34:14.906187 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:34:14.916899 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:34:14.927666 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:34:14.938759 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:34:14.949961 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:34:14.961076 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:34:14.971983 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:34:14.983178 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 08:34:15.107350 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 08:34:15.225394 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 08:34:15.433093 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:34:15.744532 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28702): Launched 08:34:16.020302 run iperf3-srv_10.42.42.10(pid=28703): Launched 08:34:16.147972 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 08:34:16.360279 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:34:16.679752 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28704): Launched 08:34:16.973693 run iperf3-srv_10.42.42.10(pid=28705): Launched 08:34:17.112593 tst cs_paging_gprs_active.py:38: start network... 08:34:17.342995 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:34:17.860037 run create_hlr_db(pid=28706): Launched 08:34:17.995792 bus /gobi_6: Setting Powered False 08:34:19.060387 run create_hlr_db(pid=28706): Terminated: ok {rc=0} 08:34:19.522073 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28708): Launched 08:34:19.854373 run osmo-hlr_10.42.42.2(pid=28709): Launched 08:34:19.980142 run osmo-stp_10.42.42.5: Starting osmo-stp 08:34:20.556540 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28711): Launched 08:34:20.890108 run osmo-stp_10.42.42.5(pid=28712): Launched 08:34:21.017657 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:34:21.591527 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28714): Launched 08:34:21.717654 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:34:21.998962 run patchelf(pid=28715): Launched 08:34:22.182885 run osmo-stp_10.42.42.5(pid=28712): ERR: Terminated: ERROR {rc=1} [trial-2402↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28712)] 08:34:22.323564 run osmo-stp_10.42.42.5(pid=28712): stdout: | (launched: 2022-12-14_08:34:20.827447) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:34:22.464342 run osmo-stp_10.42.42.5(pid=28712): stderr: | 20221214083421024 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214083421024 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214083421024 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214083421025 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214083421025 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214083421025 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214083421025 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:34:22.605391 run osmo-stp_10.42.42.5(pid=28712): stdout: | (launched: 2022-12-14_08:34:20.827447) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:34:22.741509 run osmo-stp_10.42.42.5(pid=28712): stderr: | 20221214083421024 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214083421024 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214083421024 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214083421025 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214083421025 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214083421025 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214083421025 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:34:22.902425 run patchelf(pid=28715): Terminating (SIGINT) 08:34:23.086995 run patchelf(pid=28715): Terminated: ok {rc=0} 08:34:23.220142 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=28712): Process ended prematurely: osmo-stp_10.42.42.5(pid=28712) [trial-2402↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28712)] [trial-2402↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 08:34:23.230532 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 08:34:23.259020 run osmo-hlr_10.42.42.2(pid=28709): ERR: Terminated: ERROR {rc=237} [trial-2402↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28709)] 08:34:23.309286 run osmo-hlr_10.42.42.2(pid=28709): stdout: | (launched: 2022-12-14_08:34:19.791861) 08:34:23.361246 run osmo-hlr_10.42.42.2(pid=28709): stderr: | 20221214083419995 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214083419995 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214083419995 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214083419995 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214083419995 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214083419995 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214083420009 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/gprs:sysmo+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214083420017 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214083420017 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214083420017 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:34:23.413570 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28702): Terminating (SIGTERM) 08:34:23.455623 run iperf3-srv_10.42.42.10(pid=28703): Terminating (SIGTERM) 08:34:23.497872 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28704): Terminating (SIGTERM) 08:34:23.539744 run iperf3-srv_10.42.42.10(pid=28705): Terminating (SIGTERM) 08:34:23.581116 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28708): Terminating (SIGTERM) 08:34:23.622862 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28711): Terminating (SIGTERM) 08:34:23.664431 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28714): Terminating (SIGTERM) 08:34:23.706426 --- ParallelTerminationStrategy: PID 28702 died... 08:34:23.726653 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28702): Terminated: ok {rc=0} 08:34:23.772812 --- ParallelTerminationStrategy: PID 28703 died... 08:34:23.792674 run iperf3-srv_10.42.42.10(pid=28703): Terminated {rc=256} 08:34:23.838606 --- ParallelTerminationStrategy: PID 28704 died... 08:34:23.858277 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28704): Terminated: ok {rc=0} 08:34:23.904289 --- ParallelTerminationStrategy: PID 28705 died... 08:34:23.923924 run iperf3-srv_10.42.42.10(pid=28705): Terminated {rc=256} 08:34:23.970358 --- ParallelTerminationStrategy: PID 28708 died... 08:34:23.990116 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28708): Terminated: ok {rc=0} 08:34:24.036135 --- ParallelTerminationStrategy: PID 28711 died... 08:34:24.055886 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28711): Terminated: ok {rc=0} 08:34:24.101821 --- ParallelTerminationStrategy: PID 28714 died... 08:34:24.121436 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28714): Terminated: ok {rc=0} 08:34:24.208745 bus /gobi_0: Setting Powered False 08:34:25.307488 bus /gobi_0: Setting Powered False 08:34:26.423113 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2402 gprs:sysmo+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 08:34:27.572324 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:34:27.584481 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 08:34:27.646615 tst iperf3.py: using LAC 39693 08:34:27.776655 tst iperf3.py: using RAC 168 08:34:27.907586 tst iperf3.py: using CellId 39693 08:34:28.039406 tst iperf3.py: using BVCI 39694 08:34:28.161386 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:34:28.172843 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:34:28.184243 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:34:28.195518 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:34:28.206837 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:34:28.218200 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:34:28.229666 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:34:28.240834 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:34:28.252345 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 08:34:28.369080 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 08:34:28.578916 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:34:28.893935 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28717): Launched 08:34:29.168017 run iperf3-srv_10.42.42.10(pid=28718): Launched 08:34:29.286799 tst iperf3.py:8: start network... 08:34:29.494958 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:34:29.977842 run create_hlr_db(pid=28719): Launched 08:34:30.108850 bus /gobi_6: Setting Powered False 08:34:31.174079 run create_hlr_db(pid=28719): Terminated: ok {rc=0} 08:34:31.647263 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28721): Launched 08:34:31.999221 run osmo-hlr_10.42.42.2(pid=28722): Launched 08:34:32.182319 run osmo-stp_10.42.42.5: Starting osmo-stp 08:34:32.720444 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28724): Launched 08:34:33.035573 run osmo-stp_10.42.42.5(pid=28725): Launched 08:34:33.154491 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:34:33.692351 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28727): Launched 08:34:33.813632 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:34:34.077393 run patchelf(pid=28728): Launched 08:34:34.249545 run osmo-stp_10.42.42.5(pid=28725): ERR: Terminated: ERROR {rc=1} [trial-2402↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28725)] 08:34:34.381417 run osmo-stp_10.42.42.5(pid=28725): stdout: | (launched: 2022-12-14_08:34:32.976529) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:34:34.514595 run osmo-stp_10.42.42.5(pid=28725): stderr: | 20221214083433150 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214083433150 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214083433150 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214083433150 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214083433152 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214083433153 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214083433153 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:34:34.647708 run osmo-stp_10.42.42.5(pid=28725): stdout: | (launched: 2022-12-14_08:34:32.976529) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:34:34.775302 run osmo-stp_10.42.42.5(pid=28725): stderr: | 20221214083433150 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214083433150 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214083433150 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214083433150 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214083433152 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214083433153 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214083433153 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:34:34.926638 run patchelf(pid=28728): Terminating (SIGINT) 08:34:35.100315 run patchelf(pid=28728): Terminated: ok {rc=0} 08:34:35.225678 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28725): Process ended prematurely: osmo-stp_10.42.42.5(pid=28725) [trial-2402↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28725)] [trial-2402↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8] 08:34:35.235308 tst iperf3.py:8: Test FAILED (7.7 sec) 08:34:35.262356 run osmo-hlr_10.42.42.2(pid=28722): ERR: Terminated: ERROR {rc=237} [trial-2402↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28722)] 08:34:35.311020 run osmo-hlr_10.42.42.2(pid=28722): stdout: | (launched: 2022-12-14_08:34:31.934931) 08:34:35.361136 run osmo-hlr_10.42.42.2(pid=28722): stderr: | 20221214083432206 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214083432206 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214083432206 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214083432206 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214083432206 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214083432207 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214083432219 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/gprs:sysmo+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214083432227 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214083432227 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214083432227 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:34:35.411348 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28717): Terminating (SIGTERM) 08:34:35.451728 run iperf3-srv_10.42.42.10(pid=28718): Terminating (SIGTERM) 08:34:35.491978 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28721): Terminating (SIGTERM) 08:34:35.532238 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28724): Terminating (SIGTERM) 08:34:35.572380 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28727): Terminating (SIGTERM) 08:34:35.612773 --- ParallelTerminationStrategy: PID 28717 died... 08:34:35.632587 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28717): Terminated: ok {rc=0} 08:34:35.677544 --- ParallelTerminationStrategy: PID 28718 died... 08:34:35.696771 run iperf3-srv_10.42.42.10(pid=28718): Terminated {rc=256} 08:34:35.741175 --- ParallelTerminationStrategy: PID 28721 died... 08:34:35.760324 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28721): Terminated: ok {rc=0} 08:34:35.804930 --- ParallelTerminationStrategy: PID 28724 died... 08:34:35.824336 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28724): Terminated: ok {rc=0} 08:34:35.868775 --- ParallelTerminationStrategy: PID 28727 died... 08:34:35.888223 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28727): Terminated: ok {rc=0} 08:34:35.975817 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2402 gprs:sysmo+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 08:34:37.123319 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:34:37.135201 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 08:34:37.193415 tst iperf3m4.py: using LAC 39694 08:34:37.316695 tst iperf3m4.py: using RAC 169 08:34:37.438676 tst iperf3m4.py: using CellId 39694 08:34:37.562323 tst iperf3m4.py: using BVCI 39695 08:34:37.677892 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:34:37.689156 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:34:37.699890 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:34:37.710663 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:34:37.721770 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:34:37.732852 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:34:37.744054 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:34:37.755062 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:34:37.766272 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 08:34:37.884126 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 08:34:38.008055 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 08:34:38.131099 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 08:34:38.252591 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 08:34:38.477158 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:34:38.812509 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28729): Launched 08:34:39.103033 run iperf3-srv_10.42.42.10(pid=28730): Launched 08:34:39.226908 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 08:34:39.450156 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:34:39.783193 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28731): Launched 08:34:40.072172 run iperf3-srv_10.42.42.10(pid=28732): Launched 08:34:40.197714 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 08:34:40.420929 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:34:40.754411 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28733): Launched 08:34:41.044758 run iperf3-srv_10.42.42.10(pid=28734): Launched 08:34:41.169962 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 08:34:41.392731 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:34:41.725638 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28735): Launched 08:34:42.015356 run iperf3-srv_10.42.42.10(pid=28736): Launched 08:34:42.139334 tst iperf3m4.py:8: start network... 08:34:42.361924 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:34:42.877264 run create_hlr_db(pid=28737): Launched 08:34:43.012485 bus /gobi_6: Setting Powered False 08:34:44.077447 run create_hlr_db(pid=28737): Terminated: ok {rc=0} 08:34:44.537215 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28739): Launched 08:34:44.871132 run osmo-hlr_10.42.42.2(pid=28740): Launched 08:34:44.997172 run osmo-stp_10.42.42.5: Starting osmo-stp 08:34:45.578923 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28742): Launched 08:34:45.929433 run osmo-stp_10.42.42.5(pid=28743): Launched 08:34:46.152876 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:34:46.735688 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28745): Launched 08:34:46.871210 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:34:47.145739 run patchelf(pid=28746): Launched 08:34:47.323795 run osmo-stp_10.42.42.5(pid=28743): ERR: Terminated: ERROR {rc=1} [trial-2402↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28743)] 08:34:47.458177 run osmo-stp_10.42.42.5(pid=28743): stdout: | (launched: 2022-12-14_08:34:45.856668) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:34:47.592196 run osmo-stp_10.42.42.5(pid=28743): stderr: | 20221214083446102 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214083446102 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214083446102 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214083446102 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214083446103 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214083446103 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214083446103 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:34:47.725497 run osmo-stp_10.42.42.5(pid=28743): stdout: | (launched: 2022-12-14_08:34:45.856668) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:34:47.853080 run osmo-stp_10.42.42.5(pid=28743): stderr: | 20221214083446102 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214083446102 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214083446102 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214083446102 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214083446103 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214083446103 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214083446103 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:34:48.003461 run patchelf(pid=28746): Terminating (SIGINT) 08:34:48.176916 run patchelf(pid=28746): Terminated: ok {rc=0} 08:34:48.302501 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28743): Process ended prematurely: osmo-stp_10.42.42.5(pid=28743) [trial-2402↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28743)] [trial-2402↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8] 08:34:48.312247 tst iperf3m4.py:8: Test FAILED (11.2 sec) 08:34:48.340029 run osmo-hlr_10.42.42.2(pid=28740): ERR: Terminated: ERROR {rc=237} [trial-2402↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28740)] 08:34:48.388711 run osmo-hlr_10.42.42.2(pid=28740): stdout: | (launched: 2022-12-14_08:34:44.808466) 08:34:48.439151 run osmo-hlr_10.42.42.2(pid=28740): stderr: | 20221214083445010 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214083445010 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214083445010 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214083445010 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214083445010 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214083445010 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214083445023 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/gprs:sysmo+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214083445032 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214083445032 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214083445033 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:34:48.490152 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28729): Terminating (SIGTERM) 08:34:48.530779 run iperf3-srv_10.42.42.10(pid=28730): Terminating (SIGTERM) 08:34:48.571298 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28731): Terminating (SIGTERM) 08:34:48.612135 run iperf3-srv_10.42.42.10(pid=28732): Terminating (SIGTERM) 08:34:48.653466 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28733): Terminating (SIGTERM) 08:34:48.694427 run iperf3-srv_10.42.42.10(pid=28734): Terminating (SIGTERM) 08:34:48.734978 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28735): Terminating (SIGTERM) 08:34:48.775371 run iperf3-srv_10.42.42.10(pid=28736): Terminating (SIGTERM) 08:34:48.815926 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28739): Terminating (SIGTERM) 08:34:48.856671 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28742): Terminating (SIGTERM) 08:34:48.897110 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28745): Terminating (SIGTERM) 08:34:48.938012 --- ParallelTerminationStrategy: PID 28729 died... 08:34:48.957261 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28729): Terminated: ok {rc=0} 08:34:49.001931 --- ParallelTerminationStrategy: PID 28730 died... 08:34:49.020874 run iperf3-srv_10.42.42.10(pid=28730): Terminated {rc=256} 08:34:49.065652 --- ParallelTerminationStrategy: PID 28731 died... 08:34:49.085051 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28731): Terminated: ok {rc=0} 08:34:49.129708 --- ParallelTerminationStrategy: PID 28732 died... 08:34:49.148854 run iperf3-srv_10.42.42.10(pid=28732): Terminated {rc=256} 08:34:49.193538 --- ParallelTerminationStrategy: PID 28733 died... 08:34:49.212840 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28733): Terminated: ok {rc=0} 08:34:49.257550 --- ParallelTerminationStrategy: PID 28734 died... 08:34:49.276755 run iperf3-srv_10.42.42.10(pid=28734): Terminated {rc=256} 08:34:49.321451 --- ParallelTerminationStrategy: PID 28735 died... 08:34:49.340749 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28735): Terminated: ok {rc=0} 08:34:49.385488 --- ParallelTerminationStrategy: PID 28736 died... 08:34:49.404879 run iperf3-srv_10.42.42.10(pid=28736): Terminated {rc=256} 08:34:49.449632 --- ParallelTerminationStrategy: PID 28739 died... 08:34:49.469243 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28739): Terminated: ok {rc=0} 08:34:49.513946 --- ParallelTerminationStrategy: PID 28742 died... 08:34:49.533274 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28742): Terminated: ok {rc=0} 08:34:49.577985 --- ParallelTerminationStrategy: PID 28745 died... 08:34:49.597185 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28745): Terminated: ok {rc=0} 08:34:49.684080 bus /gobi_4: Setting Powered False 08:34:50.783888 bus /gobi_4: Setting Powered False 08:34:51.899232 bus /gobi_1: Setting Powered False 08:34:52.998206 bus /gobi_1: Setting Powered False 08:34:54.113460 bus /gobi_0: Setting Powered False 08:34:55.213464 bus /gobi_0: Setting Powered False 08:34:56.329998 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2402 gprs:sysmo+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 08:34:57.433300 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:34:57.445068 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 08:34:57.505817 tst ping.py: using LAC 39695 08:34:57.634718 tst ping.py: using RAC 170 08:34:57.761311 tst ping.py: using CellId 39695 08:34:57.881114 tst ping.py: using BVCI 39696 08:34:57.992385 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:34:58.003642 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:34:58.014681 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:34:58.025676 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:34:58.037350 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:34:58.048910 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:34:58.060719 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:34:58.072388 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 08:34:58.193259 tst ping.py:19: start network... 08:34:58.412928 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:34:58.919862 run create_hlr_db(pid=28747): Launched 08:34:59.054474 bus /gobi_6: Setting Powered False 08:35:00.119008 run create_hlr_db(pid=28747): Terminated: ok {rc=0} 08:35:00.555468 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28749): Launched 08:35:00.869637 run osmo-hlr_10.42.42.2(pid=28750): Launched 08:35:01.102965 run osmo-stp_10.42.42.5: Starting osmo-stp 08:35:01.791795 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28755): Launched 08:35:02.151298 run osmo-stp_10.42.42.5(pid=28756): Launched 08:35:02.384591 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:35:02.980651 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28758): Launched 08:35:03.106094 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:35:03.382558 run patchelf(pid=28759): Launched 08:35:03.564385 run osmo-stp_10.42.42.5(pid=28756): ERR: Terminated: ERROR {rc=1} [trial-2402↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28756)] 08:35:03.702291 run osmo-stp_10.42.42.5(pid=28756): stdout: | (launched: 2022-12-14_08:35:02.092709) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:35:03.841386 run osmo-stp_10.42.42.5(pid=28756): stderr: | 20221214083502416 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214083502417 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214083502417 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214083502417 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214083502418 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214083502418 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214083502418 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:35:03.980336 run osmo-stp_10.42.42.5(pid=28756): stdout: | (launched: 2022-12-14_08:35:02.092709) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:35:04.114136 run osmo-stp_10.42.42.5(pid=28756): stderr: | 20221214083502416 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214083502417 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214083502417 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214083502417 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214083502418 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214083502418 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214083502418 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:35:04.272156 run patchelf(pid=28759): Terminating (SIGINT) 08:35:04.454559 run patchelf(pid=28759): Terminated: ok {rc=0} 08:35:04.585546 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=28756): Process ended prematurely: osmo-stp_10.42.42.5(pid=28756) [trial-2402↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28756)] [trial-2402↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22] 08:35:04.595262 tst ping.py:22: Test FAILED (7.2 sec) 08:35:04.623685 run osmo-hlr_10.42.42.2(pid=28750): ERR: Terminated: ERROR {rc=237} [trial-2402↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28750)] 08:35:04.674745 run osmo-hlr_10.42.42.2(pid=28750): stdout: | (launched: 2022-12-14_08:35:00.806186) 08:35:04.727361 run osmo-hlr_10.42.42.2(pid=28750): stderr: | 20221214083501048 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214083501048 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214083501049 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214083501049 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214083501049 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214083501049 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214083501069 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/gprs:sysmo+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214083501082 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214083501082 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214083501082 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:35:04.780327 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28749): Terminating (SIGTERM) 08:35:04.823207 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28755): Terminating (SIGTERM) 08:35:04.865738 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28758): Terminating (SIGTERM) 08:35:04.908658 --- ParallelTerminationStrategy: PID 28749 died... 08:35:04.929116 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28749): Terminated: ok {rc=0} 08:35:04.976822 --- ParallelTerminationStrategy: PID 28755 died... 08:35:04.997136 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28755): Terminated: ok {rc=0} 08:35:05.043961 --- ParallelTerminationStrategy: PID 28758 died... 08:35:05.064109 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28758): Terminated: ok {rc=0} 08:35:05.152581 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2402 gprs:sysmo+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 08:35:06.240195 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:35:06.252604 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 08:35:06.312329 tst ping_idle_ping.py: using LAC 39696 08:35:06.445774 tst ping_idle_ping.py: using RAC 171 08:35:06.573886 tst ping_idle_ping.py: using CellId 39696 08:35:06.705365 tst ping_idle_ping.py: using BVCI 39697 08:35:06.825711 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:35:06.837326 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:35:06.848456 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:35:06.859686 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:35:06.870882 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:35:06.882135 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:35:06.893617 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:35:06.904788 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 08:35:07.022315 tst ping_idle_ping.py:24: start network... 08:35:07.226275 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:35:07.703151 run create_hlr_db(pid=28760): Launched 08:35:07.821191 bus /gobi_6: Setting Powered False 08:35:08.881783 run create_hlr_db(pid=28760): Terminated: ok {rc=0} 08:35:09.308198 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28762): Launched 08:35:09.616112 run osmo-hlr_10.42.42.2(pid=28763): Launched 08:35:09.734302 run osmo-stp_10.42.42.5: Starting osmo-stp 08:35:10.277143 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28765): Launched 08:35:10.584870 run osmo-stp_10.42.42.5(pid=28766): Launched 08:35:10.702750 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:35:11.231245 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28768): Launched 08:35:11.350080 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:35:11.609952 run patchelf(pid=28769): Launched 08:35:11.781218 run osmo-stp_10.42.42.5(pid=28766): ERR: Terminated: ERROR {rc=1} [trial-2402↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28766)] 08:35:11.910467 run osmo-stp_10.42.42.5(pid=28766): stdout: | (launched: 2022-12-14_08:35:10.526949) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:35:12.041112 run osmo-stp_10.42.42.5(pid=28766): stderr: | 20221214083510700 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214083510700 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214083510700 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214083510700 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214083510701 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214083510701 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214083510701 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:35:12.172604 run osmo-stp_10.42.42.5(pid=28766): stdout: | (launched: 2022-12-14_08:35:10.526949) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:35:12.297644 run osmo-stp_10.42.42.5(pid=28766): stderr: | 20221214083510700 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214083510700 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214083510700 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214083510700 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214083510701 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214083510701 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214083510701 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:35:12.445697 run patchelf(pid=28769): Terminating (SIGINT) 08:35:12.616244 run patchelf(pid=28769): Terminated: ok {rc=0} 08:35:12.739660 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=28766): Process ended prematurely: osmo-stp_10.42.42.5(pid=28766) [trial-2402↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28766)] [trial-2402↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 08:35:12.748746 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 08:35:12.775827 run osmo-hlr_10.42.42.2(pid=28763): ERR: Terminated: ERROR {rc=237} [trial-2402↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28763)] 08:35:12.824617 run osmo-hlr_10.42.42.2(pid=28763): stdout: | (launched: 2022-12-14_08:35:09.558211) 08:35:12.874754 run osmo-hlr_10.42.42.2(pid=28763): stderr: | 20221214083509738 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214083509738 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214083509738 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214083509739 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214083509739 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214083509739 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214083509751 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/gprs:sysmo+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214083509761 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214083509761 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214083509761 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:35:12.925355 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28762): Terminating (SIGTERM) 08:35:12.965729 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28765): Terminating (SIGTERM) 08:35:13.006197 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28768): Terminating (SIGTERM) 08:35:13.046981 --- ParallelTerminationStrategy: PID 28762 died... 08:35:13.066560 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28762): Terminated: ok {rc=0} 08:35:13.111180 --- ParallelTerminationStrategy: PID 28765 died... 08:35:13.130214 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28765): Terminated: ok {rc=0} 08:35:13.174659 --- ParallelTerminationStrategy: PID 28768 died... 08:35:13.193800 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28768): Terminated: ok {rc=0} 08:35:13.278879 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2402 gprs:sysmo+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 08:35:14.572152 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:35:14.579683 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 08:35:14.601388 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 08:35:14.638283 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 08:35:14.695256 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 08:35:14.716314 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 08:35:14.750877 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 08:35:15.306158 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2402 dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 08:35:15.311507 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 08:35:15.322999 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 08:35:15.386192 tst switch_tch_pdch.py: using LAC 39697 08:35:15.509074 tst switch_tch_pdch.py: using RAC 172 08:35:15.627887 tst switch_tch_pdch.py: using CellId 39697 08:35:15.750260 tst switch_tch_pdch.py: using BVCI 39698 08:35:15.865515 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 08:35:15.877602 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 08:35:15.889508 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 08:35:15.901251 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 08:35:15.913784 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 08:35:15.926909 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 08:35:15.940292 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 08:35:15.953274 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 08:35:16.097028 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 08:35:16.242511 tst switch_tch_pdch.py:51: start network... 08:35:16.488443 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:35:17.005168 run create_hlr_db(pid=28773): Launched 08:35:17.174158 bus /gobi_6: Setting Powered False 08:35:18.238370 run create_hlr_db(pid=28773): Terminated: ok {rc=0} 08:35:18.674551 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28775): Launched 08:35:18.981442 run osmo-hlr_10.42.42.2(pid=28776): Launched 08:35:19.110339 run osmo-stp_10.42.42.5: Starting osmo-stp 08:35:19.674800 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28778): Launched 08:35:20.000420 run osmo-stp_10.42.42.5(pid=28779): Launched 08:35:20.124314 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:35:20.685784 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28781): Launched 08:35:20.810454 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:35:21.086736 run patchelf(pid=28782): Launched 08:35:21.268177 run osmo-stp_10.42.42.5(pid=28779): ERR: Terminated: ERROR {rc=1} [trial-2402↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28779)] 08:35:21.405612 run osmo-stp_10.42.42.5(pid=28779): stdout: | (launched: 2022-12-14_08:35:19.939149) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:35:21.544783 run osmo-stp_10.42.42.5(pid=28779): stderr: | 20221214083520137 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214083520138 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214083520138 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214083520138 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214083520139 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214083520139 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214083520139 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:35:21.683574 run osmo-stp_10.42.42.5(pid=28779): stdout: | (launched: 2022-12-14_08:35:19.939149) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:35:21.816730 run osmo-stp_10.42.42.5(pid=28779): stderr: | 20221214083520137 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214083520138 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214083520138 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214083520138 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214083520139 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214083520139 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214083520139 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:35:21.974354 run patchelf(pid=28782): Terminating (SIGINT) 08:35:22.156084 run patchelf(pid=28782): Terminated: ok {rc=0} 08:35:22.286659 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=28779): Process ended prematurely: osmo-stp_10.42.42.5(pid=28779) [trial-2402↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28779)] [trial-2402↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 08:35:22.296188 tst switch_tch_pdch.py:54: Test FAILED (7.0 sec) 08:35:22.324887 run osmo-hlr_10.42.42.2(pid=28776): ERR: Terminated: ERROR {rc=237} [trial-2402↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28776)] 08:35:22.375511 run osmo-hlr_10.42.42.2(pid=28776): stdout: | (launched: 2022-12-14_08:35:18.923329) 08:35:22.427670 run osmo-hlr_10.42.42.2(pid=28776): stderr: | 20221214083519110 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214083519110 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214083519110 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214083519110 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214083519110 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214083519110 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214083519122 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214083519130 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214083519131 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214083519131 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:35:22.480017 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28775): Terminating (SIGTERM) 08:35:22.522265 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28778): Terminating (SIGTERM) 08:35:22.564506 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28781): Terminating (SIGTERM) 08:35:22.606882 --- ParallelTerminationStrategy: PID 28775 died... 08:35:22.626754 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28775): Terminated: ok {rc=0} 08:35:22.673400 --- ParallelTerminationStrategy: PID 28778 died... 08:35:22.693150 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28778): Terminated: ok {rc=0} 08:35:22.739371 --- ParallelTerminationStrategy: PID 28781 died... 08:35:22.758975 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28781): Terminated: ok {rc=0} 08:35:22.846251 bus /gobi_0: Setting Powered False 08:35:23.945188 bus /gobi_0: Setting Powered False 08:35:25.060635 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2402 dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 dynts:sysmo+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 08:35:26.299164 tst dynts:sysmo+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:35:26.304914 tst dynts:sysmo+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 08:35:26.325609 tst dynts:sysmo+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 08:35:26.360892 tst dynts:sysmo+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 08:35:26.414503 tst dynts:sysmo+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 08:35:26.435914 tst dynts:sysmo+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 08:35:26.470641 tst dynts:sysmo+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 08:35:27.028208 tst dynts:sysmo+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2402 dynts:sysmo+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 08:35:27.033597 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 08:35:27.045100 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 08:35:27.102758 tst switch_tch_pdch.py: using LAC 39698 08:35:27.233055 tst switch_tch_pdch.py: using RAC 173 08:35:27.354249 tst switch_tch_pdch.py: using CellId 39698 08:35:27.475642 tst switch_tch_pdch.py: using BVCI 39699 08:35:27.588451 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 08:35:27.599565 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 08:35:27.610606 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 08:35:27.621549 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 08:35:27.632414 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 08:35:27.643391 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 08:35:27.654666 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 08:35:27.665767 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 08:35:27.786553 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 08:35:27.906994 tst switch_tch_pdch.py:51: start network... 08:35:28.126564 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:35:28.604875 run create_hlr_db(pid=28786): Launched 08:35:28.738223 bus /gobi_6: Setting Powered False 08:35:29.802203 run create_hlr_db(pid=28786): Terminated: ok {rc=0} 08:35:30.212005 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28788): Launched 08:35:30.519327 run osmo-hlr_10.42.42.2(pid=28789): Launched 08:35:30.638118 run osmo-stp_10.42.42.5: Starting osmo-stp 08:35:31.187969 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28791): Launched 08:35:31.570341 run osmo-stp_10.42.42.5(pid=28792): Launched 08:35:31.863901 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:35:32.409666 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28794): Launched 08:35:32.534027 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:35:32.810653 run patchelf(pid=28795): Launched 08:35:32.992768 run osmo-stp_10.42.42.5(pid=28792): ERR: Terminated: ERROR {rc=1} [trial-2402↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28792)] 08:35:33.130811 run osmo-stp_10.42.42.5(pid=28792): stdout: | (launched: 2022-12-14_08:35:31.507859) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:35:33.270795 run osmo-stp_10.42.42.5(pid=28792): stderr: | 20221214083531732 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214083531732 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214083531732 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214083531732 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214083531733 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214083531733 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214083531733 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:35:33.410957 run osmo-stp_10.42.42.5(pid=28792): stdout: | (launched: 2022-12-14_08:35:31.507859) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:35:33.544402 run osmo-stp_10.42.42.5(pid=28792): stderr: | 20221214083531732 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214083531732 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214083531732 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214083531732 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214083531733 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214083531733 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214083531733 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:35:33.702821 run patchelf(pid=28795): Terminating (SIGINT) 08:35:33.884025 run patchelf(pid=28795): Terminated: ok {rc=0} 08:35:34.014597 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=28792): Process ended prematurely: osmo-stp_10.42.42.5(pid=28792) [trial-2402↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28792)] [trial-2402↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 08:35:34.024292 tst switch_tch_pdch.py:54: Test FAILED (7.0 sec) 08:35:34.052699 run osmo-hlr_10.42.42.2(pid=28789): ERR: Terminated: ERROR {rc=237} [trial-2402↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28789)] 08:35:34.103425 run osmo-hlr_10.42.42.2(pid=28789): stdout: | (launched: 2022-12-14_08:35:30.461349) 08:35:34.155789 run osmo-hlr_10.42.42.2(pid=28789): stderr: | 20221214083530638 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214083530638 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214083530638 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214083530638 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214083530638 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214083530638 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214083530650 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/dynts:sysmo+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214083530658 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214083530658 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214083530658 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:35:34.208645 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28788): Terminating (SIGTERM) 08:35:34.251431 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28791): Terminating (SIGTERM) 08:35:34.293675 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28794): Terminating (SIGTERM) 08:35:34.336510 --- ParallelTerminationStrategy: PID 28788 died... 08:35:34.356936 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28788): Terminated: ok {rc=0} 08:35:34.403532 --- ParallelTerminationStrategy: PID 28791 died... 08:35:34.423320 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28791): Terminated: ok {rc=0} 08:35:34.469774 --- ParallelTerminationStrategy: PID 28794 died... 08:35:34.489438 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28794): Terminated: ok {rc=0} 08:35:34.577914 bus /gobi_0: Setting Powered False 08:35:35.675402 bus /gobi_0: Setting Powered False 08:35:36.791799 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2402 dynts:sysmo+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 nitb_sms:oc2g --------------------------------------------------------------------- 08:35:38.034658 tst nitb_sms:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:35:38.038776 tst nitb_sms:oc2g: Verifying 1 x bts (candidates: 11) 08:35:38.060056 tst nitb_sms:oc2g: Verifying 1 x ip_address (candidates: 9) 08:35:38.067114 tst nitb_sms:oc2g: Verifying 2 x modem (candidates: 12) 08:35:38.120150 tst nitb_sms:oc2g: Reserving 1 x bts (candidates: 11) 08:35:38.141360 tst nitb_sms:oc2g: Reserving 1 x ip_address (candidates: 9) 08:35:38.148291 tst nitb_sms:oc2g: Reserving 2 x modem (candidates: 12) 08:35:38.686744 tst nitb_sms:oc2g: RESERVED RESOURCES for nitb_sms: bts OC-2G ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2402 nitb_sms:oc2g mo_mt_sms.py ---------------------------------------------- 08:35:38.691854 tst nitb_sms:oc2g: Using 1 x ip_address (candidates: 1) 08:35:38.703059 tst nitb_sms:oc2g: Using 1 x bts (candidates: 1) 08:35:38.737049 tst mo_mt_sms.py: using LAC 39699 08:35:38.864625 tst mo_mt_sms.py: using RAC 174 08:35:38.992341 tst mo_mt_sms.py: using CellId 39699 08:35:39.119642 tst mo_mt_sms.py: using BVCI 39700 08:35:39.233200 tst nitb_sms:oc2g: Using 1 x modem (candidates: 2) 08:35:39.352257 tst nitb_sms:oc2g: Using 1 x modem (candidates: 2) 08:35:39.468871 tst mo_mt_sms.py:9: start nitb and bts... 08:35:39.673547 run osmo-nitb_10.42.42.2: Starting osmo-nitb 08:35:40.296453 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=28800): Launched 08:35:40.606433 run osmo-nitb_10.42.42.2(pid=28801): Launched 08:35:40.776680 run osmo-nitb_10.42.42.2(pid=28801): ERR: Terminated: ERROR {rc=2} [trial-2402↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=28801)] 08:35:40.913179 run osmo-nitb_10.42.42.2(pid=28801): stdout: | (launched: 2022-12-14_08:35:40.548558) 08:35:41.050734 run osmo-nitb_10.42.42.2(pid=28801): stderr: | (launched: 2022-12-14_08:35:40.593744) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 08:35:41.188117 run osmo-nitb_10.42.42.2(pid=28801): stdout: | (launched: 2022-12-14_08:35:40.548558) 08:35:41.321192 run osmo-nitb_10.42.42.2(pid=28801): stderr: | (launched: 2022-12-14_08:35:40.593744) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fe4ae4b0268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=28801): Process ended prematurely: osmo-nitb_10.42.42.2(pid=28801) [trial-2402↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=28801)] 08:35:41.723090 tst osmo-nitb_10.42.42.2(pid=28801): stdout: | (launched: 2022-12-14_08:35:40.548558) 08:35:41.845649 tst osmo-nitb_10.42.42.2(pid=28801): stderr: | (launched: 2022-12-14_08:35:40.593744) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 08:35:42.013574 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=28801): Process ended prematurely: osmo-nitb_10.42.42.2(pid=28801) [trial-2402↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=28801)] [trial-2402↪nitb_sms:oc2g↪mo_mt_sms.py:11] 08:35:42.022042 tst mo_mt_sms.py:11: Test FAILED (3.3 sec) 08:35:42.028497 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=28800): Terminating (SIGTERM) 08:35:42.237677 --- ParallelTerminationStrategy: PID 28800 died... 08:35:42.257989 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=28800): Terminated: ok {rc=0} 08:35:42.345273 bus /sierra_3: Setting Powered False 08:35:43.447148 bus /sierra_3: Setting Powered False 08:35:44.567950 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2402 nitb_sms:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 sms:oc2g --------------------------------------------------------------------- 08:35:45.754086 tst sms:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:35:45.758431 tst sms:oc2g: Verifying 1 x bts (candidates: 11) 08:35:45.779642 tst sms:oc2g: Verifying 6 x ip_address (candidates: 9) 08:35:45.807368 tst sms:oc2g: Verifying 2 x modem (candidates: 12) 08:35:45.874793 tst sms:oc2g: Reserving 1 x bts (candidates: 11) 08:35:45.900136 tst sms:oc2g: Reserving 6 x ip_address (candidates: 9) 08:35:45.932200 tst sms:oc2g: Reserving 2 x modem (candidates: 12) 08:35:46.469860 tst sms:oc2g: RESERVED RESOURCES for sms: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2402 sms:oc2g mo_mt_sms.py ---------------------------------------------- 08:35:46.475672 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 08:35:46.487292 tst sms:oc2g: Using 1 x bts (candidates: 1) 08:35:46.522512 tst mo_mt_sms.py: using LAC 39700 08:35:46.679146 tst mo_mt_sms.py: using RAC 175 08:35:46.799287 tst mo_mt_sms.py: using CellId 39700 08:35:46.921312 tst mo_mt_sms.py: using BVCI 39701 08:35:47.041854 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 08:35:47.054118 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 08:35:47.066349 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 08:35:47.078380 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 08:35:47.090958 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 08:35:47.102861 tst sms:oc2g: Using 1 x modem (candidates: 2) 08:35:47.241699 tst sms:oc2g: Using 1 x modem (candidates: 2) 08:35:47.363472 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:35:47.870644 run create_hlr_db(pid=28805): Launched 08:35:48.003773 bus /sierra_2: Setting Powered False 08:35:49.068389 run create_hlr_db(pid=28805): Terminated: ok {rc=0} 08:35:49.504773 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28807): Launched 08:35:49.812020 run osmo-hlr_10.42.42.2(pid=28808): Launched 08:35:49.929394 run osmo-stp_10.42.42.5: Starting osmo-stp 08:35:50.469196 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28810): Launched 08:35:50.776775 run osmo-stp_10.42.42.5(pid=28811): Launched 08:35:50.895195 run osmo-msc_10.42.42.6: Starting osmo-msc 08:35:51.448888 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28813): Launched 08:35:51.756926 run osmo-msc_10.42.42.6(pid=28814): Launched 08:35:51.928098 run osmo-stp_10.42.42.5(pid=28811): ERR: Terminated: ERROR {rc=1} [trial-2402↪sms:oc2g↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28811)] 08:35:52.068086 run osmo-stp_10.42.42.5(pid=28811): stdout: | (launched: 2022-12-14_08:35:50.718649) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:35:52.197874 run osmo-stp_10.42.42.5(pid=28811): stderr: | 20221214083550893 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214083550893 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214083550893 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214083550894 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214083550894 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214083550894 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214083550894 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:35:52.324795 run osmo-stp_10.42.42.5(pid=28811): stdout: | (launched: 2022-12-14_08:35:50.718649) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:35:52.445503 run osmo-stp_10.42.42.5(pid=28811): stderr: | 20221214083550893 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214083550893 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214083550893 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214083550894 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214083550894 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214083550894 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214083550894 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:35:52.589716 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=28811): Process ended prematurely: osmo-stp_10.42.42.5(pid=28811) [trial-2402↪sms:oc2g↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28811)] [trial-2402↪sms:oc2g↪mo_mt_sms.py:16] 08:35:52.598284 tst mo_mt_sms.py:16: Test FAILED (6.1 sec) 08:35:52.624435 run osmo-hlr_10.42.42.2(pid=28808): ERR: Terminated: ERROR {rc=237} [trial-2402↪sms:oc2g↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28808)] 08:35:52.673479 run osmo-hlr_10.42.42.2(pid=28808): stdout: | (launched: 2022-12-14_08:35:49.754254) 08:35:52.723316 run osmo-hlr_10.42.42.2(pid=28808): stderr: | 20221214083549934 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214083549934 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214083549934 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214083549934 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214083549934 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214083549934 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214083549946 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/sms:oc2g/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214083549955 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214083549955 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214083549955 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:35:52.792938 run osmo-msc_10.42.42.6(pid=28814): ERR: Terminated: ERROR {rc=2} [trial-2402↪sms:oc2g↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28814)] 08:35:52.841209 run osmo-msc_10.42.42.6(pid=28814): stdout: | (launched: 2022-12-14_08:35:51.698765) 08:35:52.890916 run osmo-msc_10.42.42.6(pid=28814): stderr: | 20221214083551970 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214083551970 DLGLOBAL DEBUG validating counter group 0x7f273e6e9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214083551970 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214083551970 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214083551972 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214083551973 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214083551974 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214083551975 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214083551975 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214083551975 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:35:52.940861 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28807): Terminating (SIGTERM) 08:35:52.981051 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28810): Terminating (SIGTERM) 08:35:53.021070 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28813): Terminating (SIGTERM) 08:35:53.061442 --- ParallelTerminationStrategy: PID 28807 died... 08:35:53.081070 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28807): Terminated: ok {rc=0} 08:35:53.125414 --- ParallelTerminationStrategy: PID 28810 died... 08:35:53.144336 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28810): Terminated: ok {rc=0} 08:35:53.188757 --- ParallelTerminationStrategy: PID 28813 died... 08:35:53.207979 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28813): Terminated: ok {rc=0} 08:35:53.292414 bus /sierra_3: Setting Powered False 08:35:54.389109 bus /sierra_3: Setting Powered False 08:35:55.504309 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2402 sms:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 nitb_ussd:oc2g --------------------------------------------------------------------- 08:35:56.717878 tst nitb_ussd:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:35:56.722805 tst nitb_ussd:oc2g: Verifying 1 x bts (candidates: 11) 08:35:56.744561 tst nitb_ussd:oc2g: Verifying 1 x ip_address (candidates: 9) 08:35:56.751654 tst nitb_ussd:oc2g: Verifying 1 x modem (candidates: 12) 08:35:56.788063 tst nitb_ussd:oc2g: Reserving 1 x bts (candidates: 11) 08:35:56.809292 tst nitb_ussd:oc2g: Reserving 1 x ip_address (candidates: 9) 08:35:56.816247 tst nitb_ussd:oc2g: Reserving 1 x modem (candidates: 12) 08:35:57.336866 tst nitb_ussd:oc2g: RESERVED RESOURCES for nitb_ussd: bts OC-2G ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2402 nitb_ussd:oc2g assert_extension.py ---------------------------------------------- 08:35:57.342337 tst nitb_ussd:oc2g: Using 1 x ip_address (candidates: 1) 08:35:57.353920 tst nitb_ussd:oc2g: Using 1 x bts (candidates: 1) 08:35:57.388362 tst assert_extension.py: using LAC 39701 08:35:57.508396 tst assert_extension.py: using RAC 176 08:35:57.629202 tst assert_extension.py: using CellId 39701 08:35:57.748467 tst assert_extension.py: using BVCI 39702 08:35:57.860884 tst nitb_ussd:oc2g: Using 1 x modem (candidates: 1) 08:35:57.979682 tst assert_extension.py:10: start nitb and bts... 08:35:58.199703 run osmo-nitb_10.42.42.2: Starting osmo-nitb 08:35:58.865352 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=28820): Launched 08:35:59.195285 run osmo-nitb_10.42.42.2(pid=28821): Launched 08:35:59.377045 run osmo-nitb_10.42.42.2(pid=28821): ERR: Terminated: ERROR {rc=2} [trial-2402↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=28821)] 08:35:59.523129 run osmo-nitb_10.42.42.2(pid=28821): stdout: | (launched: 2022-12-14_08:35:59.133805) 08:35:59.669952 run osmo-nitb_10.42.42.2(pid=28821): stderr: | (launched: 2022-12-14_08:35:59.182537) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 08:35:59.816752 run osmo-nitb_10.42.42.2(pid=28821): stdout: | (launched: 2022-12-14_08:35:59.133805) 08:35:59.958107 run osmo-nitb_10.42.42.2(pid=28821): stderr: | (launched: 2022-12-14_08:35:59.182537) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fe4ae4b0268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=28821): Process ended prematurely: osmo-nitb_10.42.42.2(pid=28821) [trial-2402↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=28821)] 08:36:00.319116 tst osmo-nitb_10.42.42.2(pid=28821): stdout: | (launched: 2022-12-14_08:35:59.133805) 08:36:00.450500 tst osmo-nitb_10.42.42.2(pid=28821): stderr: | (launched: 2022-12-14_08:35:59.182537) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 08:36:00.604937 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=28821): Process ended prematurely: osmo-nitb_10.42.42.2(pid=28821) [trial-2402↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=28821)] [trial-2402↪nitb_ussd:oc2g↪assert_extension.py:12] 08:36:00.614015 tst assert_extension.py:12: Test FAILED (3.3 sec) 08:36:00.621289 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=28820): Terminating (SIGTERM) 08:36:00.832041 --- ParallelTerminationStrategy: PID 28820 died... 08:36:00.858589 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=28820): Terminated: ok {rc=0} 08:36:00.962669 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2402 nitb_ussd:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 ussd:oc2g --------------------------------------------------------------------- 08:36:02.149269 tst ussd:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:36:02.157462 tst ussd:oc2g: Verifying 1 x bts (candidates: 11) 08:36:02.185861 tst ussd:oc2g: Verifying 6 x ip_address (candidates: 9) 08:36:02.224012 tst ussd:oc2g: Verifying 1 x modem (candidates: 12) 08:36:02.268470 tst ussd:oc2g: Reserving 1 x bts (candidates: 11) 08:36:02.304119 tst ussd:oc2g: Reserving 6 x ip_address (candidates: 9) 08:36:02.333259 tst ussd:oc2g: Reserving 1 x modem (candidates: 12) 08:36:02.844334 tst ussd:oc2g: RESERVED RESOURCES for ussd: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2402 ussd:oc2g assert_extension.py ---------------------------------------------- 08:36:02.850706 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 08:36:02.862452 tst ussd:oc2g: Using 1 x bts (candidates: 1) 08:36:02.910553 tst assert_extension.py: using LAC 39702 08:36:03.043407 tst assert_extension.py: using RAC 177 08:36:03.176556 tst assert_extension.py: using CellId 39702 08:36:03.305169 tst assert_extension.py: using BVCI 39703 08:36:03.424906 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 08:36:03.436162 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 08:36:03.447256 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 08:36:03.458243 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 08:36:03.469300 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 08:36:03.480227 tst ussd:oc2g: Using 1 x modem (candidates: 1) 08:36:03.596800 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:36:04.071710 run create_hlr_db(pid=28825): Launched 08:36:04.190072 bus /sierra_2: Setting Powered False 08:36:05.251184 run create_hlr_db(pid=28825): Terminated: ok {rc=0} 08:36:05.677481 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28827): Launched 08:36:05.982680 run osmo-hlr_10.42.42.2(pid=28828): Launched 08:36:06.100828 run osmo-stp_10.42.42.5: Starting osmo-stp 08:36:06.647195 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28830): Launched 08:36:06.954894 run osmo-stp_10.42.42.5(pid=28831): Launched 08:36:07.072826 run osmo-msc_10.42.42.6: Starting osmo-msc 08:36:07.624178 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28833): Launched 08:36:07.931165 run osmo-msc_10.42.42.6(pid=28834): Launched 08:36:08.103396 run osmo-stp_10.42.42.5(pid=28831): ERR: Terminated: ERROR {rc=1} [trial-2402↪ussd:oc2g↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28831)] 08:36:08.232471 run osmo-stp_10.42.42.5(pid=28831): stdout: | (launched: 2022-12-14_08:36:06.896636) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:36:08.361248 run osmo-stp_10.42.42.5(pid=28831): stderr: | 20221214083607069 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214083607069 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214083607070 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214083607070 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214083607072 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214083607072 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214083607072 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:36:08.488133 run osmo-stp_10.42.42.5(pid=28831): stdout: | (launched: 2022-12-14_08:36:06.896636) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:36:08.607936 run osmo-stp_10.42.42.5(pid=28831): stderr: | 20221214083607069 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214083607069 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214083607070 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214083607070 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214083607072 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214083607072 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214083607072 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:36:08.751784 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=28831): Process ended prematurely: osmo-stp_10.42.42.5(pid=28831) [trial-2402↪ussd:oc2g↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28831)] [trial-2402↪ussd:oc2g↪assert_extension.py:17] 08:36:08.760113 tst assert_extension.py:17: Test FAILED (5.9 sec) 08:36:08.786169 run osmo-hlr_10.42.42.2(pid=28828): ERR: Terminated: ERROR {rc=237} [trial-2402↪ussd:oc2g↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28828)] 08:36:08.834827 run osmo-hlr_10.42.42.2(pid=28828): stdout: | (launched: 2022-12-14_08:36:05.924582) 08:36:08.884087 run osmo-hlr_10.42.42.2(pid=28828): stderr: | 20221214083606106 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214083606106 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214083606106 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214083606106 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214083606106 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214083606106 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214083606118 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/ussd:oc2g/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214083606126 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214083606126 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214083606126 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:36:08.953238 run osmo-msc_10.42.42.6(pid=28834): ERR: Terminated: ERROR {rc=2} [trial-2402↪ussd:oc2g↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28834)] 08:36:09.000502 run osmo-msc_10.42.42.6(pid=28834): stdout: | (launched: 2022-12-14_08:36:07.873089) 08:36:09.049776 run osmo-msc_10.42.42.6(pid=28834): stderr: | 20221214083608146 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214083608146 DLGLOBAL DEBUG validating counter group 0x7f48aa402c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214083608146 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214083608146 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214083608146 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214083608146 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214083608148 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214083608148 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214083608149 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214083608149 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:36:09.099531 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28827): Terminating (SIGTERM) 08:36:09.139054 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28830): Terminating (SIGTERM) 08:36:09.178622 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28833): Terminating (SIGTERM) 08:36:09.218387 --- ParallelTerminationStrategy: PID 28827 died... 08:36:09.238074 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28827): Terminated: ok {rc=0} 08:36:09.282196 --- ParallelTerminationStrategy: PID 28830 died... 08:36:09.301264 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28830): Terminated: ok {rc=0} 08:36:09.345143 --- ParallelTerminationStrategy: PID 28833 died... 08:36:09.364061 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28833): Terminated: ok {rc=0} 08:36:09.450852 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2402 ussd:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 08:36:10.644375 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:36:10.650794 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 08:36:10.671154 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 08:36:10.699430 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 08:36:10.752400 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 08:36:10.773979 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 08:36:10.801152 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 08:36:11.348800 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2402 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 08:36:11.400572 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:36:11.411822 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 08:36:11.468895 tst mo_mt_call.py: using LAC 39703 08:36:11.593482 tst mo_mt_call.py: using RAC 178 08:36:11.715044 tst mo_mt_call.py: using CellId 39703 08:36:11.838157 tst mo_mt_call.py: using BVCI 39704 08:36:11.950704 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:36:11.961893 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:36:11.972898 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:36:11.984135 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:36:11.995404 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:36:12.006897 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 08:36:12.122202 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 08:36:12.240727 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:36:12.724114 run create_hlr_db(pid=28839): Launched 08:36:12.843737 bus /sierra_2: Setting Powered False 08:36:13.904688 run create_hlr_db(pid=28839): Terminated: ok {rc=0} 08:36:14.337653 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28841): Launched 08:36:14.650143 run osmo-hlr_10.42.42.2(pid=28842): Launched 08:36:14.769504 run osmo-stp_10.42.42.5: Starting osmo-stp 08:36:15.306471 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28844): Launched 08:36:15.619527 run osmo-stp_10.42.42.5(pid=28845): Launched 08:36:15.740871 run osmo-msc_10.42.42.6: Starting osmo-msc 08:36:16.327800 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28847): Launched 08:36:16.719578 run osmo-msc_10.42.42.6(pid=28848): Launched 08:36:17.072281 run osmo-stp_10.42.42.5(pid=28845): ERR: Terminated: ERROR {rc=1} [trial-2402↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28845)] 08:36:17.295630 run osmo-stp_10.42.42.5(pid=28845): stdout: | (launched: 2022-12-14_08:36:15.560225) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:36:17.438597 run osmo-stp_10.42.42.5(pid=28845): stderr: | 20221214083615734 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214083615734 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214083615734 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214083615735 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214083615735 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214083615735 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214083615735 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:36:17.578959 run osmo-stp_10.42.42.5(pid=28845): stdout: | (launched: 2022-12-14_08:36:15.560225) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:36:17.711237 run osmo-stp_10.42.42.5(pid=28845): stderr: | 20221214083615734 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214083615734 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214083615734 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214083615735 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214083615735 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214083615735 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214083615735 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:36:17.869310 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28845): Process ended prematurely: osmo-stp_10.42.42.5(pid=28845) [trial-2402↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28845)] [trial-2402↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 08:36:17.879057 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 08:36:17.907200 run osmo-hlr_10.42.42.2(pid=28842): ERR: Terminated: ERROR {rc=237} [trial-2402↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28842)] 08:36:17.957988 run osmo-hlr_10.42.42.2(pid=28842): stdout: | (launched: 2022-12-14_08:36:14.591119) 08:36:18.010599 run osmo-hlr_10.42.42.2(pid=28842): stderr: | 20221214083614772 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214083614772 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214083614773 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214083614773 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214083614773 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214083614773 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214083614784 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214083614793 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214083614793 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214083614793 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:36:18.084093 run osmo-msc_10.42.42.6(pid=28848): ERR: Terminated: ERROR {rc=2} [trial-2402↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28848)] 08:36:18.134705 run osmo-msc_10.42.42.6(pid=28848): stdout: | (launched: 2022-12-14_08:36:16.659803) 08:36:18.187269 run osmo-msc_10.42.42.6(pid=28848): stderr: | 20221214083617239 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214083617239 DLGLOBAL DEBUG validating counter group 0x7f61f541fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214083617239 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214083617239 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214083617239 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214083617240 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214083617241 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214083617242 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214083617242 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214083617242 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:36:18.239884 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28841): Terminating (SIGTERM) 08:36:18.281746 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28844): Terminating (SIGTERM) 08:36:18.323784 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28847): Terminating (SIGTERM) 08:36:18.366632 --- ParallelTerminationStrategy: PID 28841 died... 08:36:18.387122 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28841): Terminated: ok {rc=0} 08:36:18.433692 --- ParallelTerminationStrategy: PID 28844 died... 08:36:18.453550 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28844): Terminated: ok {rc=0} 08:36:18.499797 --- ParallelTerminationStrategy: PID 28847 died... 08:36:18.519522 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28847): Terminated: ok {rc=0} 08:36:18.606711 bus /sierra_3: Setting Powered False 08:36:19.705018 bus /sierra_3: Setting Powered False 08:36:20.822369 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2402 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 08:36:21.969242 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:36:21.981448 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 08:36:22.038904 tst mo_mt_call_osmux.py: using LAC 39704 08:36:22.162796 tst mo_mt_call_osmux.py: using RAC 179 08:36:22.286160 tst mo_mt_call_osmux.py: using CellId 39704 08:36:22.408222 tst mo_mt_call_osmux.py: using BVCI 39705 08:36:22.532557 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:36:22.544400 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:36:22.556105 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:36:22.567554 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:36:22.579268 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:36:22.590808 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 08:36:22.706946 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 08:36:22.827802 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:36:23.345512 run create_hlr_db(pid=28850): Launched 08:36:23.480681 bus /sierra_2: Setting Powered False 08:36:24.545952 run create_hlr_db(pid=28850): Terminated: ok {rc=0} 08:36:24.990459 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28852): Launched 08:36:25.302349 run osmo-hlr_10.42.42.2(pid=28853): Launched 08:36:25.423805 run osmo-stp_10.42.42.5: Starting osmo-stp 08:36:25.977924 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28855): Launched 08:36:26.291339 run osmo-stp_10.42.42.5(pid=28856): Launched 08:36:26.411348 run osmo-msc_10.42.42.6: Starting osmo-msc 08:36:26.986816 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28858): Launched 08:36:27.298382 run osmo-msc_10.42.42.6(pid=28859): Launched 08:36:27.473305 run osmo-stp_10.42.42.5(pid=28856): ERR: Terminated: ERROR {rc=1} [trial-2402↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28856)] 08:36:27.605996 run osmo-stp_10.42.42.5(pid=28856): stdout: | (launched: 2022-12-14_08:36:26.231997) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:36:27.736651 run osmo-stp_10.42.42.5(pid=28856): stderr: | 20221214083626406 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214083626406 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214083626407 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214083626407 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214083626408 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214083626408 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214083626408 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:36:27.866152 run osmo-stp_10.42.42.5(pid=28856): stdout: | (launched: 2022-12-14_08:36:26.231997) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:36:27.989174 run osmo-stp_10.42.42.5(pid=28856): stderr: | 20221214083626406 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214083626406 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214083626407 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214083626407 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214083626408 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214083626408 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214083626408 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:36:28.136784 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28856): Process ended prematurely: osmo-stp_10.42.42.5(pid=28856) [trial-2402↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28856)] [trial-2402↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 08:36:28.146015 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 08:36:28.172597 run osmo-hlr_10.42.42.2(pid=28853): ERR: Terminated: ERROR {rc=237} [trial-2402↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28853)] 08:36:28.221429 run osmo-hlr_10.42.42.2(pid=28853): stdout: | (launched: 2022-12-14_08:36:25.243693) 08:36:28.271237 run osmo-hlr_10.42.42.2(pid=28853): stderr: | 20221214083625422 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214083625422 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214083625422 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214083625423 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214083625423 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214083625423 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214083625436 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214083625444 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214083625444 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214083625444 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:36:28.340667 run osmo-msc_10.42.42.6(pid=28859): ERR: Terminated: ERROR {rc=2} [trial-2402↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28859)] 08:36:28.388406 run osmo-msc_10.42.42.6(pid=28859): stdout: | (launched: 2022-12-14_08:36:27.239381) 08:36:28.437881 run osmo-msc_10.42.42.6(pid=28859): stderr: | 20221214083627514 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214083627515 DLGLOBAL DEBUG validating counter group 0x7f25d89f5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214083627515 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214083627515 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214083627515 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214083627515 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214083627517 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214083627517 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214083627518 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214083627518 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:36:28.487889 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28852): Terminating (SIGTERM) 08:36:28.527748 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28855): Terminating (SIGTERM) 08:36:28.567514 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28858): Terminating (SIGTERM) 08:36:28.607670 --- ParallelTerminationStrategy: PID 28852 died... 08:36:28.627361 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28852): Terminated: ok {rc=0} 08:36:28.671731 --- ParallelTerminationStrategy: PID 28855 died... 08:36:28.690833 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28855): Terminated: ok {rc=0} 08:36:28.734920 --- ParallelTerminationStrategy: PID 28858 died... 08:36:28.753990 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28858): Terminated: ok {rc=0} 08:36:28.839973 bus /sierra_3: Setting Powered False 08:36:29.940871 bus /sierra_3: Setting Powered False 08:36:31.060673 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2402 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 08:36:32.296570 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:36:32.304454 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 08:36:32.326064 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 08:36:32.354048 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 08:36:32.412451 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 08:36:32.434334 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 08:36:32.461617 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 08:36:33.004372 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2402 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 08:36:33.054755 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:36:33.066180 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 08:36:33.120866 tst mo_mt_call.py: using LAC 39705 08:36:33.241761 tst mo_mt_call.py: using RAC 180 08:36:33.364490 tst mo_mt_call.py: using CellId 39705 08:36:33.485482 tst mo_mt_call.py: using BVCI 39706 08:36:33.608170 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:36:33.619936 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:36:33.631472 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:36:33.643066 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:36:33.654614 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:36:33.666303 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 08:36:33.798156 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 08:36:33.915321 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:36:34.382856 run create_hlr_db(pid=28864): Launched 08:36:34.496517 bus /sierra_2: Setting Powered False 08:36:35.556622 run create_hlr_db(pid=28864): Terminated: ok {rc=0} 08:36:35.998555 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28866): Launched 08:36:36.321900 run osmo-hlr_10.42.42.2(pid=28867): Launched 08:36:36.445726 run osmo-stp_10.42.42.5: Starting osmo-stp 08:36:37.006684 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28869): Launched 08:36:37.329816 run osmo-stp_10.42.42.5(pid=28870): Launched 08:36:37.453874 run osmo-msc_10.42.42.6: Starting osmo-msc 08:36:38.038134 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28872): Launched 08:36:38.362227 run osmo-msc_10.42.42.6(pid=28873): Launched 08:36:38.542610 run osmo-stp_10.42.42.5(pid=28870): ERR: Terminated: ERROR {rc=1} [trial-2402↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28870)] 08:36:38.678174 run osmo-stp_10.42.42.5(pid=28870): stdout: | (launched: 2022-12-14_08:36:37.269208) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:36:38.814866 run osmo-stp_10.42.42.5(pid=28870): stderr: | 20221214083637465 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214083637465 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214083637465 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214083637466 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214083637466 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214083637466 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214083637466 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:36:38.950051 run osmo-stp_10.42.42.5(pid=28870): stdout: | (launched: 2022-12-14_08:36:37.269208) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:36:39.078183 run osmo-stp_10.42.42.5(pid=28870): stderr: | 20221214083637465 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214083637465 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214083637465 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214083637466 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214083637466 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214083637466 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214083637466 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:36:39.231854 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28870): Process ended prematurely: osmo-stp_10.42.42.5(pid=28870) [trial-2402↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28870)] [trial-2402↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 08:36:39.241761 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 08:36:39.269713 run osmo-hlr_10.42.42.2(pid=28867): ERR: Terminated: ERROR {rc=237} [trial-2402↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28867)] 08:36:39.320210 run osmo-hlr_10.42.42.2(pid=28867): stdout: | (launched: 2022-12-14_08:36:36.261291) 08:36:39.373059 run osmo-hlr_10.42.42.2(pid=28867): stderr: | 20221214083636461 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214083636461 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214083636461 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214083636461 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214083636461 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214083636461 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214083636474 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214083636482 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214083636482 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214083636482 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:36:39.445791 run osmo-msc_10.42.42.6(pid=28873): ERR: Terminated: ERROR {rc=2} [trial-2402↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28873)] 08:36:39.496127 run osmo-msc_10.42.42.6(pid=28873): stdout: | (launched: 2022-12-14_08:36:38.300891) 08:36:39.548031 run osmo-msc_10.42.42.6(pid=28873): stderr: | 20221214083638623 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214083638623 DLGLOBAL DEBUG validating counter group 0x7f1aadbabc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214083638623 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214083638623 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214083638624 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214083638624 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214083638625 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214083638626 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214083638626 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214083638626 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:36:39.600470 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28866): Terminating (SIGTERM) 08:36:39.642219 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28869): Terminating (SIGTERM) 08:36:39.684141 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28872): Terminating (SIGTERM) 08:36:39.726619 --- ParallelTerminationStrategy: PID 28866 died... 08:36:39.746755 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28866): Terminated: ok {rc=0} 08:36:39.793032 --- ParallelTerminationStrategy: PID 28869 died... 08:36:39.812310 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28869): Terminated: ok {rc=0} 08:36:39.858382 --- ParallelTerminationStrategy: PID 28872 died... 08:36:39.877879 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28872): Terminated: ok {rc=0} 08:36:39.964347 bus /sierra_3: Setting Powered False 08:36:41.063012 bus /sierra_3: Setting Powered False 08:36:42.178400 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2402 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 08:36:43.323629 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:36:43.335399 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 08:36:43.391995 tst mo_mt_call_osmux.py: using LAC 39706 08:36:43.512125 tst mo_mt_call_osmux.py: using RAC 181 08:36:43.630162 tst mo_mt_call_osmux.py: using CellId 39706 08:36:43.748379 tst mo_mt_call_osmux.py: using BVCI 39707 08:36:43.857983 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:36:43.869024 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:36:43.879776 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:36:43.890604 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:36:43.901872 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:36:43.913098 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 08:36:44.027997 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 08:36:44.148143 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:36:44.616355 run create_hlr_db(pid=28875): Launched 08:36:44.730165 bus /sierra_2: Setting Powered False 08:36:45.790459 run create_hlr_db(pid=28875): Terminated: ok {rc=0} 08:36:46.270982 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28877): Launched 08:36:46.617545 run osmo-hlr_10.42.42.2(pid=28878): Launched 08:36:46.876220 run osmo-stp_10.42.42.5: Starting osmo-stp 08:36:47.506484 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28880): Launched 08:36:47.831563 run osmo-stp_10.42.42.5(pid=28881): Launched 08:36:47.953816 run osmo-msc_10.42.42.6: Starting osmo-msc 08:36:48.537134 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28883): Launched 08:36:48.860132 run osmo-msc_10.42.42.6(pid=28884): Launched 08:36:49.039626 run osmo-stp_10.42.42.5(pid=28881): ERR: Terminated: ERROR {rc=1} [trial-2402↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28881)] 08:36:49.175042 run osmo-stp_10.42.42.5(pid=28881): stdout: | (launched: 2022-12-14_08:36:47.770563) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:36:49.310402 run osmo-stp_10.42.42.5(pid=28881): stderr: | 20221214083647964 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214083647965 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214083647965 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214083647965 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214083647966 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214083647966 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214083647966 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:36:49.446313 run osmo-stp_10.42.42.5(pid=28881): stdout: | (launched: 2022-12-14_08:36:47.770563) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:36:49.574118 run osmo-stp_10.42.42.5(pid=28881): stderr: | 20221214083647964 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214083647965 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214083647965 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214083647965 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214083647966 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214083647966 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214083647966 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:36:49.727073 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28881): Process ended prematurely: osmo-stp_10.42.42.5(pid=28881) [trial-2402↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28881)] [trial-2402↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 08:36:49.736463 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 08:36:49.764217 run osmo-hlr_10.42.42.2(pid=28878): ERR: Terminated: ERROR {rc=237} [trial-2402↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28878)] 08:36:49.814646 run osmo-hlr_10.42.42.2(pid=28878): stdout: | (launched: 2022-12-14_08:36:46.550919) 08:36:49.866282 run osmo-hlr_10.42.42.2(pid=28878): stderr: | 20221214083646861 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214083646861 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214083646861 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214083646861 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214083646861 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214083646861 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214083646879 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214083646893 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214083646894 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214083646894 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:36:49.938294 run osmo-msc_10.42.42.6(pid=28884): ERR: Terminated: ERROR {rc=2} [trial-2402↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28884)] 08:36:49.988057 run osmo-msc_10.42.42.6(pid=28884): stdout: | (launched: 2022-12-14_08:36:48.799525) 08:36:50.039475 run osmo-msc_10.42.42.6(pid=28884): stderr: | 20221214083649122 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214083649122 DLGLOBAL DEBUG validating counter group 0x7f282518bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214083649122 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214083649122 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214083649122 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214083649122 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214083649124 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214083649124 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214083649124 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214083649125 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:36:50.091323 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28877): Terminating (SIGTERM) 08:36:50.132365 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28880): Terminating (SIGTERM) 08:36:50.173818 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28883): Terminating (SIGTERM) 08:36:50.215349 --- ParallelTerminationStrategy: PID 28877 died... 08:36:50.235342 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28877): Terminated: ok {rc=0} 08:36:50.281238 --- ParallelTerminationStrategy: PID 28880 died... 08:36:50.300744 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28880): Terminated: ok {rc=0} 08:36:50.346536 --- ParallelTerminationStrategy: PID 28883 died... 08:36:50.366105 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28883): Terminated: ok {rc=0} 08:36:50.452680 bus /sierra_3: Setting Powered False 08:36:51.549590 bus /sierra_3: Setting Powered False 08:36:52.663189 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2402 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 08:36:53.895472 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:36:53.901808 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 08:36:53.922022 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 08:36:53.949363 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 08:36:54.000328 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 08:36:54.020667 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 08:36:54.047737 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 08:36:54.595800 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2402 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 08:36:54.648658 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:36:54.660010 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 08:36:54.716912 tst mo_mt_call.py: using LAC 39707 08:36:54.845002 tst mo_mt_call.py: using RAC 182 08:36:54.971228 tst mo_mt_call.py: using CellId 39707 08:36:55.097814 tst mo_mt_call.py: using BVCI 39708 08:36:55.216199 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:36:55.227702 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:36:55.238996 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:36:55.250255 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:36:55.261593 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:36:55.272800 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 08:36:55.393358 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 08:36:55.510093 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:36:55.978817 run create_hlr_db(pid=28889): Launched 08:36:56.094254 bus /sierra_2: Setting Powered False 08:36:57.154122 run create_hlr_db(pid=28889): Terminated: ok {rc=0} 08:36:57.594267 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28891): Launched 08:36:57.918808 run osmo-hlr_10.42.42.2(pid=28892): Launched 08:36:58.041971 run osmo-stp_10.42.42.5: Starting osmo-stp 08:36:58.601498 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28894): Launched 08:36:58.923692 run osmo-stp_10.42.42.5(pid=28895): Launched 08:36:59.046790 run osmo-msc_10.42.42.6: Starting osmo-msc 08:36:59.630534 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28897): Launched 08:36:59.953683 run osmo-msc_10.42.42.6(pid=28898): Launched 08:37:00.133397 run osmo-stp_10.42.42.5(pid=28895): ERR: Terminated: ERROR {rc=1} [trial-2402↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28895)] 08:37:00.268227 run osmo-stp_10.42.42.5(pid=28895): stdout: | (launched: 2022-12-14_08:36:58.863076) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:37:00.404347 run osmo-stp_10.42.42.5(pid=28895): stderr: | 20221214083659057 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214083659057 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214083659058 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214083659058 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214083659058 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214083659058 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214083659059 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:37:00.539098 run osmo-stp_10.42.42.5(pid=28895): stdout: | (launched: 2022-12-14_08:36:58.863076) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:37:00.666699 run osmo-stp_10.42.42.5(pid=28895): stderr: | 20221214083659057 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214083659057 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214083659058 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214083659058 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214083659058 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214083659058 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214083659059 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:37:00.819503 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28895): Process ended prematurely: osmo-stp_10.42.42.5(pid=28895) [trial-2402↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28895)] [trial-2402↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 08:37:00.828813 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 08:37:00.857619 run osmo-hlr_10.42.42.2(pid=28892): ERR: Terminated: ERROR {rc=237} [trial-2402↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28892)] 08:37:00.908751 run osmo-hlr_10.42.42.2(pid=28892): stdout: | (launched: 2022-12-14_08:36:57.858012) 08:37:00.970730 run osmo-hlr_10.42.42.2(pid=28892): stderr: | 20221214083658057 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214083658057 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214083658057 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214083658058 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214083658058 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214083658058 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214083658069 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214083658077 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214083658077 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214083658077 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:37:01.044163 run osmo-msc_10.42.42.6(pid=28898): ERR: Terminated: ERROR {rc=2} [trial-2402↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28898)] 08:37:01.093413 run osmo-msc_10.42.42.6(pid=28898): stdout: | (launched: 2022-12-14_08:36:59.893230) 08:37:01.147626 run osmo-msc_10.42.42.6(pid=28898): stderr: | 20221214083700216 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214083700217 DLGLOBAL DEBUG validating counter group 0x7f0b46962c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214083700217 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214083700217 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214083700217 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214083700217 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214083700219 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214083700219 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214083700219 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214083700219 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:37:01.199330 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28891): Terminating (SIGTERM) 08:37:01.243180 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28894): Terminating (SIGTERM) 08:37:01.287638 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28897): Terminating (SIGTERM) 08:37:01.332429 --- ParallelTerminationStrategy: PID 28891 died... 08:37:01.353615 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28891): Terminated: ok {rc=0} 08:37:01.401400 --- ParallelTerminationStrategy: PID 28894 died... 08:37:01.422098 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28894): Terminated: ok {rc=0} 08:37:01.470181 --- ParallelTerminationStrategy: PID 28897 died... 08:37:01.490704 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28897): Terminated: ok {rc=0} 08:37:01.578526 bus /sierra_3: Setting Powered False 08:37:02.673304 bus /sierra_3: Setting Powered False 08:37:03.783159 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2402 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 08:37:04.930987 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:37:04.943180 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 08:37:05.001428 tst mo_mt_call_osmux.py: using LAC 39708 08:37:05.129085 tst mo_mt_call_osmux.py: using RAC 183 08:37:05.254809 tst mo_mt_call_osmux.py: using CellId 39708 08:37:05.386079 tst mo_mt_call_osmux.py: using BVCI 39709 08:37:05.503900 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:37:05.515532 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:37:05.526881 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:37:05.538212 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:37:05.549572 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:37:05.561074 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 08:37:05.679911 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 08:37:05.795981 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:37:06.261095 run create_hlr_db(pid=28900): Launched 08:37:06.375342 bus /sierra_2: Setting Powered False 08:37:07.435177 run create_hlr_db(pid=28900): Terminated: ok {rc=0} 08:37:07.872643 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28902): Launched 08:37:08.194603 run osmo-hlr_10.42.42.2(pid=28903): Launched 08:37:08.316435 run osmo-stp_10.42.42.5: Starting osmo-stp 08:37:08.870222 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28905): Launched 08:37:09.190613 run osmo-stp_10.42.42.5(pid=28906): Launched 08:37:09.312662 run osmo-msc_10.42.42.6: Starting osmo-msc 08:37:09.892200 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28908): Launched 08:37:10.214474 run osmo-msc_10.42.42.6(pid=28909): Launched 08:37:10.395347 run osmo-stp_10.42.42.5(pid=28906): ERR: Terminated: ERROR {rc=1} [trial-2402↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28906)] 08:37:10.530560 run osmo-stp_10.42.42.5(pid=28906): stdout: | (launched: 2022-12-14_08:37:09.130502) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:37:10.665626 run osmo-stp_10.42.42.5(pid=28906): stderr: | 20221214083709325 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214083709325 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214083709326 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214083709326 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214083709326 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214083709327 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214083709327 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:37:10.799815 run osmo-stp_10.42.42.5(pid=28906): stdout: | (launched: 2022-12-14_08:37:09.130502) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:37:10.926878 run osmo-stp_10.42.42.5(pid=28906): stderr: | 20221214083709325 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214083709325 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214083709326 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214083709326 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214083709326 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214083709327 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214083709327 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:37:11.079263 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28906): Process ended prematurely: osmo-stp_10.42.42.5(pid=28906) [trial-2402↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28906)] [trial-2402↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 08:37:11.088607 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 08:37:11.116322 run osmo-hlr_10.42.42.2(pid=28903): ERR: Terminated: ERROR {rc=237} [trial-2402↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28903)] 08:37:11.166200 run osmo-hlr_10.42.42.2(pid=28903): stdout: | (launched: 2022-12-14_08:37:08.134373) 08:37:11.217779 run osmo-hlr_10.42.42.2(pid=28903): stderr: | 20221214083708335 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214083708335 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214083708335 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214083708335 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214083708335 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214083708335 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214083708347 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214083708357 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214083708357 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214083708357 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:37:11.289722 run osmo-msc_10.42.42.6(pid=28909): ERR: Terminated: ERROR {rc=2} [trial-2402↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28909)] 08:37:11.339440 run osmo-msc_10.42.42.6(pid=28909): stdout: | (launched: 2022-12-14_08:37:10.154168) 08:37:11.390990 run osmo-msc_10.42.42.6(pid=28909): stderr: | 20221214083710478 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214083710478 DLGLOBAL DEBUG validating counter group 0x7f314ccd1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214083710479 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214083710479 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214083710479 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214083710479 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214083710481 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214083710481 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214083710481 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214083710481 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:37:11.442860 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28902): Terminating (SIGTERM) 08:37:11.483718 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28905): Terminating (SIGTERM) 08:37:11.524548 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28908): Terminating (SIGTERM) 08:37:11.565935 --- ParallelTerminationStrategy: PID 28902 died... 08:37:11.585581 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28902): Terminated: ok {rc=0} 08:37:11.631636 --- ParallelTerminationStrategy: PID 28905 died... 08:37:11.651196 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28905): Terminated: ok {rc=0} 08:37:11.697144 --- ParallelTerminationStrategy: PID 28908 died... 08:37:11.716628 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28908): Terminated: ok {rc=0} 08:37:11.803406 bus /sierra_3: Setting Powered False 08:37:12.901775 bus /sierra_3: Setting Powered False 08:37:14.017214 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2402 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 08:37:15.249504 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:37:15.256695 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 08:37:15.277633 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 08:37:15.304840 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 08:37:15.356745 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 08:37:15.376868 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 08:37:15.403798 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 08:37:15.985503 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2402 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 08:37:16.037911 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 08:37:16.049951 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 08:37:16.107911 tst mo_mt_call.py: using LAC 39709 08:37:16.227975 tst mo_mt_call.py: using RAC 184 08:37:16.347823 tst mo_mt_call.py: using CellId 39709 08:37:16.465789 tst mo_mt_call.py: using BVCI 39710 08:37:16.576367 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 08:37:16.588650 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 08:37:16.600575 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 08:37:16.612362 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 08:37:16.625544 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 08:37:16.638607 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 08:37:16.756303 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 08:37:16.889663 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:37:17.403121 run create_hlr_db(pid=28914): Launched 08:37:17.534603 bus /sierra_2: Setting Powered False 08:37:18.598517 run create_hlr_db(pid=28914): Terminated: ok {rc=0} 08:37:19.020865 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28916): Launched 08:37:19.317084 run osmo-hlr_10.42.42.2(pid=28917): Launched 08:37:19.430172 run osmo-stp_10.42.42.5: Starting osmo-stp 08:37:19.952880 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28919): Launched 08:37:20.249291 run osmo-stp_10.42.42.5(pid=28920): Launched 08:37:20.363062 run osmo-msc_10.42.42.6: Starting osmo-msc 08:37:20.899373 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28922): Launched 08:37:21.198916 run osmo-msc_10.42.42.6(pid=28923): Launched 08:37:21.366366 run osmo-stp_10.42.42.5(pid=28920): ERR: Terminated: ERROR {rc=1} [trial-2402↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28920)] 08:37:21.493271 run osmo-stp_10.42.42.5(pid=28920): stdout: | (launched: 2022-12-14_08:37:20.195026) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:37:21.620327 run osmo-stp_10.42.42.5(pid=28920): stderr: | 20221214083720362 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214083720362 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214083720362 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214083720362 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214083720363 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214083720363 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214083720363 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:37:21.745602 run osmo-stp_10.42.42.5(pid=28920): stdout: | (launched: 2022-12-14_08:37:20.195026) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:37:21.865098 run osmo-stp_10.42.42.5(pid=28920): stderr: | 20221214083720362 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214083720362 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214083720362 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214083720362 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214083720363 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214083720363 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214083720363 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:37:22.007951 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28920): Process ended prematurely: osmo-stp_10.42.42.5(pid=28920) [trial-2402↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28920)] [trial-2402↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 08:37:22.016891 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 08:37:22.043457 run osmo-hlr_10.42.42.2(pid=28917): ERR: Terminated: ERROR {rc=237} [trial-2402↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28917)] 08:37:22.091330 run osmo-hlr_10.42.42.2(pid=28917): stdout: | (launched: 2022-12-14_08:37:19.262860) 08:37:22.140400 run osmo-hlr_10.42.42.2(pid=28917): stderr: | 20221214083719435 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214083719435 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214083719435 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214083719435 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214083719435 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214083719436 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214083719447 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214083719456 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214083719457 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214083719457 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:37:22.209249 run osmo-msc_10.42.42.6(pid=28923): ERR: Terminated: ERROR {rc=2} [trial-2402↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28923)] 08:37:22.256176 run osmo-msc_10.42.42.6(pid=28923): stdout: | (launched: 2022-12-14_08:37:21.143672) 08:37:22.305339 run osmo-msc_10.42.42.6(pid=28923): stderr: | 20221214083721411 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214083721412 DLGLOBAL DEBUG validating counter group 0x7f43f410bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214083721412 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214083721412 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214083721412 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214083721412 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214083721414 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214083721414 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214083721414 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214083721414 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:37:22.354834 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28916): Terminating (SIGTERM) 08:37:22.394168 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28919): Terminating (SIGTERM) 08:37:22.433461 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28922): Terminating (SIGTERM) 08:37:22.473501 --- ParallelTerminationStrategy: PID 28916 died... 08:37:22.492811 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28916): Terminated: ok {rc=0} 08:37:22.536454 --- ParallelTerminationStrategy: PID 28919 died... 08:37:22.555448 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28919): Terminated: ok {rc=0} 08:37:22.598881 --- ParallelTerminationStrategy: PID 28922 died... 08:37:22.617607 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28922): Terminated: ok {rc=0} 08:37:22.700367 bus /sierra_3: Setting Powered False 08:37:23.796371 bus /sierra_3: Setting Powered False 08:37:24.913764 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2402 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 08:37:26.058191 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 08:37:26.070041 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 08:37:26.126152 tst mo_mt_call_osmux.py: using LAC 39710 08:37:26.244704 tst mo_mt_call_osmux.py: using RAC 185 08:37:26.362703 tst mo_mt_call_osmux.py: using CellId 39710 08:37:26.480935 tst mo_mt_call_osmux.py: using BVCI 39711 08:37:26.590416 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 08:37:26.601394 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 08:37:26.612071 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 08:37:26.622864 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 08:37:26.633927 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 08:37:26.644926 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 08:37:26.759464 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 08:37:26.877494 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:37:27.381075 run create_hlr_db(pid=28925): Launched 08:37:27.513443 bus /sierra_2: Setting Powered False 08:37:28.577953 run create_hlr_db(pid=28925): Terminated: ok {rc=0} 08:37:29.009110 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28927): Launched 08:37:29.311057 run osmo-hlr_10.42.42.2(pid=28928): Launched 08:37:29.426723 run osmo-stp_10.42.42.5: Starting osmo-stp 08:37:29.959702 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28930): Launched 08:37:30.261536 run osmo-stp_10.42.42.5(pid=28931): Launched 08:37:30.376663 run osmo-msc_10.42.42.6: Starting osmo-msc 08:37:30.948601 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28933): Launched 08:37:31.258490 run osmo-msc_10.42.42.6(pid=28934): Launched 08:37:31.576502 run osmo-stp_10.42.42.5(pid=28931): ERR: Terminated: ERROR {rc=1} [trial-2402↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28931)] 08:37:31.882263 run osmo-stp_10.42.42.5(pid=28931): stdout: | (launched: 2022-12-14_08:37:30.205855) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:37:32.195820 run osmo-stp_10.42.42.5(pid=28931): stderr: | 20221214083730372 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214083730372 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214083730373 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214083730373 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214083730374 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214083730374 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214083730374 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:37:32.343027 run osmo-stp_10.42.42.5(pid=28931): stdout: | (launched: 2022-12-14_08:37:30.205855) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:37:32.463423 run osmo-stp_10.42.42.5(pid=28931): stderr: | 20221214083730372 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214083730372 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214083730373 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214083730373 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214083730374 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214083730374 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214083730374 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:37:32.606902 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28931): Process ended prematurely: osmo-stp_10.42.42.5(pid=28931) [trial-2402↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28931)] [trial-2402↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 08:37:32.615915 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 08:37:32.642744 run osmo-hlr_10.42.42.2(pid=28928): ERR: Terminated: ERROR {rc=237} [trial-2402↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28928)] 08:37:32.691442 run osmo-hlr_10.42.42.2(pid=28928): stdout: | (launched: 2022-12-14_08:37:29.255639) 08:37:32.741400 run osmo-hlr_10.42.42.2(pid=28928): stderr: | 20221214083729427 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214083729427 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214083729427 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214083729427 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214083729427 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214083729427 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214083729439 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214083729447 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214083729448 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214083729448 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:37:32.811807 run osmo-msc_10.42.42.6(pid=28934): ERR: Terminated: ERROR {rc=2} [trial-2402↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28934)] 08:37:32.859502 run osmo-msc_10.42.42.6(pid=28934): stdout: | (launched: 2022-12-14_08:37:31.199991) 08:37:32.909199 run osmo-msc_10.42.42.6(pid=28934): stderr: | 20221214083731865 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214083731868 DLGLOBAL DEBUG validating counter group 0x7f2f0d631c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214083731868 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214083731869 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214083731869 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214083731870 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214083731879 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214083731881 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214083731882 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214083731882 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:37:32.959052 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28927): Terminating (SIGTERM) 08:37:32.999365 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28930): Terminating (SIGTERM) 08:37:33.039569 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28933): Terminating (SIGTERM) 08:37:33.080012 --- ParallelTerminationStrategy: PID 28927 died... 08:37:33.099883 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28927): Terminated: ok {rc=0} 08:37:33.144461 --- ParallelTerminationStrategy: PID 28930 died... 08:37:33.163753 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28930): Terminated: ok {rc=0} 08:37:33.208692 --- ParallelTerminationStrategy: PID 28933 died... 08:37:33.227861 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28933): Terminated: ok {rc=0} 08:37:33.314694 bus /sierra_3: Setting Powered False 08:37:34.412787 bus /sierra_3: Setting Powered False 08:37:35.527400 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2402 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 08:37:36.759265 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:37:36.765985 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 08:37:36.786718 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 08:37:36.814825 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 08:37:36.867297 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 08:37:36.888917 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 08:37:36.916464 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 08:37:37.462376 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2402 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 08:37:37.511970 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:37:37.523184 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 08:37:37.578773 tst mo_mt_call.py: using LAC 39711 08:37:37.699148 tst mo_mt_call.py: using RAC 186 08:37:37.827303 tst mo_mt_call.py: using CellId 39711 08:37:37.954358 tst mo_mt_call.py: using BVCI 39712 08:37:38.072362 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:37:38.084107 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:37:38.095585 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:37:38.106955 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:37:38.118265 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:37:38.129604 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 08:37:38.247956 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 08:37:38.364161 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:37:38.833244 run create_hlr_db(pid=28939): Launched 08:37:38.957809 bus /sierra_2: Setting Powered False 08:37:40.018453 run create_hlr_db(pid=28939): Terminated: ok {rc=0} 08:37:40.460280 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28941): Launched 08:37:40.783286 run osmo-hlr_10.42.42.2(pid=28942): Launched 08:37:40.905513 run osmo-stp_10.42.42.5: Starting osmo-stp 08:37:41.461426 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28944): Launched 08:37:41.784047 run osmo-stp_10.42.42.5(pid=28945): Launched 08:37:41.907451 run osmo-msc_10.42.42.6: Starting osmo-msc 08:37:42.492465 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28947): Launched 08:37:42.815041 run osmo-msc_10.42.42.6(pid=28948): Launched 08:37:42.995388 run osmo-stp_10.42.42.5(pid=28945): ERR: Terminated: ERROR {rc=1} [trial-2402↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28945)] 08:37:43.131139 run osmo-stp_10.42.42.5(pid=28945): stdout: | (launched: 2022-12-14_08:37:41.725037) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:37:43.267534 run osmo-stp_10.42.42.5(pid=28945): stderr: | 20221214083741912 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214083741912 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214083741912 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214083741913 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214083741913 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214083741913 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214083741913 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:37:43.403007 run osmo-stp_10.42.42.5(pid=28945): stdout: | (launched: 2022-12-14_08:37:41.725037) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:37:43.531611 run osmo-stp_10.42.42.5(pid=28945): stderr: | 20221214083741912 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214083741912 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214083741912 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214083741913 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214083741913 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214083741913 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214083741913 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:37:43.685115 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28945): Process ended prematurely: osmo-stp_10.42.42.5(pid=28945) [trial-2402↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28945)] [trial-2402↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 08:37:43.694853 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 08:37:43.722796 run osmo-hlr_10.42.42.2(pid=28942): ERR: Terminated: ERROR {rc=237} [trial-2402↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28942)] 08:37:43.773190 run osmo-hlr_10.42.42.2(pid=28942): stdout: | (launched: 2022-12-14_08:37:40.724312) 08:37:43.825280 run osmo-hlr_10.42.42.2(pid=28942): stderr: | 20221214083740917 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214083740917 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214083740917 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214083740918 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214083740918 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214083740918 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214083740931 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214083740941 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214083740941 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214083740942 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:37:43.897676 run osmo-msc_10.42.42.6(pid=28948): ERR: Terminated: ERROR {rc=2} [trial-2402↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28948)] 08:37:43.947832 run osmo-msc_10.42.42.6(pid=28948): stdout: | (launched: 2022-12-14_08:37:42.755884) 08:37:43.999517 run osmo-msc_10.42.42.6(pid=28948): stderr: | 20221214083743075 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214083743076 DLGLOBAL DEBUG validating counter group 0x7f7b69195c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214083743076 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214083743076 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214083743076 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214083743076 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214083743078 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214083743078 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214083743078 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214083743079 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:37:44.051678 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28941): Terminating (SIGTERM) 08:37:44.093450 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28944): Terminating (SIGTERM) 08:37:44.135024 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28947): Terminating (SIGTERM) 08:37:44.177042 --- ParallelTerminationStrategy: PID 28941 died... 08:37:44.197247 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28941): Terminated: ok {rc=0} 08:37:44.243848 --- ParallelTerminationStrategy: PID 28944 died... 08:37:44.263649 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28944): Terminated: ok {rc=0} 08:37:44.309669 --- ParallelTerminationStrategy: PID 28947 died... 08:37:44.329340 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28947): Terminated: ok {rc=0} 08:37:44.417076 bus /sierra_3: Setting Powered False 08:37:45.515171 bus /sierra_3: Setting Powered False 08:37:46.630905 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2402 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 08:37:47.781470 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:37:47.793681 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 08:37:47.853305 tst mo_mt_call_osmux.py: using LAC 39712 08:37:47.974176 tst mo_mt_call_osmux.py: using RAC 187 08:37:48.095415 tst mo_mt_call_osmux.py: using CellId 39712 08:37:48.213086 tst mo_mt_call_osmux.py: using BVCI 39713 08:37:48.323675 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:37:48.334910 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:37:48.345975 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:37:48.356820 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:37:48.368576 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:37:48.380346 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 08:37:48.501022 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 08:37:48.617958 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:37:49.087014 run create_hlr_db(pid=28950): Launched 08:37:49.201046 bus /sierra_2: Setting Powered False 08:37:50.261610 run create_hlr_db(pid=28950): Terminated: ok {rc=0} 08:37:50.701555 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28952): Launched 08:37:51.023408 run osmo-hlr_10.42.42.2(pid=28953): Launched 08:37:51.146365 run osmo-stp_10.42.42.5: Starting osmo-stp 08:37:51.705463 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28955): Launched 08:37:52.028386 run osmo-stp_10.42.42.5(pid=28956): Launched 08:37:52.151067 run osmo-msc_10.42.42.6: Starting osmo-msc 08:37:52.734383 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28958): Launched 08:37:53.056906 run osmo-msc_10.42.42.6(pid=28959): Launched 08:37:53.235788 run osmo-stp_10.42.42.5(pid=28956): ERR: Terminated: ERROR {rc=1} [trial-2402↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28956)] 08:37:53.373161 run osmo-stp_10.42.42.5(pid=28956): stdout: | (launched: 2022-12-14_08:37:51.969468) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:37:53.509236 run osmo-stp_10.42.42.5(pid=28956): stderr: | 20221214083752158 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214083752158 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214083752159 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214083752159 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214083752159 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214083752160 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214083752160 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:37:53.643688 run osmo-stp_10.42.42.5(pid=28956): stdout: | (launched: 2022-12-14_08:37:51.969468) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:37:53.772189 run osmo-stp_10.42.42.5(pid=28956): stderr: | 20221214083752158 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214083752158 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214083752159 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214083752159 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214083752159 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214083752160 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214083752160 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:37:53.925652 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28956): Process ended prematurely: osmo-stp_10.42.42.5(pid=28956) [trial-2402↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28956)] [trial-2402↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 08:37:53.935164 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 08:37:53.963024 run osmo-hlr_10.42.42.2(pid=28953): ERR: Terminated: ERROR {rc=237} [trial-2402↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28953)] 08:37:54.013632 run osmo-hlr_10.42.42.2(pid=28953): stdout: | (launched: 2022-12-14_08:37:50.964535) 08:37:54.065911 run osmo-hlr_10.42.42.2(pid=28953): stderr: | 20221214083751159 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214083751159 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214083751159 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214083751159 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214083751159 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214083751159 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214083751172 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214083751182 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214083751182 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214083751182 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:37:54.138493 run osmo-msc_10.42.42.6(pid=28959): ERR: Terminated: ERROR {rc=2} [trial-2402↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28959)] 08:37:54.188620 run osmo-msc_10.42.42.6(pid=28959): stdout: | (launched: 2022-12-14_08:37:52.997848) 08:37:54.240529 run osmo-msc_10.42.42.6(pid=28959): stderr: | 20221214083753318 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214083753318 DLGLOBAL DEBUG validating counter group 0x7fb45fe21c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214083753318 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214083753318 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214083753319 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214083753319 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214083753320 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214083753321 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214083753321 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214083753321 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:37:54.293109 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28952): Terminating (SIGTERM) 08:37:54.334870 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28955): Terminating (SIGTERM) 08:37:54.376564 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28958): Terminating (SIGTERM) 08:37:54.419003 --- ParallelTerminationStrategy: PID 28952 died... 08:37:54.439027 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28952): Terminated: ok {rc=0} 08:37:54.485301 --- ParallelTerminationStrategy: PID 28955 died... 08:37:54.504842 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28955): Terminated: ok {rc=0} 08:37:54.551356 --- ParallelTerminationStrategy: PID 28958 died... 08:37:54.571070 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28958): Terminated: ok {rc=0} 08:37:54.657892 bus /sierra_3: Setting Powered False 08:37:55.755732 bus /sierra_3: Setting Powered False 08:37:56.870716 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2402 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 08:37:58.114869 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:37:58.122356 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 08:37:58.143767 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 08:37:58.172049 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 08:37:58.223704 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 08:37:58.244088 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 08:37:58.270505 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 08:37:58.825702 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2402 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 08:37:58.877842 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:37:58.889565 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 08:37:58.945783 tst mo_mt_call.py: using LAC 39713 08:37:59.070569 tst mo_mt_call.py: using RAC 188 08:37:59.195383 tst mo_mt_call.py: using CellId 39713 08:37:59.313658 tst mo_mt_call.py: using BVCI 39714 08:37:59.422884 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:37:59.434247 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:37:59.445233 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:37:59.456124 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:37:59.467474 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:37:59.478690 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 08:37:59.597403 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 08:37:59.712312 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:38:00.180111 run create_hlr_db(pid=28964): Launched 08:38:00.294295 bus /sierra_2: Setting Powered False 08:38:01.354483 run create_hlr_db(pid=28964): Terminated: ok {rc=0} 08:38:01.780535 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28966): Launched 08:38:02.105718 run osmo-hlr_10.42.42.2(pid=28967): Launched 08:38:02.276594 run osmo-stp_10.42.42.5: Starting osmo-stp 08:38:02.814860 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28969): Launched 08:38:03.116485 run osmo-stp_10.42.42.5(pid=28970): Launched 08:38:03.231845 run osmo-msc_10.42.42.6: Starting osmo-msc 08:38:03.776401 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28972): Launched 08:38:04.078064 run osmo-msc_10.42.42.6(pid=28973): Launched 08:38:04.246199 run osmo-stp_10.42.42.5(pid=28970): ERR: Terminated: ERROR {rc=1} [trial-2402↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28970)] 08:38:04.374914 run osmo-stp_10.42.42.5(pid=28970): stdout: | (launched: 2022-12-14_08:38:03.060830) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:38:04.502669 run osmo-stp_10.42.42.5(pid=28970): stderr: | 20221214083803228 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214083803228 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214083803228 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214083803229 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214083803229 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214083803229 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214083803229 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:38:04.628537 run osmo-stp_10.42.42.5(pid=28970): stdout: | (launched: 2022-12-14_08:38:03.060830) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:38:04.748574 run osmo-stp_10.42.42.5(pid=28970): stderr: | 20221214083803228 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214083803228 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214083803228 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214083803229 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214083803229 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214083803229 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214083803229 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:38:04.892064 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28970): Process ended prematurely: osmo-stp_10.42.42.5(pid=28970) [trial-2402↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28970)] [trial-2402↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 08:38:04.901114 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 08:38:04.927448 run osmo-hlr_10.42.42.2(pid=28967): ERR: Terminated: ERROR {rc=237} [trial-2402↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28967)] 08:38:04.975904 run osmo-hlr_10.42.42.2(pid=28967): stdout: | (launched: 2022-12-14_08:38:02.042064) 08:38:05.025468 run osmo-hlr_10.42.42.2(pid=28967): stderr: | 20221214083802292 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214083802292 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214083802292 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214083802292 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214083802292 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214083802292 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214083802305 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214083802314 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214083802314 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214083802314 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:38:05.095062 run osmo-msc_10.42.42.6(pid=28973): ERR: Terminated: ERROR {rc=2} [trial-2402↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28973)] 08:38:05.142558 run osmo-msc_10.42.42.6(pid=28973): stdout: | (launched: 2022-12-14_08:38:04.022654) 08:38:05.191830 run osmo-msc_10.42.42.6(pid=28973): stderr: | 20221214083804290 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214083804291 DLGLOBAL DEBUG validating counter group 0x7ff00fa17c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214083804291 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214083804291 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214083804291 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214083804291 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214083804293 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214083804294 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214083804294 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214083804294 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:38:05.241733 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28966): Terminating (SIGTERM) 08:38:05.281432 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28969): Terminating (SIGTERM) 08:38:05.321098 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28972): Terminating (SIGTERM) 08:38:05.360883 --- ParallelTerminationStrategy: PID 28966 died... 08:38:05.380318 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28966): Terminated: ok {rc=0} 08:38:05.424437 --- ParallelTerminationStrategy: PID 28969 died... 08:38:05.443475 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28969): Terminated: ok {rc=0} 08:38:05.487708 --- ParallelTerminationStrategy: PID 28972 died... 08:38:05.506541 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28972): Terminated: ok {rc=0} 08:38:05.592226 bus /sierra_3: Setting Powered False 08:38:06.691600 bus /sierra_3: Setting Powered False 08:38:07.808026 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2402 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 08:38:08.959704 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:38:08.972004 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 08:38:09.029651 tst mo_mt_call_osmux.py: using LAC 39714 08:38:09.155654 tst mo_mt_call_osmux.py: using RAC 189 08:38:09.284063 tst mo_mt_call_osmux.py: using CellId 39714 08:38:09.411564 tst mo_mt_call_osmux.py: using BVCI 39715 08:38:09.523266 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:38:09.534541 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:38:09.545612 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:38:09.556597 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:38:09.567991 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:38:09.579347 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 08:38:09.698745 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 08:38:09.815681 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:38:10.284605 run create_hlr_db(pid=28975): Launched 08:38:10.399837 bus /sierra_2: Setting Powered False 08:38:11.460711 run create_hlr_db(pid=28975): Terminated: ok {rc=0} 08:38:11.879643 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28977): Launched 08:38:12.182296 run osmo-hlr_10.42.42.2(pid=28978): Launched 08:38:12.298084 run osmo-stp_10.42.42.5: Starting osmo-stp 08:38:12.820616 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28980): Launched 08:38:13.122423 run osmo-stp_10.42.42.5(pid=28981): Launched 08:38:13.237538 run osmo-msc_10.42.42.6: Starting osmo-msc 08:38:13.781170 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28983): Launched 08:38:14.083209 run osmo-msc_10.42.42.6(pid=28984): Launched 08:38:14.251851 run osmo-stp_10.42.42.5(pid=28981): ERR: Terminated: ERROR {rc=1} [trial-2402↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28981)] 08:38:14.379577 run osmo-stp_10.42.42.5(pid=28981): stdout: | (launched: 2022-12-14_08:38:13.066579) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:38:14.507956 run osmo-stp_10.42.42.5(pid=28981): stderr: | 20221214083813234 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214083813234 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214083813234 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214083813234 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214083813236 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214083813236 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214083813236 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:38:14.633586 run osmo-stp_10.42.42.5(pid=28981): stdout: | (launched: 2022-12-14_08:38:13.066579) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:38:14.753387 run osmo-stp_10.42.42.5(pid=28981): stderr: | 20221214083813234 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214083813234 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214083813234 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214083813234 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214083813236 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214083813236 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214083813236 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:38:14.896506 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28981): Process ended prematurely: osmo-stp_10.42.42.5(pid=28981) [trial-2402↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28981)] [trial-2402↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 08:38:14.905294 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 08:38:14.931809 run osmo-hlr_10.42.42.2(pid=28978): ERR: Terminated: ERROR {rc=237} [trial-2402↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28978)] 08:38:14.979972 run osmo-hlr_10.42.42.2(pid=28978): stdout: | (launched: 2022-12-14_08:38:12.126497) 08:38:15.029447 run osmo-hlr_10.42.42.2(pid=28978): stderr: | 20221214083812298 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214083812298 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214083812298 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214083812298 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214083812298 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214083812298 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214083812310 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214083812318 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214083812318 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214083812318 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:38:15.098957 run osmo-msc_10.42.42.6(pid=28984): ERR: Terminated: ERROR {rc=2} [trial-2402↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28984)] 08:38:15.146364 run osmo-msc_10.42.42.6(pid=28984): stdout: | (launched: 2022-12-14_08:38:14.027819) 08:38:15.195813 run osmo-msc_10.42.42.6(pid=28984): stderr: | 20221214083814298 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214083814298 DLGLOBAL DEBUG validating counter group 0x7f097e97cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214083814298 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214083814298 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214083814298 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214083814298 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214083814300 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214083814301 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214083814301 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214083814301 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:38:15.245982 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28977): Terminating (SIGTERM) 08:38:15.285969 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28980): Terminating (SIGTERM) 08:38:15.326552 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28983): Terminating (SIGTERM) 08:38:15.366752 --- ParallelTerminationStrategy: PID 28977 died... 08:38:15.386362 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28977): Terminated: ok {rc=0} 08:38:15.430602 --- ParallelTerminationStrategy: PID 28980 died... 08:38:15.449667 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28980): Terminated: ok {rc=0} 08:38:15.493470 --- ParallelTerminationStrategy: PID 28983 died... 08:38:15.512405 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28983): Terminated: ok {rc=0} 08:38:15.597307 bus /sierra_3: Setting Powered False 08:38:16.692482 bus /sierra_3: Setting Powered False 08:38:17.807105 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2402 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 voice:oc2g+mod-bts0-dynts-osmo --------------------------------------------------------------------- 08:38:19.050723 tst voice:oc2g+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:38:19.057738 tst voice:oc2g+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 08:38:19.078018 tst voice:oc2g+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 08:38:19.105107 tst voice:oc2g+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 08:38:19.156157 tst voice:oc2g+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 08:38:19.176812 tst voice:oc2g+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 08:38:19.204091 tst voice:oc2g+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 08:38:19.751075 tst voice:oc2g+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2402 voice:oc2g+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 08:38:19.800555 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 08:38:19.811525 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 08:38:19.868438 tst mo_mt_call.py: using LAC 39715 08:38:19.987857 tst mo_mt_call.py: using RAC 190 08:38:20.109255 tst mo_mt_call.py: using CellId 39715 08:38:20.230420 tst mo_mt_call.py: using BVCI 39716 08:38:20.341921 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 08:38:20.352928 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 08:38:20.363562 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 08:38:20.374289 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 08:38:20.385418 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 08:38:20.396401 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 08:38:20.515506 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 08:38:20.632632 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:38:21.132879 run create_hlr_db(pid=28989): Launched 08:38:21.264164 bus /sierra_2: Setting Powered False 08:38:22.328691 run create_hlr_db(pid=28989): Terminated: ok {rc=0} 08:38:22.759027 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28991): Launched 08:38:23.059784 run osmo-hlr_10.42.42.2(pid=28992): Launched 08:38:23.173979 run osmo-stp_10.42.42.5: Starting osmo-stp 08:38:23.701483 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28994): Launched 08:38:24.002748 run osmo-stp_10.42.42.5(pid=28995): Launched 08:38:24.117885 run osmo-msc_10.42.42.6: Starting osmo-msc 08:38:24.662476 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28997): Launched 08:38:24.963510 run osmo-msc_10.42.42.6(pid=28998): Launched 08:38:25.131299 run osmo-stp_10.42.42.5(pid=28995): ERR: Terminated: ERROR {rc=1} [trial-2402↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28995)] 08:38:25.257659 run osmo-stp_10.42.42.5(pid=28995): stdout: | (launched: 2022-12-14_08:38:23.947327) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:38:25.384655 run osmo-stp_10.42.42.5(pid=28995): stderr: | 20221214083824115 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214083824116 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214083824116 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214083824117 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214083824117 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214083824117 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214083824117 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:38:25.510714 run osmo-stp_10.42.42.5(pid=28995): stdout: | (launched: 2022-12-14_08:38:23.947327) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:38:25.630770 run osmo-stp_10.42.42.5(pid=28995): stderr: | 20221214083824115 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214083824116 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214083824116 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214083824117 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214083824117 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214083824117 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214083824117 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:38:25.774393 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28995): Process ended prematurely: osmo-stp_10.42.42.5(pid=28995) [trial-2402↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28995)] [trial-2402↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 08:38:25.783279 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 08:38:25.809967 run osmo-hlr_10.42.42.2(pid=28992): ERR: Terminated: ERROR {rc=237} [trial-2402↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28992)] 08:38:25.858790 run osmo-hlr_10.42.42.2(pid=28992): stdout: | (launched: 2022-12-14_08:38:23.004825) 08:38:25.908574 run osmo-hlr_10.42.42.2(pid=28992): stderr: | 20221214083823175 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214083823175 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214083823175 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214083823175 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214083823175 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214083823175 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214083823187 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/voice:oc2g+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214083823195 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214083823195 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214083823195 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:38:25.978909 run osmo-msc_10.42.42.6(pid=28998): ERR: Terminated: ERROR {rc=2} [trial-2402↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28998)] 08:38:26.026902 run osmo-msc_10.42.42.6(pid=28998): stdout: | (launched: 2022-12-14_08:38:24.908042) 08:38:26.076701 run osmo-msc_10.42.42.6(pid=28998): stderr: | 20221214083825177 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214083825177 DLGLOBAL DEBUG validating counter group 0x7fd1a7239c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214083825177 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214083825178 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214083825178 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214083825178 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214083825179 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214083825180 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214083825180 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214083825180 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:38:26.126701 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28991): Terminating (SIGTERM) 08:38:26.166579 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28994): Terminating (SIGTERM) 08:38:26.206442 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28997): Terminating (SIGTERM) 08:38:26.246616 --- ParallelTerminationStrategy: PID 28991 died... 08:38:26.266455 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28991): Terminated: ok {rc=0} 08:38:26.311038 --- ParallelTerminationStrategy: PID 28994 died... 08:38:26.330365 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28994): Terminated: ok {rc=0} 08:38:26.374601 --- ParallelTerminationStrategy: PID 28997 died... 08:38:26.393796 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28997): Terminated: ok {rc=0} 08:38:26.477816 bus /sierra_3: Setting Powered False 08:38:27.576847 bus /sierra_3: Setting Powered False 08:38:28.692514 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2402 voice:oc2g+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 08:38:29.840202 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 08:38:29.852094 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 08:38:29.913723 tst mo_mt_call_osmux.py: using LAC 39716 08:38:30.040632 tst mo_mt_call_osmux.py: using RAC 191 08:38:30.166219 tst mo_mt_call_osmux.py: using CellId 39716 08:38:30.291608 tst mo_mt_call_osmux.py: using BVCI 39717 08:38:30.409747 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 08:38:30.421304 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 08:38:30.432344 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 08:38:30.443472 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 08:38:30.454735 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 08:38:30.465966 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 08:38:30.581266 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 08:38:30.699380 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:38:31.228892 run create_hlr_db(pid=29000): Launched 08:38:31.392535 bus /sierra_2: Setting Powered False 08:38:32.457191 run create_hlr_db(pid=29000): Terminated: ok {rc=0} 08:38:32.887107 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29002): Launched 08:38:33.189541 run osmo-hlr_10.42.42.2(pid=29003): Launched 08:38:33.305151 run osmo-stp_10.42.42.5: Starting osmo-stp 08:38:33.837433 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29005): Launched 08:38:34.138347 run osmo-stp_10.42.42.5(pid=29006): Launched 08:38:34.253154 run osmo-msc_10.42.42.6: Starting osmo-msc 08:38:34.802836 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29008): Launched 08:38:35.104123 run osmo-msc_10.42.42.6(pid=29009): Launched 08:38:35.273739 run osmo-stp_10.42.42.5(pid=29006): ERR: Terminated: ERROR {rc=1} [trial-2402↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29006)] 08:38:35.401349 run osmo-stp_10.42.42.5(pid=29006): stdout: | (launched: 2022-12-14_08:38:34.082935) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:38:35.528863 run osmo-stp_10.42.42.5(pid=29006): stderr: | 20221214083834251 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214083834251 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214083834251 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214083834251 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214083834252 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214083834252 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214083834252 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:38:35.654187 run osmo-stp_10.42.42.5(pid=29006): stdout: | (launched: 2022-12-14_08:38:34.082935) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:38:35.773857 run osmo-stp_10.42.42.5(pid=29006): stderr: | 20221214083834251 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214083834251 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214083834251 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214083834251 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214083834252 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214083834252 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214083834252 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:38:35.916600 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29006): Process ended prematurely: osmo-stp_10.42.42.5(pid=29006) [trial-2402↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29006)] [trial-2402↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 08:38:35.925548 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 08:38:35.951850 run osmo-hlr_10.42.42.2(pid=29003): ERR: Terminated: ERROR {rc=237} [trial-2402↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29003)] 08:38:35.999765 run osmo-hlr_10.42.42.2(pid=29003): stdout: | (launched: 2022-12-14_08:38:33.134004) 08:38:36.049075 run osmo-hlr_10.42.42.2(pid=29003): stderr: | 20221214083833307 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214083833307 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214083833308 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214083833308 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214083833308 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214083833308 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214083833319 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/voice:oc2g+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214083833328 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214083833328 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214083833328 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:38:36.118095 run osmo-msc_10.42.42.6(pid=29009): ERR: Terminated: ERROR {rc=2} [trial-2402↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29009)] 08:38:36.165072 run osmo-msc_10.42.42.6(pid=29009): stdout: | (launched: 2022-12-14_08:38:35.048223) 08:38:36.214106 run osmo-msc_10.42.42.6(pid=29009): stderr: | 20221214083835319 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214083835319 DLGLOBAL DEBUG validating counter group 0x7f21e188cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214083835319 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214083835319 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214083835319 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214083835320 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214083835322 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214083835322 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214083835322 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214083835322 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:38:36.263506 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29002): Terminating (SIGTERM) 08:38:36.302876 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29005): Terminating (SIGTERM) 08:38:36.342228 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29008): Terminating (SIGTERM) 08:38:36.381888 --- ParallelTerminationStrategy: PID 29002 died... 08:38:36.401050 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29002): Terminated: ok {rc=0} 08:38:36.444456 --- ParallelTerminationStrategy: PID 29005 died... 08:38:36.463221 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29005): Terminated: ok {rc=0} 08:38:36.506754 --- ParallelTerminationStrategy: PID 29008 died... 08:38:36.525434 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29008): Terminated: ok {rc=0} 08:38:36.610830 bus /sierra_3: Setting Powered False 08:38:37.708761 bus /sierra_3: Setting Powered False 08:38:38.819892 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2402 voice:oc2g+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 emergency:oc2g --------------------------------------------------------------------- 08:38:40.064756 tst emergency:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:38:40.071049 tst emergency:oc2g: Verifying 1 x bts (candidates: 11) 08:38:40.092922 tst emergency:oc2g: Verifying 6 x ip_address (candidates: 9) 08:38:40.121352 tst emergency:oc2g: Verifying 4 x modem (candidates: 12) 08:38:40.206861 tst emergency:oc2g: Reserving 1 x bts (candidates: 11) 08:38:40.228094 tst emergency:oc2g: Reserving 6 x ip_address (candidates: 9) 08:38:40.255442 tst emergency:oc2g: Reserving 4 x modem (candidates: 12) 08:38:40.836381 tst emergency:oc2g: RESERVED RESOURCES for emergency: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2402 emergency:oc2g emergency_mo_mt_call.py ---------------------------------------------- 08:38:40.842773 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 08:38:40.854480 tst emergency:oc2g: Using 1 x bts (candidates: 1) 08:38:40.890892 tst emergency_mo_mt_call.py: using LAC 39717 08:38:41.007348 tst emergency_mo_mt_call.py: using RAC 192 08:38:41.122533 tst emergency_mo_mt_call.py: using CellId 39717 08:38:41.238620 tst emergency_mo_mt_call.py: using BVCI 39718 08:38:41.345892 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 08:38:41.356485 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 08:38:41.366949 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 08:38:41.377314 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 08:38:41.387950 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 08:38:41.398664 tst emergency:oc2g: Using 1 x modem (candidates: 4) 08:38:41.518253 tst emergency:oc2g: Using 1 x modem (candidates: 4) 08:38:41.633592 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:38:42.092334 run create_hlr_db(pid=29014): Launched 08:38:42.224591 bus /sierra_2: Setting Powered False 08:38:43.287835 run create_hlr_db(pid=29014): Terminated: ok {rc=0} 08:38:43.730083 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29016): Launched 08:38:44.046467 run osmo-hlr_10.42.42.2(pid=29017): Launched 08:38:44.165851 run osmo-stp_10.42.42.5: Starting osmo-stp 08:38:44.710957 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29019): Launched 08:38:45.027839 run osmo-stp_10.42.42.5(pid=29020): Launched 08:38:45.158394 tst emergency_mo_mt_call.py: using MSISDN 8597 08:38:45.321463 run osmo-msc_10.42.42.6: Starting osmo-msc 08:38:45.913221 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29022): Launched 08:38:46.233135 run osmo-msc_10.42.42.6(pid=29023): Launched 08:38:46.558456 run osmo-stp_10.42.42.5(pid=29020): ERR: Terminated: ERROR {rc=1} [trial-2402↪emergency:oc2g↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29020)] 08:38:46.876874 run osmo-stp_10.42.42.5(pid=29020): stdout: | (launched: 2022-12-14_08:38:44.969935) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:38:47.117853 run osmo-stp_10.42.42.5(pid=29020): stderr: | 20221214083845158 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214083845158 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214083845159 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214083845159 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214083845159 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214083845160 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214083845160 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:38:47.282249 run osmo-stp_10.42.42.5(pid=29020): stdout: | (launched: 2022-12-14_08:38:44.969935) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:38:47.403828 run osmo-stp_10.42.42.5(pid=29020): stderr: | 20221214083845158 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214083845158 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214083845159 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214083845159 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214083845159 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214083845160 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214083845160 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:38:47.546975 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=29020): Process ended prematurely: osmo-stp_10.42.42.5(pid=29020) [trial-2402↪emergency:oc2g↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29020)] [trial-2402↪emergency:oc2g↪emergency_mo_mt_call.py:19] 08:38:47.555346 tst emergency_mo_mt_call.py:19: Test FAILED (6.7 sec) 08:38:47.581388 run osmo-hlr_10.42.42.2(pid=29017): ERR: Terminated: ERROR {rc=237} [trial-2402↪emergency:oc2g↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29017)] 08:38:47.630463 run osmo-hlr_10.42.42.2(pid=29017): stdout: | (launched: 2022-12-14_08:38:43.988650) 08:38:47.680302 run osmo-hlr_10.42.42.2(pid=29017): stderr: | 20221214083844179 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214083844179 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214083844179 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214083844179 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214083844179 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214083844179 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214083844192 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/emergency:oc2g/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214083844200 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214083844200 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214083844200 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:38:47.750323 run osmo-msc_10.42.42.6(pid=29023): ERR: Terminated: ERROR {rc=2} [trial-2402↪emergency:oc2g↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29023)] 08:38:47.797997 run osmo-msc_10.42.42.6(pid=29023): stdout: | (launched: 2022-12-14_08:38:46.169363) 08:38:47.848025 run osmo-msc_10.42.42.6(pid=29023): stderr: | 20221214083846847 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214083846849 DLGLOBAL DEBUG validating counter group 0x7fde02038c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214083846850 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214083846850 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214083846851 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214083846854 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214083846863 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214083846865 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214083846865 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214083846865 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:38:47.898730 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29016): Terminating (SIGTERM) 08:38:47.938944 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29019): Terminating (SIGTERM) 08:38:47.979535 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29022): Terminating (SIGTERM) 08:38:48.020267 --- ParallelTerminationStrategy: PID 29016 died... 08:38:48.040232 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29016): Terminated: ok {rc=0} 08:38:48.084932 --- ParallelTerminationStrategy: PID 29019 died... 08:38:48.103671 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29019): Terminated: ok {rc=0} 08:38:48.148827 --- ParallelTerminationStrategy: PID 29022 died... 08:38:48.168654 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29022): Terminated: ok {rc=0} 08:38:48.255891 bus /sierra_3: Setting Powered False 08:38:49.355433 bus /sierra_3: Setting Powered False 08:38:50.468212 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2402 emergency:oc2g emergency_preemptive_call.py ---------------------------------------------- 08:38:51.554867 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 08:38:51.567051 tst emergency:oc2g: Using 1 x bts (candidates: 1) 08:38:51.606267 tst emergency_preemptive_call.py: using LAC 39718 08:38:51.732630 tst emergency_preemptive_call.py: using RAC 193 08:38:51.858444 tst emergency_preemptive_call.py: using CellId 39718 08:38:51.985326 tst emergency_preemptive_call.py: using BVCI 39719 08:38:52.103443 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 08:38:52.114625 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 08:38:52.125656 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 08:38:52.136662 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 08:38:52.147866 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 08:38:52.159037 tst emergency:oc2g: Using 1 x modem (candidates: 4) 08:38:52.278254 tst emergency:oc2g: Using 1 x modem (candidates: 4) 08:38:52.395268 tst emergency:oc2g: Using 1 x modem (candidates: 4) 08:38:52.515282 tst emergency:oc2g: Using 1 x modem (candidates: 4) 08:38:52.631036 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:38:53.097085 run create_hlr_db(pid=29025): Launched 08:38:53.212502 bus /sierra_2: Setting Powered False 08:38:54.271635 run create_hlr_db(pid=29025): Terminated: ok {rc=0} 08:38:54.688098 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29027): Launched 08:38:54.987770 run osmo-hlr_10.42.42.2(pid=29028): Launched 08:38:55.102467 run osmo-stp_10.42.42.5: Starting osmo-stp 08:38:55.630965 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29030): Launched 08:38:55.930126 run osmo-stp_10.42.42.5(pid=29031): Launched 08:38:56.053098 tst emergency_preemptive_call.py: using MSISDN 8598 08:38:56.205461 run osmo-msc_10.42.42.6: Starting osmo-msc 08:38:56.742381 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29033): Launched 08:38:57.042359 run osmo-msc_10.42.42.6(pid=29034): Launched 08:38:57.208597 run osmo-stp_10.42.42.5(pid=29031): ERR: Terminated: ERROR {rc=1} [trial-2402↪emergency:oc2g↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29031)] 08:38:57.337164 run osmo-stp_10.42.42.5(pid=29031): stdout: | (launched: 2022-12-14_08:38:55.874209) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:38:57.463892 run osmo-stp_10.42.42.5(pid=29031): stderr: | 20221214083856042 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214083856042 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214083856042 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214083856043 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214083856043 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214083856043 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214083856043 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:38:57.588915 run osmo-stp_10.42.42.5(pid=29031): stdout: | (launched: 2022-12-14_08:38:55.874209) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:38:57.707201 run osmo-stp_10.42.42.5(pid=29031): stderr: | 20221214083856042 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214083856042 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214083856042 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214083856043 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214083856043 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214083856043 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214083856043 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:38:57.848662 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=29031): Process ended prematurely: osmo-stp_10.42.42.5(pid=29031) [trial-2402↪emergency:oc2g↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29031)] [trial-2402↪emergency:oc2g↪emergency_preemptive_call.py:32] 08:38:57.857203 tst emergency_preemptive_call.py:32: Test FAILED (6.3 sec) 08:38:57.883435 run osmo-hlr_10.42.42.2(pid=29028): ERR: Terminated: ERROR {rc=237} [trial-2402↪emergency:oc2g↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29028)] 08:38:57.931477 run osmo-hlr_10.42.42.2(pid=29028): stdout: | (launched: 2022-12-14_08:38:54.932503) 08:38:57.981250 run osmo-hlr_10.42.42.2(pid=29028): stderr: | 20221214083855103 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214083855103 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214083855103 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214083855103 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214083855103 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214083855103 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214083855115 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/emergency:oc2g/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214083855123 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214083855124 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214083855124 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:38:58.050662 run osmo-msc_10.42.42.6(pid=29034): ERR: Terminated: ERROR {rc=2} [trial-2402↪emergency:oc2g↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29034)] 08:38:58.098015 run osmo-msc_10.42.42.6(pid=29034): stdout: | (launched: 2022-12-14_08:38:56.986993) 08:38:58.147176 run osmo-msc_10.42.42.6(pid=29034): stderr: | 20221214083857252 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214083857252 DLGLOBAL DEBUG validating counter group 0x7f97b0b1dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214083857252 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214083857252 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214083857252 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214083857252 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214083857254 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214083857254 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214083857255 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214083857255 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:38:58.196733 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29027): Terminating (SIGTERM) 08:38:58.236212 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29030): Terminating (SIGTERM) 08:38:58.275648 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29033): Terminating (SIGTERM) 08:38:58.315531 --- ParallelTerminationStrategy: PID 29027 died... 08:38:58.335188 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29027): Terminated: ok {rc=0} 08:38:58.379331 --- ParallelTerminationStrategy: PID 29030 died... 08:38:58.398215 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29030): Terminated: ok {rc=0} 08:38:58.442435 --- ParallelTerminationStrategy: PID 29033 died... 08:38:58.461728 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29033): Terminated: ok {rc=0} 08:38:58.547904 bus /sierra_9: Setting Powered False 08:38:59.648911 bus /sierra_9: Setting Powered False 08:39:00.764738 bus /sierra_8: Setting Powered False 08:39:01.888307 bus /sierra_8: Setting Powered False 08:39:03.050289 bus /sierra_3: Setting Powered False 08:39:04.171711 bus /sierra_3: Setting Powered False 08:39:05.291530 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2402 emergency:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 gprs:oc2g --------------------------------------------------------------------- 08:39:06.556263 tst gprs:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:39:06.561551 tst gprs:oc2g: Verifying 1 x bts (candidates: 11) 08:39:06.583702 tst gprs:oc2g: Verifying 9 x ip_address (candidates: 9) 08:39:06.628769 tst gprs:oc2g: Verifying 4 x modem (candidates: 12) 08:39:06.717565 tst gprs:oc2g: Reserving 1 x bts (candidates: 11) 08:39:06.738963 tst gprs:oc2g: Reserving 9 x ip_address (candidates: 9) 08:39:06.779258 tst gprs:oc2g: Reserving 4 x modem (candidates: 12) 08:39:07.367492 tst gprs:oc2g: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2402 gprs:oc2g cs_paging_gprs_active.py ---------------------------------------------- 08:39:07.427506 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 08:39:07.439945 tst gprs:oc2g: Using 1 x bts (candidates: 1) 08:39:07.473747 tst cs_paging_gprs_active.py: using LAC 39719 08:39:07.602818 tst cs_paging_gprs_active.py: using RAC 194 08:39:07.727724 tst cs_paging_gprs_active.py: using CellId 39719 08:39:07.854108 tst cs_paging_gprs_active.py: using BVCI 39720 08:39:07.971657 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 08:39:07.983462 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 08:39:07.995045 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 08:39:08.006376 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 08:39:08.018754 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 08:39:08.031218 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 08:39:08.044696 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 08:39:08.057180 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 08:39:08.069685 tst gprs:oc2g: Using 1 x modem (candidates: 4) 08:39:08.195702 tst gprs:oc2g: Using 1 x modem (candidates: 4) 08:39:08.318065 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 08:39:08.530293 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:39:08.845837 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29312): Launched 08:39:09.131351 run iperf3-srv_10.42.42.10(pid=29313): Launched 08:39:09.268848 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 08:39:09.493103 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:39:09.825753 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29314): Launched 08:39:10.124774 run iperf3-srv_10.42.42.10(pid=29315): Launched 08:39:10.263787 tst cs_paging_gprs_active.py:38: start network... 08:39:10.488606 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:39:11.003913 run create_hlr_db(pid=29316): Launched 08:39:11.173201 bus /sierra_2: Setting Powered False 08:39:12.239645 run create_hlr_db(pid=29316): Terminated: ok {rc=0} 08:39:12.706803 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29318): Launched 08:39:13.052025 run osmo-hlr_10.42.42.2(pid=29319): Launched 08:39:13.306845 run osmo-stp_10.42.42.5: Starting osmo-stp 08:39:13.977584 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29321): Launched 08:39:14.322380 run osmo-stp_10.42.42.5(pid=29322): Launched 08:39:14.571465 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:39:15.230724 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29324): Launched 08:39:15.370704 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:39:15.656835 run patchelf(pid=29325): Launched 08:39:15.864118 run osmo-stp_10.42.42.5(pid=29322): ERR: Terminated: ERROR {rc=1} [trial-2402↪gprs:oc2g↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29322)] 08:39:16.016085 run osmo-stp_10.42.42.5(pid=29322): stdout: | (launched: 2022-12-14_08:39:14.262200) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:39:16.176340 run osmo-stp_10.42.42.5(pid=29322): stderr: | 20221214083914553 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214083914554 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214083914554 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214083914554 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214083914555 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214083914555 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214083914555 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:39:16.346470 run osmo-stp_10.42.42.5(pid=29322): stdout: | (launched: 2022-12-14_08:39:14.262200) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:39:16.534388 run osmo-stp_10.42.42.5(pid=29322): stderr: | 20221214083914553 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214083914554 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214083914554 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214083914554 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214083914555 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214083914555 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214083914555 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:39:16.687822 run patchelf(pid=29325): Terminating (SIGINT) 08:39:16.863877 run patchelf(pid=29325): Terminated: ok {rc=0} 08:39:16.991151 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=29322): Process ended prematurely: osmo-stp_10.42.42.5(pid=29322) [trial-2402↪gprs:oc2g↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29322)] [trial-2402↪gprs:oc2g↪cs_paging_gprs_active.py:38] 08:39:17.001080 tst cs_paging_gprs_active.py:38: Test FAILED (9.6 sec) 08:39:17.029225 run osmo-hlr_10.42.42.2(pid=29319): ERR: Terminated: ERROR {rc=237} [trial-2402↪gprs:oc2g↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29319)] 08:39:17.081102 run osmo-hlr_10.42.42.2(pid=29319): stdout: | (launched: 2022-12-14_08:39:12.990726) 08:39:17.134082 run osmo-hlr_10.42.42.2(pid=29319): stderr: | 20221214083913300 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214083913300 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214083913300 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214083913300 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214083913300 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214083913300 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214083913318 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/gprs:oc2g/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214083913331 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214083913331 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214083913331 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:39:17.185824 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29312): Terminating (SIGTERM) 08:39:17.228462 run iperf3-srv_10.42.42.10(pid=29313): Terminating (SIGTERM) 08:39:17.272047 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29314): Terminating (SIGTERM) 08:39:17.315161 run iperf3-srv_10.42.42.10(pid=29315): Terminating (SIGTERM) 08:39:17.357905 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29318): Terminating (SIGTERM) 08:39:17.400721 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29321): Terminating (SIGTERM) 08:39:17.444856 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29324): Terminating (SIGTERM) 08:39:17.488239 --- ParallelTerminationStrategy: PID 29312 died... 08:39:17.509591 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29312): Terminated: ok {rc=0} 08:39:17.556768 --- ParallelTerminationStrategy: PID 29313 died... 08:39:17.577818 run iperf3-srv_10.42.42.10(pid=29313): Terminated {rc=256} 08:39:17.624424 --- ParallelTerminationStrategy: PID 29314 died... 08:39:17.645530 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29314): Terminated: ok {rc=0} 08:39:17.691955 --- ParallelTerminationStrategy: PID 29315 died... 08:39:17.712869 run iperf3-srv_10.42.42.10(pid=29315): Terminated {rc=256} 08:39:17.759273 --- ParallelTerminationStrategy: PID 29318 died... 08:39:17.780301 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29318): Terminated: ok {rc=0} 08:39:17.826994 --- ParallelTerminationStrategy: PID 29321 died... 08:39:17.848108 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29321): Terminated: ok {rc=0} 08:39:17.895068 --- ParallelTerminationStrategy: PID 29324 died... 08:39:17.916347 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29324): Terminated: ok {rc=0} 08:39:18.006052 bus /gobi_0: Setting Powered False 08:39:19.111359 bus /gobi_0: Setting Powered False 08:39:20.230999 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2402 gprs:oc2g iperf3.py ---------------------------------------------- 08:39:21.383390 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 08:39:21.396031 tst gprs:oc2g: Using 1 x bts (candidates: 1) 08:39:21.432797 tst iperf3.py: using LAC 39720 08:39:21.559611 tst iperf3.py: using RAC 195 08:39:21.687803 tst iperf3.py: using CellId 39720 08:39:21.811602 tst iperf3.py: using BVCI 39721 08:39:21.930029 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 08:39:21.941657 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 08:39:21.953669 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 08:39:21.965356 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 08:39:21.978051 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 08:39:21.990754 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 08:39:22.003769 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 08:39:22.016331 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 08:39:22.029410 tst gprs:oc2g: Using 1 x modem (candidates: 4) 08:39:22.148800 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 08:39:22.361759 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:39:22.680035 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29326): Launched 08:39:22.971082 run iperf3-srv_10.42.42.10(pid=29327): Launched 08:39:23.105536 tst iperf3.py:8: start network... 08:39:23.316787 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:39:23.811555 run create_hlr_db(pid=29328): Launched 08:39:23.974628 bus /gobi_6: Setting Powered False 08:39:25.037297 run create_hlr_db(pid=29328): Terminated: ok {rc=0} 08:39:25.483394 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29332): Launched 08:39:25.791158 run osmo-hlr_10.42.42.2(pid=29333): Launched 08:39:25.910006 run osmo-stp_10.42.42.5: Starting osmo-stp 08:39:26.453468 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29335): Launched 08:39:26.762458 run osmo-stp_10.42.42.5(pid=29336): Launched 08:39:26.881562 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:39:27.410644 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29338): Launched 08:39:27.527289 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:39:27.785544 run patchelf(pid=29339): Launched 08:39:27.955695 run osmo-stp_10.42.42.5(pid=29336): ERR: Terminated: ERROR {rc=1} [trial-2402↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29336)] 08:39:28.085229 run osmo-stp_10.42.42.5(pid=29336): stdout: | (launched: 2022-12-14_08:39:26.702820) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:39:28.215984 run osmo-stp_10.42.42.5(pid=29336): stderr: | 20221214083926876 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214083926876 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214083926877 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214083926877 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214083926878 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214083926878 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214083926878 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:39:28.347174 run osmo-stp_10.42.42.5(pid=29336): stdout: | (launched: 2022-12-14_08:39:26.702820) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:39:28.472343 run osmo-stp_10.42.42.5(pid=29336): stderr: | 20221214083926876 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214083926876 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214083926877 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214083926877 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214083926878 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214083926878 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214083926878 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:39:28.620682 run patchelf(pid=29339): Terminating (SIGINT) 08:39:28.791244 run patchelf(pid=29339): Terminated: ok {rc=0} 08:39:28.914316 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29336): Process ended prematurely: osmo-stp_10.42.42.5(pid=29336) [trial-2402↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29336)] [trial-2402↪gprs:oc2g↪iperf3.py:8] 08:39:28.923838 tst iperf3.py:8: Test FAILED (7.6 sec) 08:39:28.951035 run osmo-hlr_10.42.42.2(pid=29333): ERR: Terminated: ERROR {rc=237} [trial-2402↪gprs:oc2g↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29333)] 08:39:28.999127 run osmo-hlr_10.42.42.2(pid=29333): stdout: | (launched: 2022-12-14_08:39:25.734581) 08:39:29.049145 run osmo-hlr_10.42.42.2(pid=29333): stderr: | 20221214083925910 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214083925910 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214083925910 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214083925910 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214083925910 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214083925910 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214083925927 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/gprs:oc2g/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214083925937 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214083925937 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214083925937 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:39:29.099005 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29326): Terminating (SIGTERM) 08:39:29.139076 run iperf3-srv_10.42.42.10(pid=29327): Terminating (SIGTERM) 08:39:29.178941 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29332): Terminating (SIGTERM) 08:39:29.219120 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29335): Terminating (SIGTERM) 08:39:29.259219 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29338): Terminating (SIGTERM) 08:39:29.299391 --- ParallelTerminationStrategy: PID 29326 died... 08:39:29.318996 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29326): Terminated: ok {rc=0} 08:39:29.363481 --- ParallelTerminationStrategy: PID 29327 died... 08:39:29.382585 run iperf3-srv_10.42.42.10(pid=29327): Terminated {rc=256} 08:39:29.426768 --- ParallelTerminationStrategy: PID 29332 died... 08:39:29.446555 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29332): Terminated: ok {rc=0} 08:39:29.490681 --- ParallelTerminationStrategy: PID 29335 died... 08:39:29.509825 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29335): Terminated: ok {rc=0} 08:39:29.553728 --- ParallelTerminationStrategy: PID 29338 died... 08:39:29.572669 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29338): Terminated: ok {rc=0} 08:39:29.655328 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2402 gprs:oc2g iperf3m4.py ---------------------------------------------- 08:39:30.803245 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 08:39:30.815157 tst gprs:oc2g: Using 1 x bts (candidates: 1) 08:39:30.855798 tst iperf3m4.py: using LAC 39721 08:39:31.011068 tst iperf3m4.py: using RAC 196 08:39:31.172064 tst iperf3m4.py: using CellId 39721 08:39:31.299964 tst iperf3m4.py: using BVCI 39722 08:39:31.422125 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 08:39:31.434182 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 08:39:31.445754 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 08:39:31.458397 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 08:39:31.470130 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 08:39:31.481826 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 08:39:31.493599 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 08:39:31.505577 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 08:39:31.517422 tst gprs:oc2g: Using 1 x modem (candidates: 4) 08:39:31.659696 tst gprs:oc2g: Using 1 x modem (candidates: 4) 08:39:31.793785 tst gprs:oc2g: Using 1 x modem (candidates: 4) 08:39:31.915154 tst gprs:oc2g: Using 1 x modem (candidates: 4) 08:39:32.040520 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 08:39:32.303807 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:39:32.615955 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29340): Launched 08:39:32.885271 run iperf3-srv_10.42.42.10(pid=29341): Launched 08:39:32.999990 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 08:39:33.204039 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:39:33.510270 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29342): Launched 08:39:33.777518 run iperf3-srv_10.42.42.10(pid=29343): Launched 08:39:33.892210 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 08:39:34.096244 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:39:34.402674 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29344): Launched 08:39:34.669682 run iperf3-srv_10.42.42.10(pid=29345): Launched 08:39:34.785382 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 08:39:34.988005 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:39:35.294298 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29346): Launched 08:39:35.561497 run iperf3-srv_10.42.42.10(pid=29347): Launched 08:39:35.675995 tst iperf3m4.py:8: start network... 08:39:35.879413 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:39:36.352034 run create_hlr_db(pid=29348): Launched 08:39:36.470262 bus /gobi_6: Setting Powered False 08:39:37.530738 run create_hlr_db(pid=29348): Terminated: ok {rc=0} 08:39:37.975432 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29351): Launched 08:39:38.305438 run osmo-hlr_10.42.42.2(pid=29352): Launched 08:39:38.432932 run osmo-stp_10.42.42.5: Starting osmo-stp 08:39:39.000605 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29354): Launched 08:39:39.330005 run osmo-stp_10.42.42.5(pid=29355): Launched 08:39:39.455757 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:39:40.019581 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29357): Launched 08:39:40.144202 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:39:40.421851 run patchelf(pid=29358): Launched 08:39:40.603354 run osmo-stp_10.42.42.5(pid=29355): ERR: Terminated: ERROR {rc=1} [trial-2402↪gprs:oc2g↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29355)] 08:39:40.740744 run osmo-stp_10.42.42.5(pid=29355): stdout: | (launched: 2022-12-14_08:39:39.269522) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:39:40.879709 run osmo-stp_10.42.42.5(pid=29355): stderr: | 20221214083939459 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214083939460 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214083939460 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214083939460 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214083939461 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214083939461 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214083939461 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:39:41.019215 run osmo-stp_10.42.42.5(pid=29355): stdout: | (launched: 2022-12-14_08:39:39.269522) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:39:41.152852 run osmo-stp_10.42.42.5(pid=29355): stderr: | 20221214083939459 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214083939460 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214083939460 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214083939460 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214083939461 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214083939461 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214083939461 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:39:41.310766 run patchelf(pid=29358): Terminating (SIGINT) 08:39:41.493189 run patchelf(pid=29358): Terminated: ok {rc=0} 08:39:41.624165 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29355): Process ended prematurely: osmo-stp_10.42.42.5(pid=29355) [trial-2402↪gprs:oc2g↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29355)] [trial-2402↪gprs:oc2g↪iperf3m4.py:8] 08:39:41.634431 tst iperf3m4.py:8: Test FAILED (10.9 sec) 08:39:41.663124 run osmo-hlr_10.42.42.2(pid=29352): ERR: Terminated: ERROR {rc=237} [trial-2402↪gprs:oc2g↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29352)] 08:39:41.713221 run osmo-hlr_10.42.42.2(pid=29352): stdout: | (launched: 2022-12-14_08:39:38.244723) 08:39:41.764598 run osmo-hlr_10.42.42.2(pid=29352): stderr: | 20221214083938440 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214083938440 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214083938440 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214083938440 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214083938440 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214083938440 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214083938452 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/gprs:oc2g/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214083938461 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214083938461 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214083938461 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:39:41.816340 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29340): Terminating (SIGTERM) 08:39:41.857832 run iperf3-srv_10.42.42.10(pid=29341): Terminating (SIGTERM) 08:39:41.899902 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29342): Terminating (SIGTERM) 08:39:41.941409 run iperf3-srv_10.42.42.10(pid=29343): Terminating (SIGTERM) 08:39:41.983051 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29344): Terminating (SIGTERM) 08:39:42.024365 run iperf3-srv_10.42.42.10(pid=29345): Terminating (SIGTERM) 08:39:42.065571 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29346): Terminating (SIGTERM) 08:39:42.106819 run iperf3-srv_10.42.42.10(pid=29347): Terminating (SIGTERM) 08:39:42.147916 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29351): Terminating (SIGTERM) 08:39:42.189405 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29354): Terminating (SIGTERM) 08:39:42.230744 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29357): Terminating (SIGTERM) 08:39:42.272756 --- ParallelTerminationStrategy: PID 29340 died... 08:39:42.292675 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29340): Terminated: ok {rc=0} 08:39:42.338608 --- ParallelTerminationStrategy: PID 29341 died... 08:39:42.358088 run iperf3-srv_10.42.42.10(pid=29341): Terminated {rc=256} 08:39:42.403728 --- ParallelTerminationStrategy: PID 29342 died... 08:39:42.423142 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29342): Terminated: ok {rc=0} 08:39:42.469203 --- ParallelTerminationStrategy: PID 29343 died... 08:39:42.488619 run iperf3-srv_10.42.42.10(pid=29343): Terminated {rc=256} 08:39:42.534219 --- ParallelTerminationStrategy: PID 29344 died... 08:39:42.553733 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29344): Terminated: ok {rc=0} 08:39:42.599381 --- ParallelTerminationStrategy: PID 29345 died... 08:39:42.618825 run iperf3-srv_10.42.42.10(pid=29345): Terminated {rc=256} 08:39:42.664574 --- ParallelTerminationStrategy: PID 29346 died... 08:39:42.684118 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29346): Terminated: ok {rc=0} 08:39:42.730146 --- ParallelTerminationStrategy: PID 29347 died... 08:39:42.749756 run iperf3-srv_10.42.42.10(pid=29347): Terminated {rc=256} 08:39:42.795392 --- ParallelTerminationStrategy: PID 29351 died... 08:39:42.815010 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29351): Terminated: ok {rc=0} 08:39:42.860647 --- ParallelTerminationStrategy: PID 29354 died... 08:39:42.880205 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29354): Terminated: ok {rc=0} 08:39:42.925889 --- ParallelTerminationStrategy: PID 29357 died... 08:39:42.945407 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29357): Terminated: ok {rc=0} 08:39:43.031865 bus /gobi_4: Setting Powered False 08:39:44.131590 bus /gobi_4: Setting Powered False 08:39:45.248310 bus /gobi_1: Setting Powered False 08:39:46.342436 bus /gobi_1: Setting Powered False 08:39:47.457893 bus /gobi_0: Setting Powered False 08:39:48.555830 bus /gobi_0: Setting Powered False 08:39:49.672115 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2402 gprs:oc2g ping.py ---------------------------------------------- 08:39:50.772129 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 08:39:50.783260 tst gprs:oc2g: Using 1 x bts (candidates: 1) 08:39:50.817367 tst ping.py: using LAC 39722 08:39:50.935293 tst ping.py: using RAC 197 08:39:51.056049 tst ping.py: using CellId 39722 08:39:51.172744 tst ping.py: using BVCI 39723 08:39:51.281741 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 08:39:51.292409 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 08:39:51.303002 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 08:39:51.313565 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 08:39:51.324006 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 08:39:51.334660 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 08:39:51.345486 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 08:39:51.355949 tst gprs:oc2g: Using 1 x modem (candidates: 4) 08:39:51.476550 tst ping.py:19: start network... 08:39:51.692834 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:39:52.189767 run create_hlr_db(pid=29359): Launched 08:39:52.321836 bus /gobi_6: Setting Powered False 08:39:53.385775 run create_hlr_db(pid=29359): Terminated: ok {rc=0} 08:39:53.813952 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29361): Launched 08:39:54.115818 run osmo-hlr_10.42.42.2(pid=29362): Launched 08:39:54.229908 run osmo-stp_10.42.42.5: Starting osmo-stp 08:39:54.765334 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29364): Launched 08:39:55.067141 run osmo-stp_10.42.42.5(pid=29365): Launched 08:39:55.182802 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:39:55.700649 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29367): Launched 08:39:55.816124 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:39:56.069649 run patchelf(pid=29368): Launched 08:39:56.237250 run osmo-stp_10.42.42.5(pid=29365): ERR: Terminated: ERROR {rc=1} [trial-2402↪gprs:oc2g↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29365)] 08:39:56.364734 run osmo-stp_10.42.42.5(pid=29365): stdout: | (launched: 2022-12-14_08:39:55.011265) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:39:56.494855 run osmo-stp_10.42.42.5(pid=29365): stderr: | 20221214083955179 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214083955180 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214083955180 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214083955180 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214083955181 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214083955181 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214083955181 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:39:56.623964 run osmo-stp_10.42.42.5(pid=29365): stdout: | (launched: 2022-12-14_08:39:55.011265) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:39:56.747696 run osmo-stp_10.42.42.5(pid=29365): stderr: | 20221214083955179 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214083955180 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214083955180 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214083955180 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214083955181 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214083955181 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214083955181 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:39:56.893807 run patchelf(pid=29368): Terminating (SIGINT) 08:39:57.062210 run patchelf(pid=29368): Terminated: ok {rc=0} 08:39:57.183201 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=29365): Process ended prematurely: osmo-stp_10.42.42.5(pid=29365) [trial-2402↪gprs:oc2g↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29365)] [trial-2402↪gprs:oc2g↪ping.py:22] 08:39:57.192087 tst ping.py:22: Test FAILED (6.4 sec) 08:39:57.219166 run osmo-hlr_10.42.42.2(pid=29362): ERR: Terminated: ERROR {rc=237} [trial-2402↪gprs:oc2g↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29362)] 08:39:57.268023 run osmo-hlr_10.42.42.2(pid=29362): stdout: | (launched: 2022-12-14_08:39:54.059732) 08:39:57.318056 run osmo-hlr_10.42.42.2(pid=29362): stderr: | 20221214083954236 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214083954236 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214083954236 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214083954236 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214083954236 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214083954236 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214083954248 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/gprs:oc2g/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214083954257 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214083954258 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214083954258 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:39:57.368120 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29361): Terminating (SIGTERM) 08:39:57.408629 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29364): Terminating (SIGTERM) 08:39:57.448772 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29367): Terminating (SIGTERM) 08:39:57.489104 --- ParallelTerminationStrategy: PID 29361 died... 08:39:57.508302 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29361): Terminated: ok {rc=0} 08:39:57.552662 --- ParallelTerminationStrategy: PID 29364 died... 08:39:57.572011 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29364): Terminated: ok {rc=0} 08:39:57.616347 --- ParallelTerminationStrategy: PID 29367 died... 08:39:57.635459 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29367): Terminated: ok {rc=0} 08:39:57.721338 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2402 gprs:oc2g ping_idle_ping.py ---------------------------------------------- 08:39:58.809577 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 08:39:58.820912 tst gprs:oc2g: Using 1 x bts (candidates: 1) 08:39:58.856903 tst ping_idle_ping.py: using LAC 39723 08:39:58.975331 tst ping_idle_ping.py: using RAC 198 08:39:59.094324 tst ping_idle_ping.py: using CellId 39723 08:39:59.220675 tst ping_idle_ping.py: using BVCI 39724 08:39:59.333618 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 08:39:59.344331 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 08:39:59.354999 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 08:39:59.365409 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 08:39:59.376245 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 08:39:59.386941 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 08:39:59.397732 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 08:39:59.408352 tst gprs:oc2g: Using 1 x modem (candidates: 4) 08:39:59.528827 tst ping_idle_ping.py:24: start network... 08:39:59.746527 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:40:00.249265 run create_hlr_db(pid=29369): Launched 08:40:00.382138 bus /gobi_6: Setting Powered False 08:40:01.456418 run create_hlr_db(pid=29369): Terminated: ok {rc=0} 08:40:01.899857 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29374): Launched 08:40:02.233706 run osmo-hlr_10.42.42.2(pid=29375): Launched 08:40:02.418734 run osmo-stp_10.42.42.5: Starting osmo-stp 08:40:02.936642 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29377): Launched 08:40:03.238651 run osmo-stp_10.42.42.5(pid=29378): Launched 08:40:03.355776 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:40:03.875605 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29380): Launched 08:40:03.990722 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:40:04.245761 run patchelf(pid=29381): Launched 08:40:04.415431 run osmo-stp_10.42.42.5(pid=29378): ERR: Terminated: ERROR {rc=1} [trial-2402↪gprs:oc2g↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29378)] 08:40:04.543172 run osmo-stp_10.42.42.5(pid=29378): stdout: | (launched: 2022-12-14_08:40:03.182792) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:40:04.672393 run osmo-stp_10.42.42.5(pid=29378): stderr: | 20221214084003354 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214084003354 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214084003355 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214084003355 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214084003355 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214084003355 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214084003356 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:40:04.801679 run osmo-stp_10.42.42.5(pid=29378): stdout: | (launched: 2022-12-14_08:40:03.182792) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:40:04.925504 run osmo-stp_10.42.42.5(pid=29378): stderr: | 20221214084003354 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214084003354 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214084003355 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214084003355 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214084003355 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214084003355 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214084003356 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:40:05.071665 run patchelf(pid=29381): Terminating (SIGINT) 08:40:05.240001 run patchelf(pid=29381): Terminated: ok {rc=0} 08:40:05.361885 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=29378): Process ended prematurely: osmo-stp_10.42.42.5(pid=29378) [trial-2402↪gprs:oc2g↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29378)] [trial-2402↪gprs:oc2g↪ping_idle_ping.py:27] 08:40:05.370916 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 08:40:05.397715 run osmo-hlr_10.42.42.2(pid=29375): ERR: Terminated: ERROR {rc=237} [trial-2402↪gprs:oc2g↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29375)] 08:40:05.445678 run osmo-hlr_10.42.42.2(pid=29375): stdout: | (launched: 2022-12-14_08:40:02.176469) 08:40:05.495054 run osmo-hlr_10.42.42.2(pid=29375): stderr: | 20221214084002380 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214084002380 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214084002380 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214084002380 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214084002380 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214084002380 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214084002391 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/gprs:oc2g/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214084002399 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214084002400 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214084002400 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:40:05.545221 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29374): Terminating (SIGTERM) 08:40:05.585265 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29377): Terminating (SIGTERM) 08:40:05.625442 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29380): Terminating (SIGTERM) 08:40:05.665925 --- ParallelTerminationStrategy: PID 29374 died... 08:40:05.685372 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29374): Terminated: ok {rc=0} 08:40:05.729919 --- ParallelTerminationStrategy: PID 29377 died... 08:40:05.749162 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29377): Terminated: ok {rc=0} 08:40:05.793506 --- ParallelTerminationStrategy: PID 29380 died... 08:40:05.812789 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29380): Terminated: ok {rc=0} 08:40:05.899361 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2402 gprs:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 gprs:oc2g+mod-bts0-egprs --------------------------------------------------------------------- 08:40:07.190070 tst gprs:oc2g+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:40:07.195525 tst gprs:oc2g+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 08:40:07.215607 tst gprs:oc2g+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 08:40:07.257700 tst gprs:oc2g+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 08:40:07.344527 tst gprs:oc2g+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 08:40:07.366062 tst gprs:oc2g+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 08:40:07.404878 tst gprs:oc2g+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 08:40:07.999127 tst gprs:oc2g+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2402 gprs:oc2g+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 08:40:08.050615 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:40:08.061952 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 08:40:08.097818 tst cs_paging_gprs_active.py: using LAC 39724 08:40:08.222517 tst cs_paging_gprs_active.py: using RAC 199 08:40:08.346791 tst cs_paging_gprs_active.py: using CellId 39724 08:40:08.473691 tst cs_paging_gprs_active.py: using BVCI 39725 08:40:08.591641 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:40:08.602896 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:40:08.614045 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:40:08.625239 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:40:08.636248 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:40:08.647380 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:40:08.658758 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:40:08.669963 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:40:08.681293 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 08:40:08.798243 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 08:40:08.918197 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 08:40:09.135578 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:40:09.459487 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29386): Launched 08:40:09.739410 run iperf3-srv_10.42.42.10(pid=29387): Launched 08:40:09.860182 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 08:40:10.076834 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:40:10.399470 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29388): Launched 08:40:10.679504 run iperf3-srv_10.42.42.10(pid=29389): Launched 08:40:10.800276 tst cs_paging_gprs_active.py:38: start network... 08:40:11.016518 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:40:11.519681 run create_hlr_db(pid=29390): Launched 08:40:11.651318 bus /gobi_6: Setting Powered False 08:40:12.714903 run create_hlr_db(pid=29390): Terminated: ok {rc=0} 08:40:13.146142 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29392): Launched 08:40:13.449440 run osmo-hlr_10.42.42.2(pid=29393): Launched 08:40:13.568184 run osmo-stp_10.42.42.5: Starting osmo-stp 08:40:14.103391 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29395): Launched 08:40:14.405666 run osmo-stp_10.42.42.5(pid=29396): Launched 08:40:14.521571 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:40:15.043135 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29398): Launched 08:40:15.158301 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:40:15.412410 run patchelf(pid=29399): Launched 08:40:15.579950 run osmo-stp_10.42.42.5(pid=29396): ERR: Terminated: ERROR {rc=1} [trial-2402↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29396)] 08:40:15.707374 run osmo-stp_10.42.42.5(pid=29396): stdout: | (launched: 2022-12-14_08:40:14.349945) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:40:15.836268 run osmo-stp_10.42.42.5(pid=29396): stderr: | 20221214084014518 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214084014518 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214084014518 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214084014519 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214084014519 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214084014519 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214084014519 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:40:15.979056 run osmo-stp_10.42.42.5(pid=29396): stdout: | (launched: 2022-12-14_08:40:14.349945) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:40:16.106213 run osmo-stp_10.42.42.5(pid=29396): stderr: | 20221214084014518 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214084014518 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214084014518 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214084014519 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214084014519 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214084014519 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214084014519 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:40:16.256913 run patchelf(pid=29399): Terminating (SIGINT) 08:40:16.429960 run patchelf(pid=29399): Terminated: ok {rc=0} 08:40:16.555207 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=29396): Process ended prematurely: osmo-stp_10.42.42.5(pid=29396) [trial-2402↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29396)] [trial-2402↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 08:40:16.566009 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 08:40:16.594124 run osmo-hlr_10.42.42.2(pid=29393): ERR: Terminated: ERROR {rc=237} [trial-2402↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29393)] 08:40:16.646664 run osmo-hlr_10.42.42.2(pid=29393): stdout: | (launched: 2022-12-14_08:40:13.393374) 08:40:16.697456 run osmo-hlr_10.42.42.2(pid=29393): stderr: | 20221214084013569 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214084013569 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214084013569 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214084013569 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214084013569 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214084013569 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214084013582 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/gprs:oc2g+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214084013590 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214084013590 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214084013590 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:40:16.751458 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29386): Terminating (SIGTERM) 08:40:16.793157 run iperf3-srv_10.42.42.10(pid=29387): Terminating (SIGTERM) 08:40:16.838390 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29388): Terminating (SIGTERM) 08:40:16.881560 run iperf3-srv_10.42.42.10(pid=29389): Terminating (SIGTERM) 08:40:16.926722 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29392): Terminating (SIGTERM) 08:40:16.969610 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29395): Terminating (SIGTERM) 08:40:17.011828 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29398): Terminating (SIGTERM) 08:40:17.054007 --- ParallelTerminationStrategy: PID 29386 died... 08:40:17.074861 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29386): Terminated: ok {rc=0} 08:40:17.121219 --- ParallelTerminationStrategy: PID 29387 died... 08:40:17.141697 run iperf3-srv_10.42.42.10(pid=29387): Terminated {rc=256} 08:40:17.187355 --- ParallelTerminationStrategy: PID 29388 died... 08:40:17.208031 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29388): Terminated: ok {rc=0} 08:40:17.254221 --- ParallelTerminationStrategy: PID 29389 died... 08:40:17.272706 run iperf3-srv_10.42.42.10(pid=29389): Terminated {rc=256} 08:40:17.316246 --- ParallelTerminationStrategy: PID 29392 died... 08:40:17.334954 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29392): Terminated: ok {rc=0} 08:40:17.378902 --- ParallelTerminationStrategy: PID 29395 died... 08:40:17.397602 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29395): Terminated: ok {rc=0} 08:40:17.441223 --- ParallelTerminationStrategy: PID 29398 died... 08:40:17.460092 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29398): Terminated: ok {rc=0} 08:40:17.544645 bus /gobi_0: Setting Powered False 08:40:18.639138 bus /gobi_0: Setting Powered False 08:40:19.755105 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2402 gprs:oc2g+mod-bts0-egprs iperf3.py ---------------------------------------------- 08:40:20.902126 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:40:20.913606 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 08:40:20.956607 tst iperf3.py: using LAC 39725 08:40:21.074514 tst iperf3.py: using RAC 200 08:40:21.196621 tst iperf3.py: using CellId 39725 08:40:21.316349 tst iperf3.py: using BVCI 39726 08:40:21.434756 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:40:21.445976 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:40:21.457749 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:40:21.469052 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:40:21.480118 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:40:21.491150 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:40:21.502283 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:40:21.513451 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:40:21.524829 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 08:40:21.646106 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 08:40:21.862451 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:40:22.185272 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29400): Launched 08:40:22.464612 run iperf3-srv_10.42.42.10(pid=29401): Launched 08:40:22.585330 tst iperf3.py:8: start network... 08:40:22.800663 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:40:23.299685 run create_hlr_db(pid=29402): Launched 08:40:23.430041 bus /gobi_6: Setting Powered False 08:40:24.493528 run create_hlr_db(pid=29402): Terminated: ok {rc=0} 08:40:24.921335 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29404): Launched 08:40:25.223396 run osmo-hlr_10.42.42.2(pid=29405): Launched 08:40:25.338484 run osmo-stp_10.42.42.5: Starting osmo-stp 08:40:25.862631 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29407): Launched 08:40:26.164802 run osmo-stp_10.42.42.5(pid=29408): Launched 08:40:26.280113 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:40:26.813574 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29410): Launched 08:40:26.928778 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:40:27.184634 run patchelf(pid=29411): Launched 08:40:27.352257 run osmo-stp_10.42.42.5(pid=29408): ERR: Terminated: ERROR {rc=1} [trial-2402↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29408)] 08:40:27.480029 run osmo-stp_10.42.42.5(pid=29408): stdout: | (launched: 2022-12-14_08:40:26.108678) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:40:27.610079 run osmo-stp_10.42.42.5(pid=29408): stderr: | 20221214084026279 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214084026279 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214084026279 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214084026280 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214084026280 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214084026280 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214084026280 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:40:27.739786 run osmo-stp_10.42.42.5(pid=29408): stdout: | (launched: 2022-12-14_08:40:26.108678) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:40:27.863618 run osmo-stp_10.42.42.5(pid=29408): stderr: | 20221214084026279 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214084026279 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214084026279 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214084026280 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214084026280 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214084026280 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214084026280 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:40:28.010339 run patchelf(pid=29411): Terminating (SIGINT) 08:40:28.178301 run patchelf(pid=29411): Terminated: ok {rc=0} 08:40:28.299596 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29408): Process ended prematurely: osmo-stp_10.42.42.5(pid=29408) [trial-2402↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29408)] [trial-2402↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8] 08:40:28.309318 tst iperf3.py:8: Test FAILED (7.4 sec) 08:40:28.336227 run osmo-hlr_10.42.42.2(pid=29405): ERR: Terminated: ERROR {rc=237} [trial-2402↪gprs:oc2g+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29405)] 08:40:28.384566 run osmo-hlr_10.42.42.2(pid=29405): stdout: | (launched: 2022-12-14_08:40:25.166903) 08:40:28.434018 run osmo-hlr_10.42.42.2(pid=29405): stderr: | 20221214084025344 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214084025344 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214084025344 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214084025344 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214084025344 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214084025344 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214084025356 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/gprs:oc2g+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214084025365 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214084025366 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214084025366 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:40:28.484008 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29400): Terminating (SIGTERM) 08:40:28.524376 run iperf3-srv_10.42.42.10(pid=29401): Terminating (SIGTERM) 08:40:28.564338 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29404): Terminating (SIGTERM) 08:40:28.604365 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29407): Terminating (SIGTERM) 08:40:28.644358 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29410): Terminating (SIGTERM) 08:40:28.684819 --- ParallelTerminationStrategy: PID 29400 died... 08:40:28.704583 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29400): Terminated: ok {rc=0} 08:40:28.749352 --- ParallelTerminationStrategy: PID 29401 died... 08:40:28.768379 run iperf3-srv_10.42.42.10(pid=29401): Terminated {rc=256} 08:40:28.812773 --- ParallelTerminationStrategy: PID 29404 died... 08:40:28.831960 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29404): Terminated: ok {rc=0} 08:40:28.876332 --- ParallelTerminationStrategy: PID 29407 died... 08:40:28.895512 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29407): Terminated: ok {rc=0} 08:40:28.939925 --- ParallelTerminationStrategy: PID 29410 died... 08:40:28.959162 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29410): Terminated: ok {rc=0} 08:40:29.044325 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2402 gprs:oc2g+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 08:40:30.192737 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:40:30.204658 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 08:40:30.244045 tst iperf3m4.py: using LAC 39726 08:40:30.372028 tst iperf3m4.py: using RAC 201 08:40:30.493730 tst iperf3m4.py: using CellId 39726 08:40:30.612531 tst iperf3m4.py: using BVCI 39727 08:40:30.722653 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:40:30.733497 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:40:30.744260 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:40:30.754891 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:40:30.766305 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:40:30.777669 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:40:30.789317 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:40:30.800474 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:40:30.811934 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 08:40:30.931663 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 08:40:31.046421 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 08:40:31.176706 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 08:40:31.299315 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 08:40:31.550294 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:40:31.913696 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29412): Launched 08:40:32.207596 run iperf3-srv_10.42.42.10(pid=29413): Launched 08:40:32.336777 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 08:40:32.539111 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:40:32.842468 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29414): Launched 08:40:33.107198 run iperf3-srv_10.42.42.10(pid=29415): Launched 08:40:33.220427 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 08:40:33.421381 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:40:33.723956 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29416): Launched 08:40:33.987080 run iperf3-srv_10.42.42.10(pid=29417): Launched 08:40:34.102626 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 08:40:34.303163 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:40:34.606591 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29418): Launched 08:40:34.869298 run iperf3-srv_10.42.42.10(pid=29419): Launched 08:40:34.982283 tst iperf3m4.py:8: start network... 08:40:35.182252 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:40:35.650706 run create_hlr_db(pid=29420): Launched 08:40:35.767219 bus /gobi_6: Setting Powered False 08:40:36.827324 run create_hlr_db(pid=29420): Terminated: ok {rc=0} 08:40:37.265361 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29422): Launched 08:40:37.586908 run osmo-hlr_10.42.42.2(pid=29423): Launched 08:40:37.710291 run osmo-stp_10.42.42.5: Starting osmo-stp 08:40:38.266956 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29425): Launched 08:40:38.588940 run osmo-stp_10.42.42.5(pid=29426): Launched 08:40:38.712614 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:40:39.265937 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29428): Launched 08:40:39.391240 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:40:39.665490 run patchelf(pid=29429): Launched 08:40:39.843334 run osmo-stp_10.42.42.5(pid=29426): ERR: Terminated: ERROR {rc=1} [trial-2402↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29426)] 08:40:39.980226 run osmo-stp_10.42.42.5(pid=29426): stdout: | (launched: 2022-12-14_08:40:38.529963) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:40:40.110554 run osmo-stp_10.42.42.5(pid=29426): stderr: | 20221214084038718 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214084038718 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214084038718 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214084038719 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214084038719 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214084038719 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214084038719 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:40:40.240767 run osmo-stp_10.42.42.5(pid=29426): stdout: | (launched: 2022-12-14_08:40:38.529963) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:40:40.364734 run osmo-stp_10.42.42.5(pid=29426): stderr: | 20221214084038718 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214084038718 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214084038718 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214084038719 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214084038719 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214084038719 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214084038719 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:40:40.511484 run patchelf(pid=29429): Terminating (SIGINT) 08:40:40.679528 run patchelf(pid=29429): Terminated: ok {rc=0} 08:40:40.800930 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29426): Process ended prematurely: osmo-stp_10.42.42.5(pid=29426) [trial-2402↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29426)] [trial-2402↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8] 08:40:40.810748 tst iperf3m4.py:8: Test FAILED (10.7 sec) 08:40:40.837958 run osmo-hlr_10.42.42.2(pid=29423): ERR: Terminated: ERROR {rc=237} [trial-2402↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29423)] 08:40:40.886162 run osmo-hlr_10.42.42.2(pid=29423): stdout: | (launched: 2022-12-14_08:40:37.527661) 08:40:40.935731 run osmo-hlr_10.42.42.2(pid=29423): stderr: | 20221214084037723 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214084037723 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214084037723 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214084037723 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214084037723 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214084037723 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214084037735 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/gprs:oc2g+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214084037743 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214084037743 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214084037744 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:40:40.985933 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29412): Terminating (SIGTERM) 08:40:41.025681 run iperf3-srv_10.42.42.10(pid=29413): Terminating (SIGTERM) 08:40:41.065318 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29414): Terminating (SIGTERM) 08:40:41.105569 run iperf3-srv_10.42.42.10(pid=29415): Terminating (SIGTERM) 08:40:41.145318 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29416): Terminating (SIGTERM) 08:40:41.185457 run iperf3-srv_10.42.42.10(pid=29417): Terminating (SIGTERM) 08:40:41.225068 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29418): Terminating (SIGTERM) 08:40:41.264753 run iperf3-srv_10.42.42.10(pid=29419): Terminating (SIGTERM) 08:40:41.304298 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29422): Terminating (SIGTERM) 08:40:41.344073 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29425): Terminating (SIGTERM) 08:40:41.383841 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29428): Terminating (SIGTERM) 08:40:41.423767 --- ParallelTerminationStrategy: PID 29412 died... 08:40:41.443072 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29412): Terminated: ok {rc=0} 08:40:41.487286 --- ParallelTerminationStrategy: PID 29413 died... 08:40:41.506002 run iperf3-srv_10.42.42.10(pid=29413): Terminated {rc=256} 08:40:41.550320 --- ParallelTerminationStrategy: PID 29414 died... 08:40:41.569168 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29414): Terminated: ok {rc=0} 08:40:41.613294 --- ParallelTerminationStrategy: PID 29415 died... 08:40:41.632156 run iperf3-srv_10.42.42.10(pid=29415): Terminated {rc=256} 08:40:41.675925 --- ParallelTerminationStrategy: PID 29416 died... 08:40:41.694779 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29416): Terminated: ok {rc=0} 08:40:41.738511 --- ParallelTerminationStrategy: PID 29417 died... 08:40:41.757312 run iperf3-srv_10.42.42.10(pid=29417): Terminated {rc=256} 08:40:41.801176 --- ParallelTerminationStrategy: PID 29418 died... 08:40:41.819850 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29418): Terminated: ok {rc=0} 08:40:41.863664 --- ParallelTerminationStrategy: PID 29419 died... 08:40:41.882808 run iperf3-srv_10.42.42.10(pid=29419): Terminated {rc=256} 08:40:41.926551 --- ParallelTerminationStrategy: PID 29422 died... 08:40:41.945479 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29422): Terminated: ok {rc=0} 08:40:41.990118 --- ParallelTerminationStrategy: PID 29425 died... 08:40:42.009051 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29425): Terminated: ok {rc=0} 08:40:42.052912 --- ParallelTerminationStrategy: PID 29428 died... 08:40:42.072279 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29428): Terminated: ok {rc=0} 08:40:42.158695 bus /gobi_4: Setting Powered False 08:40:43.257835 bus /gobi_4: Setting Powered False 08:40:44.371986 bus /gobi_1: Setting Powered False 08:40:45.470875 bus /gobi_1: Setting Powered False 08:40:46.585502 bus /gobi_0: Setting Powered False 08:40:47.686512 bus /gobi_0: Setting Powered False 08:40:48.804650 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2402 gprs:oc2g+mod-bts0-egprs ping.py ---------------------------------------------- 08:40:49.907273 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:40:49.918652 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 08:40:49.955093 tst ping.py: using LAC 39727 08:40:50.079576 tst ping.py: using RAC 202 08:40:50.204718 tst ping.py: using CellId 39727 08:40:50.327850 tst ping.py: using BVCI 39728 08:40:50.443610 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:40:50.454958 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:40:50.466199 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:40:50.477748 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:40:50.488672 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:40:50.499686 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:40:50.510901 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:40:50.522262 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 08:40:50.638849 tst ping.py:19: start network... 08:40:50.835485 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:40:51.291836 run create_hlr_db(pid=29430): Launched 08:40:51.404792 bus /gobi_6: Setting Powered False 08:40:52.464080 run create_hlr_db(pid=29430): Terminated: ok {rc=0} 08:40:52.896427 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29433): Launched 08:40:53.211994 run osmo-hlr_10.42.42.2(pid=29434): Launched 08:40:53.331922 run osmo-stp_10.42.42.5: Starting osmo-stp 08:40:53.885774 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29436): Launched 08:40:54.203048 run osmo-stp_10.42.42.5(pid=29437): Launched 08:40:54.323683 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:40:54.867551 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29439): Launched 08:40:54.987597 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:40:55.255031 run patchelf(pid=29440): Launched 08:40:55.430200 run osmo-stp_10.42.42.5(pid=29437): ERR: Terminated: ERROR {rc=1} [trial-2402↪gprs:oc2g+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29437)] 08:40:55.564176 run osmo-stp_10.42.42.5(pid=29437): stdout: | (launched: 2022-12-14_08:40:54.144825) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:40:55.699365 run osmo-stp_10.42.42.5(pid=29437): stderr: | 20221214084054338 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214084054338 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214084054339 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214084054339 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214084054340 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214084054340 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214084054340 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:40:55.834872 run osmo-stp_10.42.42.5(pid=29437): stdout: | (launched: 2022-12-14_08:40:54.144825) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:40:55.964408 run osmo-stp_10.42.42.5(pid=29437): stderr: | 20221214084054338 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214084054338 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214084054339 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214084054339 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214084054340 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214084054340 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214084054340 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:40:56.118041 run patchelf(pid=29440): Terminating (SIGINT) 08:40:56.294175 run patchelf(pid=29440): Terminated: ok {rc=0} 08:40:56.420859 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=29437): Process ended prematurely: osmo-stp_10.42.42.5(pid=29437) [trial-2402↪gprs:oc2g+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29437)] [trial-2402↪gprs:oc2g+mod-bts0-egprs↪ping.py:22] 08:40:56.430531 tst ping.py:22: Test FAILED (6.5 sec) 08:40:56.458522 run osmo-hlr_10.42.42.2(pid=29434): ERR: Terminated: ERROR {rc=237} [trial-2402↪gprs:oc2g+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29434)] 08:40:56.508729 run osmo-hlr_10.42.42.2(pid=29434): stdout: | (launched: 2022-12-14_08:40:53.153827) 08:40:56.560450 run osmo-hlr_10.42.42.2(pid=29434): stderr: | 20221214084053352 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214084053352 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214084053352 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214084053353 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214084053353 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214084053353 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214084053366 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/gprs:oc2g+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214084053374 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214084053374 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214084053374 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:40:56.612485 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29433): Terminating (SIGTERM) 08:40:56.654221 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29436): Terminating (SIGTERM) 08:40:56.695776 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29439): Terminating (SIGTERM) 08:40:56.737806 --- ParallelTerminationStrategy: PID 29433 died... 08:40:56.757699 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29433): Terminated: ok {rc=0} 08:40:56.803585 --- ParallelTerminationStrategy: PID 29436 died... 08:40:56.823048 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29436): Terminated: ok {rc=0} 08:40:56.868646 --- ParallelTerminationStrategy: PID 29439 died... 08:40:56.888067 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29439): Terminated: ok {rc=0} 08:40:56.975010 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2402 gprs:oc2g+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 08:40:58.060230 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:40:58.072148 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 08:40:58.110451 tst ping_idle_ping.py: using LAC 39728 08:40:58.237217 tst ping_idle_ping.py: using RAC 203 08:40:58.362419 tst ping_idle_ping.py: using CellId 39728 08:40:58.487074 tst ping_idle_ping.py: using BVCI 39729 08:40:58.603842 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:40:58.615174 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:40:58.626401 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:40:58.637611 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:40:58.649220 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:40:58.661238 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:40:58.672903 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:40:58.684548 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 08:40:58.801098 tst ping_idle_ping.py:24: start network... 08:40:58.998864 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:40:59.460550 run create_hlr_db(pid=29441): Launched 08:40:59.573798 bus /gobi_6: Setting Powered False 08:41:00.632917 run create_hlr_db(pid=29441): Terminated: ok {rc=0} 08:41:01.101762 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29443): Launched 08:41:01.435069 run osmo-hlr_10.42.42.2(pid=29444): Launched 08:41:01.610734 run osmo-stp_10.42.42.5: Starting osmo-stp 08:41:02.319873 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29446): Launched 08:41:02.638765 run osmo-stp_10.42.42.5(pid=29447): Launched 08:41:02.760201 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:41:03.309947 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29449): Launched 08:41:03.432371 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:41:03.701331 run patchelf(pid=29450): Launched 08:41:03.877722 run osmo-stp_10.42.42.5(pid=29447): ERR: Terminated: ERROR {rc=1} [trial-2402↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29447)] 08:41:04.011933 run osmo-stp_10.42.42.5(pid=29447): stdout: | (launched: 2022-12-14_08:41:02.580342) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:41:04.147556 run osmo-stp_10.42.42.5(pid=29447): stderr: | 20221214084102771 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214084102771 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214084102772 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214084102772 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214084102773 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214084102773 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214084102773 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:41:04.283806 run osmo-stp_10.42.42.5(pid=29447): stdout: | (launched: 2022-12-14_08:41:02.580342) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:41:04.414130 run osmo-stp_10.42.42.5(pid=29447): stderr: | 20221214084102771 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214084102771 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214084102772 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214084102772 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214084102773 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214084102773 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214084102773 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:41:04.569205 run patchelf(pid=29450): Terminating (SIGINT) 08:41:04.746362 run patchelf(pid=29450): Terminated: ok {rc=0} 08:41:04.873757 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=29447): Process ended prematurely: osmo-stp_10.42.42.5(pid=29447) [trial-2402↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29447)] [trial-2402↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27] 08:41:04.883580 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 08:41:04.911630 run osmo-hlr_10.42.42.2(pid=29444): ERR: Terminated: ERROR {rc=237} [trial-2402↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29444)] 08:41:04.961905 run osmo-hlr_10.42.42.2(pid=29444): stdout: | (launched: 2022-12-14_08:41:01.376372) 08:41:05.013825 run osmo-hlr_10.42.42.2(pid=29444): stderr: | 20221214084101742 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214084101742 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214084101742 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214084101742 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214084101742 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214084101742 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214084101764 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/gprs:oc2g+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214084101786 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214084101786 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214084101786 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:41:05.066139 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29443): Terminating (SIGTERM) 08:41:05.108015 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29446): Terminating (SIGTERM) 08:41:05.150368 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29449): Terminating (SIGTERM) 08:41:05.192364 --- ParallelTerminationStrategy: PID 29443 died... 08:41:05.212393 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29443): Terminated: ok {rc=0} 08:41:05.258489 --- ParallelTerminationStrategy: PID 29446 died... 08:41:05.278056 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29446): Terminated: ok {rc=0} 08:41:05.323943 --- ParallelTerminationStrategy: PID 29449 died... 08:41:05.343426 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29449): Terminated: ok {rc=0} 08:41:05.430868 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2402 gprs:oc2g+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 gprs:oc2g+mod-bts0-dynts-ipa --------------------------------------------------------------------- 08:41:06.728560 tst gprs:oc2g+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:41:06.735065 tst gprs:oc2g+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 08:41:06.756128 tst gprs:oc2g+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 08:41:06.797490 tst gprs:oc2g+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 08:41:06.883283 tst gprs:oc2g+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 08:41:06.903449 tst gprs:oc2g+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 08:41:06.941411 tst gprs:oc2g+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 08:41:07.540559 tst gprs:oc2g+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2402 gprs:oc2g+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 08:41:07.590991 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:41:07.601817 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 08:41:07.657660 tst cs_paging_gprs_active.py: using LAC 39729 08:41:07.786211 tst cs_paging_gprs_active.py: using RAC 204 08:41:07.914686 tst cs_paging_gprs_active.py: using CellId 39729 08:41:08.042609 tst cs_paging_gprs_active.py: using BVCI 39730 08:41:08.159777 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:41:08.171245 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:41:08.182361 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:41:08.193527 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:41:08.204519 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:41:08.215692 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:41:08.226963 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:41:08.238045 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:41:08.249271 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 08:41:08.365840 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 08:41:08.482488 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 08:41:08.685220 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:41:08.989428 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29456): Launched 08:41:09.253758 run iperf3-srv_10.42.42.10(pid=29457): Launched 08:41:09.367329 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 08:41:09.569916 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:41:09.874192 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29458): Launched 08:41:10.138051 run iperf3-srv_10.42.42.10(pid=29459): Launched 08:41:10.253321 tst cs_paging_gprs_active.py:38: start network... 08:41:10.455535 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:41:10.924464 run create_hlr_db(pid=29460): Launched 08:41:11.040313 bus /gobi_6: Setting Powered False 08:41:12.101136 run create_hlr_db(pid=29460): Terminated: ok {rc=0} 08:41:12.541445 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29462): Launched 08:41:12.864124 run osmo-hlr_10.42.42.2(pid=29463): Launched 08:41:12.987410 run osmo-stp_10.42.42.5: Starting osmo-stp 08:41:13.523779 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29465): Launched 08:41:13.826449 run osmo-stp_10.42.42.5(pid=29466): Launched 08:41:13.942195 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:41:14.465128 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29468): Launched 08:41:14.580645 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:41:14.836085 run patchelf(pid=29469): Launched 08:41:15.003855 run osmo-stp_10.42.42.5(pid=29466): ERR: Terminated: ERROR {rc=1} [trial-2402↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29466)] 08:41:15.131606 run osmo-stp_10.42.42.5(pid=29466): stdout: | (launched: 2022-12-14_08:41:13.770643) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:41:15.261285 run osmo-stp_10.42.42.5(pid=29466): stderr: | 20221214084113940 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214084113940 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214084113940 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214084113941 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214084113941 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214084113941 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214084113941 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:41:15.390863 run osmo-stp_10.42.42.5(pid=29466): stdout: | (launched: 2022-12-14_08:41:13.770643) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:41:15.514836 run osmo-stp_10.42.42.5(pid=29466): stderr: | 20221214084113940 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214084113940 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214084113940 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214084113941 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214084113941 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214084113941 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214084113941 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:41:15.661622 run patchelf(pid=29469): Terminating (SIGINT) 08:41:15.830929 run patchelf(pid=29469): Terminated: ok {rc=0} 08:41:15.981367 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=29466): Process ended prematurely: osmo-stp_10.42.42.5(pid=29466) [trial-2402↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29466)] [trial-2402↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 08:41:15.991826 tst cs_paging_gprs_active.py:38: Test FAILED (8.4 sec) 08:41:16.020026 run osmo-hlr_10.42.42.2(pid=29463): ERR: Terminated: ERROR {rc=237} [trial-2402↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29463)] 08:41:16.070903 run osmo-hlr_10.42.42.2(pid=29463): stdout: | (launched: 2022-12-14_08:41:12.804408) 08:41:16.122740 run osmo-hlr_10.42.42.2(pid=29463): stderr: | 20221214084113004 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214084113004 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214084113004 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214084113004 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214084113004 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214084113004 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214084113015 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/gprs:oc2g+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214084113023 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214084113023 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214084113024 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:41:16.175108 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29456): Terminating (SIGTERM) 08:41:16.217850 run iperf3-srv_10.42.42.10(pid=29457): Terminating (SIGTERM) 08:41:16.262337 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29458): Terminating (SIGTERM) 08:41:16.304624 run iperf3-srv_10.42.42.10(pid=29459): Terminating (SIGTERM) 08:41:16.350539 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29462): Terminating (SIGTERM) 08:41:16.395204 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29465): Terminating (SIGTERM) 08:41:16.439853 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29468): Terminating (SIGTERM) 08:41:16.486553 --- ParallelTerminationStrategy: PID 29456 died... 08:41:16.507082 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29456): Terminated: ok {rc=0} 08:41:16.556122 --- ParallelTerminationStrategy: PID 29457 died... 08:41:16.576541 run iperf3-srv_10.42.42.10(pid=29457): Terminated {rc=256} 08:41:16.623334 --- ParallelTerminationStrategy: PID 29458 died... 08:41:16.643508 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29458): Terminated: ok {rc=0} 08:41:16.691782 --- ParallelTerminationStrategy: PID 29459 died... 08:41:16.711809 run iperf3-srv_10.42.42.10(pid=29459): Terminated {rc=256} 08:41:16.758884 --- ParallelTerminationStrategy: PID 29462 died... 08:41:16.779912 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29462): Terminated: ok {rc=0} 08:41:16.828070 --- ParallelTerminationStrategy: PID 29465 died... 08:41:16.850814 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29465): Terminated: ok {rc=0} 08:41:16.897918 --- ParallelTerminationStrategy: PID 29468 died... 08:41:16.917858 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29468): Terminated: ok {rc=0} 08:41:17.005917 bus /gobi_0: Setting Powered False 08:41:18.103077 bus /gobi_0: Setting Powered False 08:41:19.218440 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2402 gprs:oc2g+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 08:41:20.363611 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:41:20.375121 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 08:41:20.433791 tst iperf3.py: using LAC 39730 08:41:20.555154 tst iperf3.py: using RAC 205 08:41:20.676267 tst iperf3.py: using CellId 39730 08:41:20.795107 tst iperf3.py: using BVCI 39731 08:41:20.907124 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:41:20.917986 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:41:20.928597 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:41:20.939148 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:41:20.949999 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:41:20.960862 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:41:20.972314 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:41:20.983094 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:41:20.994050 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 08:41:21.108384 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 08:41:21.310560 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:41:21.615025 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29470): Launched 08:41:21.878109 run iperf3-srv_10.42.42.10(pid=29471): Launched 08:41:21.992092 tst iperf3.py:8: start network... 08:41:22.194103 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:41:22.662921 run create_hlr_db(pid=29472): Launched 08:41:22.779589 bus /gobi_6: Setting Powered False 08:41:23.840584 run create_hlr_db(pid=29472): Terminated: ok {rc=0} 08:41:24.281112 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29474): Launched 08:41:24.603150 run osmo-hlr_10.42.42.2(pid=29475): Launched 08:41:24.737178 run osmo-stp_10.42.42.5: Starting osmo-stp 08:41:25.296450 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29477): Launched 08:41:25.618364 run osmo-stp_10.42.42.5(pid=29478): Launched 08:41:25.741841 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:41:26.296093 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29480): Launched 08:41:26.418765 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:41:26.691974 run patchelf(pid=29481): Launched 08:41:26.869814 run osmo-stp_10.42.42.5(pid=29478): ERR: Terminated: ERROR {rc=1} [trial-2402↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29478)] 08:41:27.005374 run osmo-stp_10.42.42.5(pid=29478): stdout: | (launched: 2022-12-14_08:41:25.559201) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:41:27.142412 run osmo-stp_10.42.42.5(pid=29478): stderr: | 20221214084125753 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214084125753 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214084125753 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214084125754 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214084125754 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214084125754 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214084125754 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:41:27.279693 run osmo-stp_10.42.42.5(pid=29478): stdout: | (launched: 2022-12-14_08:41:25.559201) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:41:27.411109 run osmo-stp_10.42.42.5(pid=29478): stderr: | 20221214084125753 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214084125753 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214084125753 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214084125754 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214084125754 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214084125754 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214084125754 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:41:27.567410 run patchelf(pid=29481): Terminating (SIGINT) 08:41:27.746213 run patchelf(pid=29481): Terminated: ok {rc=0} 08:41:27.875347 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29478): Process ended prematurely: osmo-stp_10.42.42.5(pid=29478) [trial-2402↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29478)] [trial-2402↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8] 08:41:27.885709 tst iperf3.py:8: Test FAILED (7.6 sec) 08:41:27.913760 run osmo-hlr_10.42.42.2(pid=29475): ERR: Terminated: ERROR {rc=237} [trial-2402↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29475)] 08:41:27.963534 run osmo-hlr_10.42.42.2(pid=29475): stdout: | (launched: 2022-12-14_08:41:24.543723) 08:41:28.015576 run osmo-hlr_10.42.42.2(pid=29475): stderr: | 20221214084124753 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214084124754 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214084124754 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214084124754 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214084124754 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214084124754 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214084124766 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/gprs:oc2g+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214084124776 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214084124776 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214084124776 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:41:28.067521 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29470): Terminating (SIGTERM) 08:41:28.108934 run iperf3-srv_10.42.42.10(pid=29471): Terminating (SIGTERM) 08:41:28.150385 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29474): Terminating (SIGTERM) 08:41:28.191907 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29477): Terminating (SIGTERM) 08:41:28.233358 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29480): Terminating (SIGTERM) 08:41:28.274973 --- ParallelTerminationStrategy: PID 29470 died... 08:41:28.294846 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29470): Terminated: ok {rc=0} 08:41:28.341201 --- ParallelTerminationStrategy: PID 29471 died... 08:41:28.360623 run iperf3-srv_10.42.42.10(pid=29471): Terminated {rc=256} 08:41:28.406674 --- ParallelTerminationStrategy: PID 29474 died... 08:41:28.426016 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29474): Terminated: ok {rc=0} 08:41:28.471531 --- ParallelTerminationStrategy: PID 29477 died... 08:41:28.491125 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29477): Terminated: ok {rc=0} 08:41:28.536926 --- ParallelTerminationStrategy: PID 29480 died... 08:41:28.556753 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29480): Terminated: ok {rc=0} 08:41:28.644073 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2402 gprs:oc2g+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 08:41:29.793145 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:41:29.805081 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 08:41:29.862768 tst iperf3m4.py: using LAC 39731 08:41:29.990385 tst iperf3m4.py: using RAC 206 08:41:30.119321 tst iperf3m4.py: using CellId 39731 08:41:30.245420 tst iperf3m4.py: using BVCI 39732 08:41:30.362400 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:41:30.373890 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:41:30.385076 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:41:30.396263 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:41:30.407401 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:41:30.418596 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:41:30.430119 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:41:30.441320 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:41:30.452625 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 08:41:30.568164 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 08:41:30.688880 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 08:41:30.804540 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 08:41:30.957495 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 08:41:31.168773 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:41:31.484582 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29482): Launched 08:41:31.769790 run iperf3-srv_10.42.42.10(pid=29483): Launched 08:41:31.903595 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 08:41:32.123738 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:41:32.449542 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29484): Launched 08:41:32.730476 run iperf3-srv_10.42.42.10(pid=29485): Launched 08:41:32.852904 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 08:41:33.069324 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:41:33.393632 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29486): Launched 08:41:33.674632 run iperf3-srv_10.42.42.10(pid=29487): Launched 08:41:33.797690 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 08:41:34.014483 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:41:34.339189 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29488): Launched 08:41:34.621202 run iperf3-srv_10.42.42.10(pid=29489): Launched 08:41:34.742053 tst iperf3m4.py:8: start network... 08:41:34.958619 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:41:35.461661 run create_hlr_db(pid=29490): Launched 08:41:35.593517 bus /gobi_6: Setting Powered False 08:41:36.656578 run create_hlr_db(pid=29490): Terminated: ok {rc=0} 08:41:37.104303 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29492): Launched 08:41:37.427755 run osmo-hlr_10.42.42.2(pid=29493): Launched 08:41:37.551321 run osmo-stp_10.42.42.5: Starting osmo-stp 08:41:38.106532 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29495): Launched 08:41:38.429496 run osmo-stp_10.42.42.5(pid=29496): Launched 08:41:38.553971 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:41:39.111647 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29498): Launched 08:41:39.235215 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:41:39.508254 run patchelf(pid=29499): Launched 08:41:39.687396 run osmo-stp_10.42.42.5(pid=29496): ERR: Terminated: ERROR {rc=1} [trial-2402↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29496)] 08:41:39.823642 run osmo-stp_10.42.42.5(pid=29496): stdout: | (launched: 2022-12-14_08:41:38.369969) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:41:39.961352 run osmo-stp_10.42.42.5(pid=29496): stderr: | 20221214084138559 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214084138559 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214084138560 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214084138560 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214084138560 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214084138560 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214084138561 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:41:40.099399 run osmo-stp_10.42.42.5(pid=29496): stdout: | (launched: 2022-12-14_08:41:38.369969) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:41:40.231388 run osmo-stp_10.42.42.5(pid=29496): stderr: | 20221214084138559 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214084138559 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214084138560 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214084138560 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214084138560 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214084138560 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214084138561 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:41:40.387693 run patchelf(pid=29499): Terminating (SIGINT) 08:41:40.567896 run patchelf(pid=29499): Terminated: ok {rc=0} 08:41:40.697509 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29496): Process ended prematurely: osmo-stp_10.42.42.5(pid=29496) [trial-2402↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29496)] [trial-2402↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8] 08:41:40.707704 tst iperf3m4.py:8: Test FAILED (11.0 sec) 08:41:40.736580 run osmo-hlr_10.42.42.2(pid=29493): ERR: Terminated: ERROR {rc=237} [trial-2402↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29493)] 08:41:40.786854 run osmo-hlr_10.42.42.2(pid=29493): stdout: | (launched: 2022-12-14_08:41:37.368249) 08:41:40.838853 run osmo-hlr_10.42.42.2(pid=29493): stderr: | 20221214084137564 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214084137564 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214084137564 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214084137565 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214084137565 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214084137565 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214084137577 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/gprs:oc2g+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214084137585 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214084137586 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214084137586 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:41:40.891671 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29482): Terminating (SIGTERM) 08:41:40.933529 run iperf3-srv_10.42.42.10(pid=29483): Terminating (SIGTERM) 08:41:40.975811 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29484): Terminating (SIGTERM) 08:41:41.017766 run iperf3-srv_10.42.42.10(pid=29485): Terminating (SIGTERM) 08:41:41.059555 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29486): Terminating (SIGTERM) 08:41:41.101671 run iperf3-srv_10.42.42.10(pid=29487): Terminating (SIGTERM) 08:41:41.143338 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29488): Terminating (SIGTERM) 08:41:41.185232 run iperf3-srv_10.42.42.10(pid=29489): Terminating (SIGTERM) 08:41:41.227219 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29492): Terminating (SIGTERM) 08:41:41.269545 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29495): Terminating (SIGTERM) 08:41:41.311847 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29498): Terminating (SIGTERM) 08:41:41.354476 --- ParallelTerminationStrategy: PID 29482 died... 08:41:41.374398 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29482): Terminated: ok {rc=0} 08:41:41.420386 --- ParallelTerminationStrategy: PID 29483 died... 08:41:41.439848 run iperf3-srv_10.42.42.10(pid=29483): Terminated {rc=256} 08:41:41.485679 --- ParallelTerminationStrategy: PID 29484 died... 08:41:41.505510 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29484): Terminated: ok {rc=0} 08:41:41.551567 --- ParallelTerminationStrategy: PID 29485 died... 08:41:41.571087 run iperf3-srv_10.42.42.10(pid=29485): Terminated {rc=256} 08:41:41.616794 --- ParallelTerminationStrategy: PID 29486 died... 08:41:41.636682 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29486): Terminated: ok {rc=0} 08:41:41.682429 --- ParallelTerminationStrategy: PID 29487 died... 08:41:41.701786 run iperf3-srv_10.42.42.10(pid=29487): Terminated {rc=256} 08:41:41.747527 --- ParallelTerminationStrategy: PID 29488 died... 08:41:41.766988 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29488): Terminated: ok {rc=0} 08:41:41.812709 --- ParallelTerminationStrategy: PID 29489 died... 08:41:41.832219 run iperf3-srv_10.42.42.10(pid=29489): Terminated {rc=256} 08:41:41.877968 --- ParallelTerminationStrategy: PID 29492 died... 08:41:41.897779 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29492): Terminated: ok {rc=0} 08:41:41.943820 --- ParallelTerminationStrategy: PID 29495 died... 08:41:41.963415 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29495): Terminated: ok {rc=0} 08:41:42.009314 --- ParallelTerminationStrategy: PID 29498 died... 08:41:42.028818 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29498): Terminated: ok {rc=0} 08:41:42.116154 bus /gobi_4: Setting Powered False 08:41:43.215589 bus /gobi_4: Setting Powered False 08:41:44.331991 bus /gobi_1: Setting Powered False 08:41:45.428390 bus /gobi_1: Setting Powered False 08:41:46.550577 bus /gobi_0: Setting Powered False 08:41:47.662654 bus /gobi_0: Setting Powered False 08:41:48.778498 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2402 gprs:oc2g+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 08:41:49.881982 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:41:49.893923 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 08:41:49.952685 tst ping.py: using LAC 39732 08:41:50.078597 tst ping.py: using RAC 207 08:41:50.204372 tst ping.py: using CellId 39732 08:41:50.329289 tst ping.py: using BVCI 39733 08:41:50.443945 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:41:50.455481 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:41:50.466807 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:41:50.478025 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:41:50.489238 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:41:50.500705 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:41:50.512142 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:41:50.523383 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 08:41:50.638461 tst ping.py:19: start network... 08:41:50.837272 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:41:51.298942 run create_hlr_db(pid=29500): Launched 08:41:51.414140 bus /gobi_6: Setting Powered False 08:41:52.473698 run create_hlr_db(pid=29500): Terminated: ok {rc=0} 08:41:52.909222 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29502): Launched 08:41:53.225540 run osmo-hlr_10.42.42.2(pid=29503): Launched 08:41:53.345914 run osmo-stp_10.42.42.5: Starting osmo-stp 08:41:53.895069 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29505): Launched 08:41:54.213725 run osmo-stp_10.42.42.5(pid=29506): Launched 08:41:54.333770 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:41:54.880338 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29508): Launched 08:41:55.002297 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:41:55.270324 run patchelf(pid=29509): Launched 08:41:55.446028 run osmo-stp_10.42.42.5(pid=29506): ERR: Terminated: ERROR {rc=1} [trial-2402↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29506)] 08:41:55.580491 run osmo-stp_10.42.42.5(pid=29506): stdout: | (launched: 2022-12-14_08:41:54.154807) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:41:55.716189 run osmo-stp_10.42.42.5(pid=29506): stderr: | 20221214084154347 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214084154347 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214084154347 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214084154348 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214084154348 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214084154348 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214084154348 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:41:55.851765 run osmo-stp_10.42.42.5(pid=29506): stdout: | (launched: 2022-12-14_08:41:54.154807) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:41:55.982196 run osmo-stp_10.42.42.5(pid=29506): stderr: | 20221214084154347 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214084154347 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214084154347 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214084154348 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214084154348 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214084154348 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214084154348 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:41:56.136612 run patchelf(pid=29509): Terminating (SIGINT) 08:41:56.314686 run patchelf(pid=29509): Terminated: ok {rc=0} 08:41:56.442503 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=29506): Process ended prematurely: osmo-stp_10.42.42.5(pid=29506) [trial-2402↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29506)] [trial-2402↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22] 08:41:56.452287 tst ping.py:22: Test FAILED (6.6 sec) 08:41:56.480375 run osmo-hlr_10.42.42.2(pid=29503): ERR: Terminated: ERROR {rc=237} [trial-2402↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29503)] 08:41:56.531215 run osmo-hlr_10.42.42.2(pid=29503): stdout: | (launched: 2022-12-14_08:41:53.167278) 08:41:56.583346 run osmo-hlr_10.42.42.2(pid=29503): stderr: | 20221214084153365 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214084153365 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214084153365 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214084153365 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214084153365 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214084153365 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214084153380 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/gprs:oc2g+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214084153391 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214084153391 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214084153391 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:41:56.635963 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29502): Terminating (SIGTERM) 08:41:56.678238 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29505): Terminating (SIGTERM) 08:41:56.720519 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29508): Terminating (SIGTERM) 08:41:56.762948 --- ParallelTerminationStrategy: PID 29502 died... 08:41:56.783021 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29502): Terminated: ok {rc=0} 08:41:56.829729 --- ParallelTerminationStrategy: PID 29505 died... 08:41:56.849383 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29505): Terminated: ok {rc=0} 08:41:56.895792 --- ParallelTerminationStrategy: PID 29508 died... 08:41:56.915409 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29508): Terminated: ok {rc=0} 08:41:57.003399 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2402 gprs:oc2g+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 08:41:58.088938 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:41:58.101097 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 08:41:58.161456 tst ping_idle_ping.py: using LAC 39733 08:41:58.289216 tst ping_idle_ping.py: using RAC 208 08:41:58.407836 tst ping_idle_ping.py: using CellId 39733 08:41:58.529432 tst ping_idle_ping.py: using BVCI 39734 08:41:58.639157 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:41:58.650188 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:41:58.660940 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:41:58.671771 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:41:58.682990 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:41:58.694092 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:41:58.705426 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:41:58.716409 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 08:41:58.831162 tst ping_idle_ping.py:24: start network... 08:41:59.029012 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:41:59.491978 run create_hlr_db(pid=29510): Launched 08:41:59.605384 bus /gobi_6: Setting Powered False 08:42:00.665427 run create_hlr_db(pid=29510): Terminated: ok {rc=0} 08:42:01.156173 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29514): Launched 08:42:01.486332 run osmo-hlr_10.42.42.2(pid=29515): Launched 08:42:01.634925 run osmo-stp_10.42.42.5: Starting osmo-stp 08:42:02.405709 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29517): Launched 08:42:02.709583 run osmo-stp_10.42.42.5(pid=29518): Launched 08:42:02.823302 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:42:03.338647 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29520): Launched 08:42:03.482454 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:42:03.752374 run patchelf(pid=29521): Launched 08:42:03.930900 run osmo-stp_10.42.42.5(pid=29518): ERR: Terminated: ERROR {rc=1} [trial-2402↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29518)] 08:42:04.065723 run osmo-stp_10.42.42.5(pid=29518): stdout: | (launched: 2022-12-14_08:42:02.654043) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:42:04.201992 run osmo-stp_10.42.42.5(pid=29518): stderr: | 20221214084202824 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214084202824 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214084202825 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214084202825 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214084202826 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214084202826 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214084202826 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:42:04.339067 run osmo-stp_10.42.42.5(pid=29518): stdout: | (launched: 2022-12-14_08:42:02.654043) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:42:04.469468 run osmo-stp_10.42.42.5(pid=29518): stderr: | 20221214084202824 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214084202824 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214084202825 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214084202825 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214084202826 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214084202826 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214084202826 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:42:04.624722 run patchelf(pid=29521): Terminating (SIGINT) 08:42:04.801878 run patchelf(pid=29521): Terminated: ok {rc=0} 08:42:04.929659 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=29518): Process ended prematurely: osmo-stp_10.42.42.5(pid=29518) [trial-2402↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29518)] [trial-2402↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 08:42:04.939232 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 08:42:04.967336 run osmo-hlr_10.42.42.2(pid=29515): ERR: Terminated: ERROR {rc=237} [trial-2402↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29515)] 08:42:05.017710 run osmo-hlr_10.42.42.2(pid=29515): stdout: | (launched: 2022-12-14_08:42:01.426226) 08:42:05.070135 run osmo-hlr_10.42.42.2(pid=29515): stderr: | 20221214084201742 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214084201742 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214084201742 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214084201742 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214084201742 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214084201743 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214084201756 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/gprs:oc2g+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214084201772 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214084201772 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214084201772 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:42:05.122527 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29514): Terminating (SIGTERM) 08:42:05.164625 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29517): Terminating (SIGTERM) 08:42:05.206955 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29520): Terminating (SIGTERM) 08:42:05.249209 --- ParallelTerminationStrategy: PID 29514 died... 08:42:05.269342 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29514): Terminated: ok {rc=0} 08:42:05.316205 --- ParallelTerminationStrategy: PID 29517 died... 08:42:05.335953 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29517): Terminated: ok {rc=0} 08:42:05.382714 --- ParallelTerminationStrategy: PID 29520 died... 08:42:05.402589 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29520): Terminated: ok {rc=0} 08:42:05.492169 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2402 gprs:oc2g+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 gprs:oc2g+mod-bts0-dynts-osmo --------------------------------------------------------------------- 08:42:06.783195 tst gprs:oc2g+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:42:06.789345 tst gprs:oc2g+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 08:42:06.809555 tst gprs:oc2g+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 08:42:06.848327 tst gprs:oc2g+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 08:42:06.933336 tst gprs:oc2g+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 08:42:06.953593 tst gprs:oc2g+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 08:42:06.991458 tst gprs:oc2g+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 08:42:07.585136 tst gprs:oc2g+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2402 gprs:oc2g+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 08:42:07.633543 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:42:07.644227 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 08:42:07.700421 tst cs_paging_gprs_active.py: using LAC 39734 08:42:07.830958 tst cs_paging_gprs_active.py: using RAC 209 08:42:07.958444 tst cs_paging_gprs_active.py: using CellId 39734 08:42:08.077838 tst cs_paging_gprs_active.py: using BVCI 39735 08:42:08.188691 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:42:08.199770 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:42:08.210519 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:42:08.221076 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:42:08.231745 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:42:08.243109 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:42:08.254517 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:42:08.265374 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:42:08.276293 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 08:42:08.395442 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 08:42:08.512606 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 08:42:08.715845 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:42:09.019129 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29525): Launched 08:42:09.284095 run iperf3-srv_10.42.42.10(pid=29526): Launched 08:42:09.397811 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 08:42:09.600003 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:42:09.903718 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29527): Launched 08:42:10.167632 run iperf3-srv_10.42.42.10(pid=29528): Launched 08:42:10.281371 tst cs_paging_gprs_active.py:38: start network... 08:42:10.484379 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:42:10.955099 run create_hlr_db(pid=29529): Launched 08:42:11.069841 bus /gobi_6: Setting Powered False 08:42:12.129266 run create_hlr_db(pid=29529): Terminated: ok {rc=0} 08:42:12.570574 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29531): Launched 08:42:12.895199 run osmo-hlr_10.42.42.2(pid=29532): Launched 08:42:13.020159 run osmo-stp_10.42.42.5: Starting osmo-stp 08:42:13.580892 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29534): Launched 08:42:13.903790 run osmo-stp_10.42.42.5(pid=29535): Launched 08:42:14.027054 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:42:14.586457 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29537): Launched 08:42:14.710833 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:42:14.983576 run patchelf(pid=29538): Launched 08:42:15.164292 run osmo-stp_10.42.42.5(pid=29535): ERR: Terminated: ERROR {rc=1} [trial-2402↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29535)] 08:42:15.300788 run osmo-stp_10.42.42.5(pid=29535): stdout: | (launched: 2022-12-14_08:42:13.844376) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:42:15.438555 run osmo-stp_10.42.42.5(pid=29535): stderr: | 20221214084214035 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214084214035 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214084214035 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214084214036 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214084214036 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214084214037 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214084214037 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:42:15.577288 run osmo-stp_10.42.42.5(pid=29535): stdout: | (launched: 2022-12-14_08:42:13.844376) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:42:15.709679 run osmo-stp_10.42.42.5(pid=29535): stderr: | 20221214084214035 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214084214035 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214084214035 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214084214036 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214084214036 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214084214037 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214084214037 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:42:15.876635 run patchelf(pid=29538): Terminating (SIGINT) 08:42:16.051731 run patchelf(pid=29538): Terminated: ok {rc=0} 08:42:16.179717 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=29535): Process ended prematurely: osmo-stp_10.42.42.5(pid=29535) [trial-2402↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29535)] [trial-2402↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 08:42:16.190677 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 08:42:16.219225 run osmo-hlr_10.42.42.2(pid=29532): ERR: Terminated: ERROR {rc=237} [trial-2402↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29532)] 08:42:16.272074 run osmo-hlr_10.42.42.2(pid=29532): stdout: | (launched: 2022-12-14_08:42:12.836055) 08:42:16.324059 run osmo-hlr_10.42.42.2(pid=29532): stderr: | 20221214084213032 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214084213032 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214084213032 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214084213032 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214084213032 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214084213032 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214084213045 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/gprs:oc2g+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214084213054 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214084213054 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214084213055 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:42:16.378544 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29525): Terminating (SIGTERM) 08:42:16.420590 run iperf3-srv_10.42.42.10(pid=29526): Terminating (SIGTERM) 08:42:16.465203 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29527): Terminating (SIGTERM) 08:42:16.508660 run iperf3-srv_10.42.42.10(pid=29528): Terminating (SIGTERM) 08:42:16.552561 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29531): Terminating (SIGTERM) 08:42:16.596044 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29534): Terminating (SIGTERM) 08:42:16.640703 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29537): Terminating (SIGTERM) 08:42:16.686216 --- ParallelTerminationStrategy: PID 29525 died... 08:42:16.707391 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29525): Terminated: ok {rc=0} 08:42:16.755499 --- ParallelTerminationStrategy: PID 29526 died... 08:42:16.776034 run iperf3-srv_10.42.42.10(pid=29526): Terminated {rc=256} 08:42:16.822220 --- ParallelTerminationStrategy: PID 29527 died... 08:42:16.842953 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29527): Terminated: ok {rc=0} 08:42:16.889623 --- ParallelTerminationStrategy: PID 29528 died... 08:42:16.910329 run iperf3-srv_10.42.42.10(pid=29528): Terminated {rc=256} 08:42:16.956773 --- ParallelTerminationStrategy: PID 29531 died... 08:42:16.978024 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29531): Terminated: ok {rc=0} 08:42:17.024419 --- ParallelTerminationStrategy: PID 29534 died... 08:42:17.045312 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29534): Terminated: ok {rc=0} 08:42:17.093019 --- ParallelTerminationStrategy: PID 29537 died... 08:42:17.113876 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29537): Terminated: ok {rc=0} 08:42:17.203179 bus /gobi_0: Setting Powered False 08:42:18.301384 bus /gobi_0: Setting Powered False 08:42:19.414954 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2402 gprs:oc2g+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 08:42:20.559712 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:42:20.571212 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 08:42:20.630706 tst iperf3.py: using LAC 39735 08:42:20.750356 tst iperf3.py: using RAC 210 08:42:20.870353 tst iperf3.py: using CellId 39735 08:42:20.990155 tst iperf3.py: using BVCI 39736 08:42:21.101491 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:42:21.112332 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:42:21.122933 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:42:21.133510 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:42:21.144270 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:42:21.155704 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:42:21.166716 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:42:21.177912 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:42:21.188841 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 08:42:21.304200 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 08:42:21.505778 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:42:21.807812 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29539): Launched 08:42:22.069759 run iperf3-srv_10.42.42.10(pid=29540): Launched 08:42:22.182926 tst iperf3.py:8: start network... 08:42:22.383461 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:42:22.853663 run create_hlr_db(pid=29541): Launched 08:42:22.969272 bus /gobi_6: Setting Powered False 08:42:24.029872 run create_hlr_db(pid=29541): Terminated: ok {rc=0} 08:42:24.470918 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29543): Launched 08:42:24.794979 run osmo-hlr_10.42.42.2(pid=29544): Launched 08:42:24.919640 run osmo-stp_10.42.42.5: Starting osmo-stp 08:42:25.475619 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29546): Launched 08:42:25.799891 run osmo-stp_10.42.42.5(pid=29547): Launched 08:42:25.922776 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:42:26.479553 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29549): Launched 08:42:26.603631 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:42:26.876094 run patchelf(pid=29550): Launched 08:42:27.054601 run osmo-stp_10.42.42.5(pid=29547): ERR: Terminated: ERROR {rc=1} [trial-2402↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29547)] 08:42:27.190521 run osmo-stp_10.42.42.5(pid=29547): stdout: | (launched: 2022-12-14_08:42:25.740565) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:42:27.327886 run osmo-stp_10.42.42.5(pid=29547): stderr: | 20221214084225932 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214084225932 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214084225933 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214084225933 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214084225934 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214084225934 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214084225934 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:42:27.466388 run osmo-stp_10.42.42.5(pid=29547): stdout: | (launched: 2022-12-14_08:42:25.740565) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:42:27.598940 run osmo-stp_10.42.42.5(pid=29547): stderr: | 20221214084225932 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214084225932 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214084225933 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214084225933 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214084225934 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214084225934 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214084225934 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:42:27.755188 run patchelf(pid=29550): Terminating (SIGINT) 08:42:27.934522 run patchelf(pid=29550): Terminated: ok {rc=0} 08:42:28.063773 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29547): Process ended prematurely: osmo-stp_10.42.42.5(pid=29547) [trial-2402↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29547)] [trial-2402↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8] 08:42:28.074154 tst iperf3.py:8: Test FAILED (7.5 sec) 08:42:28.102364 run osmo-hlr_10.42.42.2(pid=29544): ERR: Terminated: ERROR {rc=237} [trial-2402↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29544)] 08:42:28.152187 run osmo-hlr_10.42.42.2(pid=29544): stdout: | (launched: 2022-12-14_08:42:24.736011) 08:42:28.203959 run osmo-hlr_10.42.42.2(pid=29544): stderr: | 20221214084224932 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214084224932 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214084224932 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214084224932 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214084224932 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214084224932 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214084224949 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/gprs:oc2g+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214084224958 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214084224959 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214084224959 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:42:28.255954 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29539): Terminating (SIGTERM) 08:42:28.297339 run iperf3-srv_10.42.42.10(pid=29540): Terminating (SIGTERM) 08:42:28.339214 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29543): Terminating (SIGTERM) 08:42:28.380618 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29546): Terminating (SIGTERM) 08:42:28.421982 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29549): Terminating (SIGTERM) 08:42:28.463656 --- ParallelTerminationStrategy: PID 29539 died... 08:42:28.483565 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29539): Terminated: ok {rc=0} 08:42:28.529652 --- ParallelTerminationStrategy: PID 29540 died... 08:42:28.548851 run iperf3-srv_10.42.42.10(pid=29540): Terminated {rc=256} 08:42:28.594657 --- ParallelTerminationStrategy: PID 29543 died... 08:42:28.614008 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29543): Terminated: ok {rc=0} 08:42:28.659366 --- ParallelTerminationStrategy: PID 29546 died... 08:42:28.678704 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29546): Terminated: ok {rc=0} 08:42:28.724197 --- ParallelTerminationStrategy: PID 29549 died... 08:42:28.743663 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29549): Terminated: ok {rc=0} 08:42:28.831501 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2402 gprs:oc2g+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 08:42:29.980197 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:42:29.992354 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 08:42:30.051278 tst iperf3m4.py: using LAC 39736 08:42:30.180576 tst iperf3m4.py: using RAC 211 08:42:30.305191 tst iperf3m4.py: using CellId 39736 08:42:30.424411 tst iperf3m4.py: using BVCI 39737 08:42:30.535349 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:42:30.546568 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:42:30.557481 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:42:30.568305 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:42:30.579604 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:42:30.590563 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:42:30.601671 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:42:30.612475 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:42:30.623577 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 08:42:30.743493 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 08:42:30.874995 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 08:42:31.014182 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 08:42:31.154075 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 08:42:31.413289 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:42:31.728437 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29551): Launched 08:42:32.008457 run iperf3-srv_10.42.42.10(pid=29552): Launched 08:42:32.140292 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 08:42:32.345605 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:42:32.650176 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29553): Launched 08:42:32.915269 run iperf3-srv_10.42.42.10(pid=29554): Launched 08:42:33.029076 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 08:42:33.230976 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:42:33.534893 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29555): Launched 08:42:33.798282 run iperf3-srv_10.42.42.10(pid=29556): Launched 08:42:33.914416 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 08:42:34.116213 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:42:34.420127 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29557): Launched 08:42:34.684092 run iperf3-srv_10.42.42.10(pid=29558): Launched 08:42:34.797900 tst iperf3m4.py:8: start network... 08:42:34.999374 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:42:35.469182 run create_hlr_db(pid=29559): Launched 08:42:35.585249 bus /gobi_6: Setting Powered False 08:42:36.645739 run create_hlr_db(pid=29559): Terminated: ok {rc=0} 08:42:37.087284 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29561): Launched 08:42:37.411463 run osmo-hlr_10.42.42.2(pid=29562): Launched 08:42:37.536918 run osmo-stp_10.42.42.5: Starting osmo-stp 08:42:38.096021 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29564): Launched 08:42:38.420780 run osmo-stp_10.42.42.5(pid=29565): Launched 08:42:38.543855 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:42:39.100887 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29567): Launched 08:42:39.225153 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:42:39.497654 run patchelf(pid=29568): Launched 08:42:39.678089 run osmo-stp_10.42.42.5(pid=29565): ERR: Terminated: ERROR {rc=1} [trial-2402↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29565)] 08:42:39.814442 run osmo-stp_10.42.42.5(pid=29565): stdout: | (launched: 2022-12-14_08:42:38.360381) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:42:39.952303 run osmo-stp_10.42.42.5(pid=29565): stderr: | 20221214084238551 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214084238551 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214084238551 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214084238552 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214084238552 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214084238552 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214084238552 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:42:40.090637 run osmo-stp_10.42.42.5(pid=29565): stdout: | (launched: 2022-12-14_08:42:38.360381) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:42:40.222800 run osmo-stp_10.42.42.5(pid=29565): stderr: | 20221214084238551 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214084238551 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214084238551 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214084238552 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214084238552 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214084238552 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214084238552 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:42:40.379395 run patchelf(pid=29568): Terminating (SIGINT) 08:42:40.559811 run patchelf(pid=29568): Terminated: ok {rc=0} 08:42:40.689659 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29565): Process ended prematurely: osmo-stp_10.42.42.5(pid=29565) [trial-2402↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29565)] [trial-2402↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8] 08:42:40.700024 tst iperf3m4.py:8: Test FAILED (10.8 sec) 08:42:40.729010 run osmo-hlr_10.42.42.2(pid=29562): ERR: Terminated: ERROR {rc=237} [trial-2402↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29562)] 08:42:40.779689 run osmo-hlr_10.42.42.2(pid=29562): stdout: | (launched: 2022-12-14_08:42:37.351936) 08:42:40.832000 run osmo-hlr_10.42.42.2(pid=29562): stderr: | 20221214084237547 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214084237548 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214084237548 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214084237548 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214084237548 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214084237548 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214084237560 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/gprs:oc2g+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214084237569 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214084237569 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214084237569 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:42:40.884752 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29551): Terminating (SIGTERM) 08:42:40.926694 run iperf3-srv_10.42.42.10(pid=29552): Terminating (SIGTERM) 08:42:40.969042 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29553): Terminating (SIGTERM) 08:42:41.011089 run iperf3-srv_10.42.42.10(pid=29554): Terminating (SIGTERM) 08:42:41.053679 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29555): Terminating (SIGTERM) 08:42:41.096102 run iperf3-srv_10.42.42.10(pid=29556): Terminating (SIGTERM) 08:42:41.138411 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29557): Terminating (SIGTERM) 08:42:41.180227 run iperf3-srv_10.42.42.10(pid=29558): Terminating (SIGTERM) 08:42:41.222322 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29561): Terminating (SIGTERM) 08:42:41.264823 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29564): Terminating (SIGTERM) 08:42:41.307215 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29567): Terminating (SIGTERM) 08:42:41.349803 --- ParallelTerminationStrategy: PID 29551 died... 08:42:41.369851 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29551): Terminated: ok {rc=0} 08:42:41.415960 --- ParallelTerminationStrategy: PID 29552 died... 08:42:41.435425 run iperf3-srv_10.42.42.10(pid=29552): Terminated {rc=256} 08:42:41.481287 --- ParallelTerminationStrategy: PID 29553 died... 08:42:41.500678 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29553): Terminated: ok {rc=0} 08:42:41.547210 --- ParallelTerminationStrategy: PID 29554 died... 08:42:41.566676 run iperf3-srv_10.42.42.10(pid=29554): Terminated {rc=256} 08:42:41.612629 --- ParallelTerminationStrategy: PID 29555 died... 08:42:41.632029 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29555): Terminated: ok {rc=0} 08:42:41.677653 --- ParallelTerminationStrategy: PID 29556 died... 08:42:41.696886 run iperf3-srv_10.42.42.10(pid=29556): Terminated {rc=256} 08:42:41.742571 --- ParallelTerminationStrategy: PID 29557 died... 08:42:41.761982 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29557): Terminated: ok {rc=0} 08:42:41.807908 --- ParallelTerminationStrategy: PID 29558 died... 08:42:41.827451 run iperf3-srv_10.42.42.10(pid=29558): Terminated {rc=256} 08:42:41.873281 --- ParallelTerminationStrategy: PID 29561 died... 08:42:41.893151 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29561): Terminated: ok {rc=0} 08:42:41.939212 --- ParallelTerminationStrategy: PID 29564 died... 08:42:41.958811 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29564): Terminated: ok {rc=0} 08:42:42.004758 --- ParallelTerminationStrategy: PID 29567 died... 08:42:42.024366 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29567): Terminated: ok {rc=0} 08:42:42.110898 bus /gobi_4: Setting Powered False 08:42:43.210976 bus /gobi_4: Setting Powered False 08:42:44.326818 bus /gobi_1: Setting Powered False 08:42:45.425451 bus /gobi_1: Setting Powered False 08:42:46.541110 bus /gobi_0: Setting Powered False 08:42:47.639848 bus /gobi_0: Setting Powered False 08:42:48.758334 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2402 gprs:oc2g+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 08:42:49.861309 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:42:49.873023 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 08:42:49.930465 tst ping.py: using LAC 39737 08:42:50.049982 tst ping.py: using RAC 212 08:42:50.166593 tst ping.py: using CellId 39737 08:42:50.287439 tst ping.py: using BVCI 39738 08:42:50.403898 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:42:50.415554 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:42:50.426975 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:42:50.438499 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:42:50.450470 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:42:50.462061 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:42:50.473807 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:42:50.485378 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 08:42:50.602006 tst ping.py:19: start network... 08:42:50.801384 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:42:51.260885 run create_hlr_db(pid=29569): Launched 08:42:51.374545 bus /gobi_6: Setting Powered False 08:42:52.434141 run create_hlr_db(pid=29569): Terminated: ok {rc=0} 08:42:52.870103 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29571): Launched 08:42:53.189468 run osmo-hlr_10.42.42.2(pid=29572): Launched 08:42:53.311188 run osmo-stp_10.42.42.5: Starting osmo-stp 08:42:53.864408 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29574): Launched 08:42:54.181936 run osmo-stp_10.42.42.5(pid=29575): Launched 08:42:54.302539 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:42:54.851444 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29577): Launched 08:42:54.973745 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:42:55.242592 run patchelf(pid=29578): Launched 08:42:55.419736 run osmo-stp_10.42.42.5(pid=29575): ERR: Terminated: ERROR {rc=1} [trial-2402↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29575)] 08:42:55.554398 run osmo-stp_10.42.42.5(pid=29575): stdout: | (launched: 2022-12-14_08:42:54.123209) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:42:55.690648 run osmo-stp_10.42.42.5(pid=29575): stderr: | 20221214084254315 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214084254315 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214084254315 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214084254316 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214084254316 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214084254316 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214084254316 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:42:55.825974 run osmo-stp_10.42.42.5(pid=29575): stdout: | (launched: 2022-12-14_08:42:54.123209) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:42:55.955913 run osmo-stp_10.42.42.5(pid=29575): stderr: | 20221214084254315 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214084254315 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214084254315 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214084254316 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214084254316 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214084254316 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214084254316 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:42:56.109994 run patchelf(pid=29578): Terminating (SIGINT) 08:42:56.286491 run patchelf(pid=29578): Terminated: ok {rc=0} 08:42:56.413649 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=29575): Process ended prematurely: osmo-stp_10.42.42.5(pid=29575) [trial-2402↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29575)] [trial-2402↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22] 08:42:56.423337 tst ping.py:22: Test FAILED (6.6 sec) 08:42:56.451475 run osmo-hlr_10.42.42.2(pid=29572): ERR: Terminated: ERROR {rc=237} [trial-2402↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29572)] 08:42:56.501761 run osmo-hlr_10.42.42.2(pid=29572): stdout: | (launched: 2022-12-14_08:42:53.130953) 08:42:56.554211 run osmo-hlr_10.42.42.2(pid=29572): stderr: | 20221214084253329 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214084253329 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214084253330 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214084253330 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214084253330 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214084253330 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214084253342 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/gprs:oc2g+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214084253350 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214084253350 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214084253350 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:42:56.606690 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29571): Terminating (SIGTERM) 08:42:56.648828 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29574): Terminating (SIGTERM) 08:42:56.691161 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29577): Terminating (SIGTERM) 08:42:56.733700 --- ParallelTerminationStrategy: PID 29571 died... 08:42:56.753792 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29571): Terminated: ok {rc=0} 08:42:56.800382 --- ParallelTerminationStrategy: PID 29574 died... 08:42:56.820025 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29574): Terminated: ok {rc=0} 08:42:56.866313 --- ParallelTerminationStrategy: PID 29577 died... 08:42:56.885988 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29577): Terminated: ok {rc=0} 08:42:56.974106 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2402 gprs:oc2g+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 08:42:58.062076 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:42:58.074652 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 08:42:58.135661 tst ping_idle_ping.py: using LAC 39738 08:42:58.261815 tst ping_idle_ping.py: using RAC 213 08:42:58.386593 tst ping_idle_ping.py: using CellId 39738 08:42:58.513511 tst ping_idle_ping.py: using BVCI 39739 08:42:58.629333 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:42:58.640741 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:42:58.652122 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:42:58.663501 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:42:58.674771 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:42:58.685957 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:42:58.697400 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:42:58.708818 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 08:42:58.827473 tst ping_idle_ping.py:24: start network... 08:42:59.040506 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:42:59.540162 run create_hlr_db(pid=29579): Launched 08:42:59.670762 bus /gobi_6: Setting Powered False 08:43:00.733674 run create_hlr_db(pid=29579): Terminated: ok {rc=0} 08:43:01.185649 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29581): Launched 08:43:01.510357 run osmo-hlr_10.42.42.2(pid=29582): Launched 08:43:01.663690 run osmo-stp_10.42.42.5: Starting osmo-stp 08:43:02.423465 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29584): Launched 08:43:02.722673 run osmo-stp_10.42.42.5(pid=29585): Launched 08:43:02.837396 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:43:03.351881 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29587): Launched 08:43:03.466617 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:43:03.719003 run patchelf(pid=29588): Launched 08:43:03.884907 run osmo-stp_10.42.42.5(pid=29585): ERR: Terminated: ERROR {rc=1} [trial-2402↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29585)] 08:43:04.011762 run osmo-stp_10.42.42.5(pid=29585): stdout: | (launched: 2022-12-14_08:43:02.667704) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:43:04.140087 run osmo-stp_10.42.42.5(pid=29585): stderr: | 20221214084302838 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214084302838 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214084302838 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214084302838 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214084302839 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214084302839 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214084302839 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:43:04.268745 run osmo-stp_10.42.42.5(pid=29585): stdout: | (launched: 2022-12-14_08:43:02.667704) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:43:04.391601 run osmo-stp_10.42.42.5(pid=29585): stderr: | 20221214084302838 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214084302838 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214084302838 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214084302838 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214084302839 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214084302839 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214084302839 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:43:04.537381 run patchelf(pid=29588): Terminating (SIGINT) 08:43:04.703839 run patchelf(pid=29588): Terminated: ok {rc=0} 08:43:04.824456 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=29585): Process ended prematurely: osmo-stp_10.42.42.5(pid=29585) [trial-2402↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29585)] [trial-2402↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 08:43:04.833503 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 08:43:04.859886 run osmo-hlr_10.42.42.2(pid=29582): ERR: Terminated: ERROR {rc=237} [trial-2402↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29582)] 08:43:04.907907 run osmo-hlr_10.42.42.2(pid=29582): stdout: | (launched: 2022-12-14_08:43:01.453691) 08:43:04.957554 run osmo-hlr_10.42.42.2(pid=29582): stderr: | 20221214084301803 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214084301803 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214084301803 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214084301803 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214084301803 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214084301804 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214084301823 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/gprs:oc2g+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214084301831 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214084301832 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214084301832 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:43:05.007424 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29581): Terminating (SIGTERM) 08:43:05.047123 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29584): Terminating (SIGTERM) 08:43:05.086885 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29587): Terminating (SIGTERM) 08:43:05.126759 --- ParallelTerminationStrategy: PID 29581 died... 08:43:05.146090 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29581): Terminated: ok {rc=0} 08:43:05.189894 --- ParallelTerminationStrategy: PID 29584 died... 08:43:05.208469 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29584): Terminated: ok {rc=0} 08:43:05.252643 --- ParallelTerminationStrategy: PID 29587 died... 08:43:05.271732 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29587): Terminated: ok {rc=0} 08:43:05.356847 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2402 gprs:oc2g+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 08:43:06.642740 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:43:06.649504 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 08:43:06.669773 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 08:43:06.705132 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 08:43:06.757487 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 08:43:06.778147 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 08:43:06.812885 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 08:43:07.368517 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2402 dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 08:43:07.373971 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 08:43:07.385305 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 08:43:07.442942 tst switch_tch_pdch.py: using LAC 39739 08:43:07.564916 tst switch_tch_pdch.py: using RAC 214 08:43:07.681678 tst switch_tch_pdch.py: using CellId 39739 08:43:07.798256 tst switch_tch_pdch.py: using BVCI 39740 08:43:07.908548 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 08:43:07.919890 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 08:43:07.930949 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 08:43:07.942081 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 08:43:07.953402 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 08:43:07.964721 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 08:43:07.976002 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 08:43:07.987331 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 08:43:08.107246 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 08:43:08.226924 tst switch_tch_pdch.py:51: start network... 08:43:08.439193 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:43:08.931763 run create_hlr_db(pid=29592): Launched 08:43:09.063303 bus /gobi_6: Setting Powered False 08:43:10.125996 run create_hlr_db(pid=29592): Terminated: ok {rc=0} 08:43:10.551264 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29594): Launched 08:43:10.850244 run osmo-hlr_10.42.42.2(pid=29595): Launched 08:43:10.963273 run osmo-stp_10.42.42.5: Starting osmo-stp 08:43:11.512462 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29597): Launched 08:43:11.830156 run osmo-stp_10.42.42.5(pid=29598): Launched 08:43:11.950261 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:43:12.495752 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29600): Launched 08:43:12.617379 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:43:12.884703 run patchelf(pid=29601): Launched 08:43:13.059753 run osmo-stp_10.42.42.5(pid=29598): ERR: Terminated: ERROR {rc=1} [trial-2402↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29598)] 08:43:13.194220 run osmo-stp_10.42.42.5(pid=29598): stdout: | (launched: 2022-12-14_08:43:11.771739) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:43:13.329232 run osmo-stp_10.42.42.5(pid=29598): stderr: | 20221214084311964 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214084311964 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214084311964 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214084311965 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214084311965 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214084311965 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214084311965 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:43:13.464485 run osmo-stp_10.42.42.5(pid=29598): stdout: | (launched: 2022-12-14_08:43:11.771739) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:43:13.594682 run osmo-stp_10.42.42.5(pid=29598): stderr: | 20221214084311964 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214084311964 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214084311964 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214084311965 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214084311965 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214084311965 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214084311965 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:43:13.748532 run patchelf(pid=29601): Terminating (SIGINT) 08:43:13.924742 run patchelf(pid=29601): Terminated: ok {rc=0} 08:43:14.051758 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=29598): Process ended prematurely: osmo-stp_10.42.42.5(pid=29598) [trial-2402↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29598)] [trial-2402↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 08:43:14.061802 tst switch_tch_pdch.py:54: Test FAILED (6.7 sec) 08:43:14.089857 run osmo-hlr_10.42.42.2(pid=29595): ERR: Terminated: ERROR {rc=237} [trial-2402↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29595)] 08:43:14.139707 run osmo-hlr_10.42.42.2(pid=29595): stdout: | (launched: 2022-12-14_08:43:10.794365) 08:43:14.191547 run osmo-hlr_10.42.42.2(pid=29595): stderr: | 20221214084310969 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214084310970 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214084310970 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214084310970 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214084310970 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214084310970 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214084310982 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214084310991 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214084310991 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214084310991 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:43:14.243540 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29594): Terminating (SIGTERM) 08:43:14.285213 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29597): Terminating (SIGTERM) 08:43:14.326734 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29600): Terminating (SIGTERM) 08:43:14.368326 --- ParallelTerminationStrategy: PID 29594 died... 08:43:14.388282 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29594): Terminated: ok {rc=0} 08:43:14.434279 --- ParallelTerminationStrategy: PID 29597 died... 08:43:14.453610 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29597): Terminated: ok {rc=0} 08:43:14.499002 --- ParallelTerminationStrategy: PID 29600 died... 08:43:14.518333 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29600): Terminated: ok {rc=0} 08:43:14.605286 bus /gobi_0: Setting Powered False 08:43:15.701544 bus /gobi_0: Setting Powered False 08:43:16.827275 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2402 dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 dynts:oc2g+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 08:43:18.082815 tst dynts:oc2g+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:43:18.089002 tst dynts:oc2g+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 08:43:18.110174 tst dynts:oc2g+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 08:43:18.145565 tst dynts:oc2g+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 08:43:18.201968 tst dynts:oc2g+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 08:43:18.222776 tst dynts:oc2g+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 08:43:18.257641 tst dynts:oc2g+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 08:43:18.808886 tst dynts:oc2g+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2402 dynts:oc2g+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 08:43:18.814316 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 08:43:18.825408 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 08:43:18.882162 tst switch_tch_pdch.py: using LAC 39740 08:43:19.001220 tst switch_tch_pdch.py: using RAC 215 08:43:19.126198 tst switch_tch_pdch.py: using CellId 39740 08:43:19.250336 tst switch_tch_pdch.py: using BVCI 39741 08:43:19.367421 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 08:43:19.379037 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 08:43:19.390353 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 08:43:19.401477 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 08:43:19.412439 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 08:43:19.423573 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 08:43:19.434954 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 08:43:19.446119 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 08:43:19.562434 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 08:43:19.680362 tst switch_tch_pdch.py:51: start network... 08:43:19.892787 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:43:20.356380 run create_hlr_db(pid=29605): Launched 08:43:20.485596 bus /gobi_6: Setting Powered False 08:43:21.548918 run create_hlr_db(pid=29605): Terminated: ok {rc=0} 08:43:21.963014 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29607): Launched 08:43:22.280519 run osmo-hlr_10.42.42.2(pid=29608): Launched 08:43:22.400874 run osmo-stp_10.42.42.5: Starting osmo-stp 08:43:22.917720 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29610): Launched 08:43:23.234440 run osmo-stp_10.42.42.5(pid=29611): Launched 08:43:23.356219 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:43:23.873774 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29613): Launched 08:43:23.993984 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:43:24.261827 run patchelf(pid=29614): Launched 08:43:24.437937 run osmo-stp_10.42.42.5(pid=29611): ERR: Terminated: ERROR {rc=1} [trial-2402↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29611)] 08:43:24.571822 run osmo-stp_10.42.42.5(pid=29611): stdout: | (launched: 2022-12-14_08:43:23.176390) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:43:24.707102 run osmo-stp_10.42.42.5(pid=29611): stderr: | 20221214084323367 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214084323367 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214084323367 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214084323368 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214084323368 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214084323368 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214084323368 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:43:24.842238 run osmo-stp_10.42.42.5(pid=29611): stdout: | (launched: 2022-12-14_08:43:23.176390) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:43:24.972306 run osmo-stp_10.42.42.5(pid=29611): stderr: | 20221214084323367 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214084323367 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214084323367 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214084323368 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214084323368 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214084323368 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214084323368 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:43:25.125564 run patchelf(pid=29614): Terminating (SIGINT) 08:43:25.301066 run patchelf(pid=29614): Terminated: ok {rc=0} 08:43:25.427673 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=29611): Process ended prematurely: osmo-stp_10.42.42.5(pid=29611) [trial-2402↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29611)] [trial-2402↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 08:43:25.437548 tst switch_tch_pdch.py:54: Test FAILED (6.6 sec) 08:43:25.465250 run osmo-hlr_10.42.42.2(pid=29608): ERR: Terminated: ERROR {rc=237} [trial-2402↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29608)] 08:43:25.515040 run osmo-hlr_10.42.42.2(pid=29608): stdout: | (launched: 2022-12-14_08:43:22.222387) 08:43:25.567018 run osmo-hlr_10.42.42.2(pid=29608): stderr: | 20221214084322419 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214084322419 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214084322419 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214084322419 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214084322419 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214084322419 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214084322431 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/dynts:oc2g+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214084322439 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214084322440 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214084322440 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:43:25.618932 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29607): Terminating (SIGTERM) 08:43:25.660717 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29610): Terminating (SIGTERM) 08:43:25.702384 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29613): Terminating (SIGTERM) 08:43:25.744018 --- ParallelTerminationStrategy: PID 29607 died... 08:43:25.763755 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29607): Terminated: ok {rc=0} 08:43:25.809758 --- ParallelTerminationStrategy: PID 29610 died... 08:43:25.829395 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29610): Terminated: ok {rc=0} 08:43:25.875557 --- ParallelTerminationStrategy: PID 29613 died... 08:43:25.895058 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29613): Terminated: ok {rc=0} 08:43:25.983274 bus /gobi_0: Setting Powered False 08:43:27.082712 bus /gobi_0: Setting Powered False 08:43:28.198532 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2402 dynts:oc2g+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 nitb_sms:trx-b200 --------------------------------------------------------------------- 08:43:29.438507 tst nitb_sms:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:43:29.443244 tst nitb_sms:trx-b200: Verifying 1 x bts (candidates: 11) 08:43:29.475834 tst nitb_sms:trx-b200: Verifying 1 x ip_address (candidates: 9) 08:43:29.483595 tst nitb_sms:trx-b200: Verifying 2 x modem (candidates: 12) 08:43:29.535876 tst nitb_sms:trx-b200: Reserving 1 x bts (candidates: 11) 08:43:29.570614 tst nitb_sms:trx-b200: Reserving 1 x ip_address (candidates: 9) 08:43:29.578123 tst nitb_sms:trx-b200: Reserving 2 x modem (candidates: 12) 08:43:30.116152 tst nitb_sms:trx-b200: RESERVED RESOURCES for nitb_sms: bts Ettus B200 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2402 nitb_sms:trx-b200 mo_mt_sms.py ---------------------------------------------- 08:43:30.122275 tst nitb_sms:trx-b200: Using 1 x ip_address (candidates: 1) 08:43:30.133737 tst nitb_sms:trx-b200: Using 1 x bts (candidates: 1) 08:43:30.186343 tst mo_mt_sms.py: using LAC 39741 08:43:30.305857 tst mo_mt_sms.py: using RAC 216 08:43:30.424774 tst mo_mt_sms.py: using CellId 39741 08:43:30.542401 tst mo_mt_sms.py: using BVCI 39742 08:43:30.650683 tst nitb_sms:trx-b200: Using 1 x modem (candidates: 2) 08:43:30.769294 tst nitb_sms:trx-b200: Using 1 x modem (candidates: 2) 08:43:30.889059 tst mo_mt_sms.py:9: start nitb and bts... 08:43:31.120427 run osmo-nitb_10.42.42.2: Starting osmo-nitb 08:43:31.781492 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=29618): Launched 08:43:32.117744 run osmo-nitb_10.42.42.2(pid=29619): Launched 08:43:32.287148 run osmo-nitb_10.42.42.2(pid=29619): ERR: Terminated: ERROR {rc=2} [trial-2402↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=29619)] 08:43:32.421558 run osmo-nitb_10.42.42.2(pid=29619): stdout: | (launched: 2022-12-14_08:43:32.055443) 08:43:32.557370 run osmo-nitb_10.42.42.2(pid=29619): stderr: | (launched: 2022-12-14_08:43:32.103725) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 08:43:32.692737 run osmo-nitb_10.42.42.2(pid=29619): stdout: | (launched: 2022-12-14_08:43:32.055443) 08:43:32.823078 run osmo-nitb_10.42.42.2(pid=29619): stderr: | (launched: 2022-12-14_08:43:32.103725) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fe4ae4b0268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=29619): Process ended prematurely: osmo-nitb_10.42.42.2(pid=29619) [trial-2402↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=29619)] 08:43:33.235026 tst osmo-nitb_10.42.42.2(pid=29619): stdout: | (launched: 2022-12-14_08:43:32.055443) 08:43:33.354984 tst osmo-nitb_10.42.42.2(pid=29619): stderr: | (launched: 2022-12-14_08:43:32.103725) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 08:43:33.496046 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=29619): Process ended prematurely: osmo-nitb_10.42.42.2(pid=29619) [trial-2402↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=29619)] [trial-2402↪nitb_sms:trx-b200↪mo_mt_sms.py:11] 08:43:33.504543 tst mo_mt_sms.py:11: Test FAILED (3.4 sec) 08:43:33.511194 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=29618): Terminating (SIGTERM) 08:43:33.720839 --- ParallelTerminationStrategy: PID 29618 died... 08:43:33.741249 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=29618): Terminated: ok {rc=0} 08:43:33.828512 bus /sierra_3: Setting Powered False 08:43:34.929019 bus /sierra_3: Setting Powered False 08:43:36.045529 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2402 nitb_sms:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 sms:trx-b200 --------------------------------------------------------------------- 08:43:37.244357 tst sms:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:43:37.248867 tst sms:trx-b200: Verifying 1 x bts (candidates: 11) 08:43:37.284153 tst sms:trx-b200: Verifying 6 x ip_address (candidates: 9) 08:43:37.312379 tst sms:trx-b200: Verifying 2 x modem (candidates: 12) 08:43:37.364579 tst sms:trx-b200: Reserving 1 x bts (candidates: 11) 08:43:37.398432 tst sms:trx-b200: Reserving 6 x ip_address (candidates: 9) 08:43:37.425753 tst sms:trx-b200: Reserving 2 x modem (candidates: 12) 08:43:37.970518 tst sms:trx-b200: RESERVED RESOURCES for sms: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2402 sms:trx-b200 mo_mt_sms.py ---------------------------------------------- 08:43:37.975624 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 08:43:37.986306 tst sms:trx-b200: Using 1 x bts (candidates: 1) 08:43:38.033696 tst mo_mt_sms.py: using LAC 39742 08:43:38.157587 tst mo_mt_sms.py: using RAC 217 08:43:38.274052 tst mo_mt_sms.py: using CellId 39742 08:43:38.391561 tst mo_mt_sms.py: using BVCI 39743 08:43:38.499137 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 08:43:38.509915 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 08:43:38.520400 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 08:43:38.530883 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 08:43:38.541640 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 08:43:38.552699 tst sms:trx-b200: Using 1 x modem (candidates: 2) 08:43:38.669553 tst sms:trx-b200: Using 1 x modem (candidates: 2) 08:43:38.787191 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:43:39.279890 run create_hlr_db(pid=29623): Launched 08:43:39.409574 bus /sierra_2: Setting Powered False 08:43:40.472866 run create_hlr_db(pid=29623): Terminated: ok {rc=0} 08:43:40.900900 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29625): Launched 08:43:41.220307 run osmo-hlr_10.42.42.2(pid=29626): Launched 08:43:41.340092 run osmo-stp_10.42.42.5: Starting osmo-stp 08:43:41.884233 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29628): Launched 08:43:42.200230 run osmo-stp_10.42.42.5(pid=29629): Launched 08:43:42.319795 run osmo-msc_10.42.42.6: Starting osmo-msc 08:43:42.892390 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29631): Launched 08:43:43.208449 run osmo-msc_10.42.42.6(pid=29632): Launched 08:43:43.383551 run osmo-stp_10.42.42.5(pid=29629): ERR: Terminated: ERROR {rc=1} [trial-2402↪sms:trx-b200↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29629)] 08:43:43.516632 run osmo-stp_10.42.42.5(pid=29629): stdout: | (launched: 2022-12-14_08:43:42.141910) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:43:43.651087 run osmo-stp_10.42.42.5(pid=29629): stderr: | 20221214084342334 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214084342334 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214084342334 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214084342335 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214084342335 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214084342335 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214084342335 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:43:43.784912 run osmo-stp_10.42.42.5(pid=29629): stdout: | (launched: 2022-12-14_08:43:42.141910) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:43:43.910401 run osmo-stp_10.42.42.5(pid=29629): stderr: | 20221214084342334 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214084342334 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214084342334 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214084342335 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214084342335 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214084342335 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214084342335 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:43:44.060579 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=29629): Process ended prematurely: osmo-stp_10.42.42.5(pid=29629) [trial-2402↪sms:trx-b200↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29629)] [trial-2402↪sms:trx-b200↪mo_mt_sms.py:16] 08:43:44.069749 tst mo_mt_sms.py:16: Test FAILED (6.1 sec) 08:43:44.097042 run osmo-hlr_10.42.42.2(pid=29626): ERR: Terminated: ERROR {rc=237} [trial-2402↪sms:trx-b200↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29626)] 08:43:44.147185 run osmo-hlr_10.42.42.2(pid=29626): stdout: | (launched: 2022-12-14_08:43:41.162362) 08:43:44.198998 run osmo-hlr_10.42.42.2(pid=29626): stderr: | 20221214084341360 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214084341360 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214084341360 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214084341360 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214084341360 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214084341360 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214084341373 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/sms:trx-b200/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214084341381 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214084341382 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214084341382 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:43:44.271014 run osmo-msc_10.42.42.6(pid=29632): ERR: Terminated: ERROR {rc=2} [trial-2402↪sms:trx-b200↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29632)] 08:43:44.320918 run osmo-msc_10.42.42.6(pid=29632): stdout: | (launched: 2022-12-14_08:43:43.150058) 08:43:44.372503 run osmo-msc_10.42.42.6(pid=29632): stderr: | 20221214084343473 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214084343473 DLGLOBAL DEBUG validating counter group 0x7efefaca8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214084343473 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214084343473 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214084343474 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214084343474 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214084343475 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214084343476 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214084343476 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214084343476 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:43:44.424591 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29625): Terminating (SIGTERM) 08:43:44.466080 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29628): Terminating (SIGTERM) 08:43:44.507776 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29631): Terminating (SIGTERM) 08:43:44.550158 --- ParallelTerminationStrategy: PID 29625 died... 08:43:44.570697 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29625): Terminated: ok {rc=0} 08:43:44.617290 --- ParallelTerminationStrategy: PID 29628 died... 08:43:44.636930 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29628): Terminated: ok {rc=0} 08:43:44.683337 --- ParallelTerminationStrategy: PID 29631 died... 08:43:44.703005 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29631): Terminated: ok {rc=0} 08:43:44.790772 bus /sierra_3: Setting Powered False 08:43:45.914208 bus /sierra_3: Setting Powered False 08:43:47.034445 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2402 sms:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 nitb_ussd:trx-b200 --------------------------------------------------------------------- 08:43:48.261999 tst nitb_ussd:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:43:48.265821 tst nitb_ussd:trx-b200: Verifying 1 x bts (candidates: 11) 08:43:48.298016 tst nitb_ussd:trx-b200: Verifying 1 x ip_address (candidates: 9) 08:43:48.306241 tst nitb_ussd:trx-b200: Verifying 1 x modem (candidates: 12) 08:43:48.341449 tst nitb_ussd:trx-b200: Reserving 1 x bts (candidates: 11) 08:43:48.374373 tst nitb_ussd:trx-b200: Reserving 1 x ip_address (candidates: 9) 08:43:48.381093 tst nitb_ussd:trx-b200: Reserving 1 x modem (candidates: 12) 08:43:48.900032 tst nitb_ussd:trx-b200: RESERVED RESOURCES for nitb_ussd: bts Ettus B200 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2402 nitb_ussd:trx-b200 assert_extension.py ---------------------------------------------- 08:43:48.907158 tst nitb_ussd:trx-b200: Using 1 x ip_address (candidates: 1) 08:43:48.919190 tst nitb_ussd:trx-b200: Using 1 x bts (candidates: 1) 08:43:48.972662 tst assert_extension.py: using LAC 39743 08:43:49.098196 tst assert_extension.py: using RAC 218 08:43:49.222032 tst assert_extension.py: using CellId 39743 08:43:49.345775 tst assert_extension.py: using BVCI 39744 08:43:49.461266 tst nitb_ussd:trx-b200: Using 1 x modem (candidates: 1) 08:43:49.574485 tst assert_extension.py:10: start nitb and bts... 08:43:49.773329 run osmo-nitb_10.42.42.2: Starting osmo-nitb 08:43:50.381690 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=29637): Launched 08:43:50.678349 run osmo-nitb_10.42.42.2(pid=29638): Launched 08:43:50.844393 run osmo-nitb_10.42.42.2(pid=29638): ERR: Terminated: ERROR {rc=2} [trial-2402↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=29638)] 08:43:50.977766 run osmo-nitb_10.42.42.2(pid=29638): stdout: | (launched: 2022-12-14_08:43:50.623381) 08:43:51.112364 run osmo-nitb_10.42.42.2(pid=29638): stderr: | (launched: 2022-12-14_08:43:50.667333) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 08:43:51.246988 run osmo-nitb_10.42.42.2(pid=29638): stdout: | (launched: 2022-12-14_08:43:50.623381) 08:43:51.376014 run osmo-nitb_10.42.42.2(pid=29638): stderr: | (launched: 2022-12-14_08:43:50.667333) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fe4ae4b0268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=29638): Process ended prematurely: osmo-nitb_10.42.42.2(pid=29638) [trial-2402↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=29638)] 08:43:51.792243 tst osmo-nitb_10.42.42.2(pid=29638): stdout: | (launched: 2022-12-14_08:43:50.623381) 08:43:51.911952 tst osmo-nitb_10.42.42.2(pid=29638): stderr: | (launched: 2022-12-14_08:43:50.667333) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 08:43:52.053206 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=29638): Process ended prematurely: osmo-nitb_10.42.42.2(pid=29638) [trial-2402↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=29638)] [trial-2402↪nitb_ussd:trx-b200↪assert_extension.py:12] 08:43:52.061556 tst assert_extension.py:12: Test FAILED (3.1 sec) 08:43:52.068122 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=29637): Terminating (SIGTERM) 08:43:52.278271 --- ParallelTerminationStrategy: PID 29637 died... 08:43:52.299163 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=29637): Terminated: ok {rc=0} 08:43:52.386905 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2402 nitb_ussd:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 ussd:trx-b200 --------------------------------------------------------------------- 08:43:53.566902 tst ussd:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:43:53.570956 tst ussd:trx-b200: Verifying 1 x bts (candidates: 11) 08:43:53.603753 tst ussd:trx-b200: Verifying 6 x ip_address (candidates: 9) 08:43:53.631564 tst ussd:trx-b200: Verifying 1 x modem (candidates: 12) 08:43:53.664663 tst ussd:trx-b200: Reserving 1 x bts (candidates: 11) 08:43:53.698012 tst ussd:trx-b200: Reserving 6 x ip_address (candidates: 9) 08:43:53.724494 tst ussd:trx-b200: Reserving 1 x modem (candidates: 12) 08:43:54.256315 tst ussd:trx-b200: RESERVED RESOURCES for ussd: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2402 ussd:trx-b200 assert_extension.py ---------------------------------------------- 08:43:54.262138 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 08:43:54.273204 tst ussd:trx-b200: Using 1 x bts (candidates: 1) 08:43:54.322629 tst assert_extension.py: using LAC 39744 08:43:54.439882 tst assert_extension.py: using RAC 219 08:43:54.554529 tst assert_extension.py: using CellId 39744 08:43:54.669801 tst assert_extension.py: using BVCI 39745 08:43:54.785632 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 08:43:54.796817 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 08:43:54.808102 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 08:43:54.819299 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 08:43:54.830504 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 08:43:54.841711 tst ussd:trx-b200: Using 1 x modem (candidates: 1) 08:43:54.957292 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:43:55.418206 run create_hlr_db(pid=29643): Launched 08:43:55.532939 bus /sierra_2: Setting Powered False 08:43:56.592340 run create_hlr_db(pid=29643): Terminated: ok {rc=0} 08:43:57.027206 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29645): Launched 08:43:57.329376 run osmo-hlr_10.42.42.2(pid=29646): Launched 08:43:57.442619 run osmo-stp_10.42.42.5: Starting osmo-stp 08:43:57.956286 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29648): Launched 08:43:58.255407 run osmo-stp_10.42.42.5(pid=29649): Launched 08:43:58.368524 run osmo-msc_10.42.42.6: Starting osmo-msc 08:43:58.903418 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29651): Launched 08:43:59.201237 run osmo-msc_10.42.42.6(pid=29652): Launched 08:43:59.368683 run osmo-stp_10.42.42.5(pid=29649): ERR: Terminated: ERROR {rc=1} [trial-2402↪ussd:trx-b200↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29649)] 08:43:59.494903 run osmo-stp_10.42.42.5(pid=29649): stdout: | (launched: 2022-12-14_08:43:58.199456) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:43:59.621329 run osmo-stp_10.42.42.5(pid=29649): stderr: | 20221214084358367 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214084358367 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214084358368 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214084358368 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214084358369 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214084358369 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214084358369 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:43:59.745103 run osmo-stp_10.42.42.5(pid=29649): stdout: | (launched: 2022-12-14_08:43:58.199456) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:43:59.862658 run osmo-stp_10.42.42.5(pid=29649): stderr: | 20221214084358367 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214084358367 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214084358368 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214084358368 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214084358369 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214084358369 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214084358369 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:44:00.003178 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=29649): Process ended prematurely: osmo-stp_10.42.42.5(pid=29649) [trial-2402↪ussd:trx-b200↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29649)] [trial-2402↪ussd:trx-b200↪assert_extension.py:17] 08:44:00.011535 tst assert_extension.py:17: Test FAILED (5.7 sec) 08:44:00.037778 run osmo-hlr_10.42.42.2(pid=29646): ERR: Terminated: ERROR {rc=237} [trial-2402↪ussd:trx-b200↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29646)] 08:44:00.086961 run osmo-hlr_10.42.42.2(pid=29646): stdout: | (launched: 2022-12-14_08:43:57.274365) 08:44:00.137345 run osmo-hlr_10.42.42.2(pid=29646): stderr: | 20221214084357449 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214084357449 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214084357449 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214084357449 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214084357450 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214084357450 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214084357462 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/ussd:trx-b200/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214084357472 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214084357472 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214084357472 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:44:00.208227 run osmo-msc_10.42.42.6(pid=29652): ERR: Terminated: ERROR {rc=2} [trial-2402↪ussd:trx-b200↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29652)] 08:44:00.256284 run osmo-msc_10.42.42.6(pid=29652): stdout: | (launched: 2022-12-14_08:43:59.145370) 08:44:00.306345 run osmo-msc_10.42.42.6(pid=29652): stderr: | 20221214084359417 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214084359417 DLGLOBAL DEBUG validating counter group 0x7ff325707c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214084359417 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214084359417 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214084359418 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214084359418 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214084359420 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214084359420 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214084359420 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214084359420 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:44:00.356928 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29645): Terminating (SIGTERM) 08:44:00.397295 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29648): Terminating (SIGTERM) 08:44:00.437670 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29651): Terminating (SIGTERM) 08:44:00.478116 --- ParallelTerminationStrategy: PID 29645 died... 08:44:00.497702 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29645): Terminated: ok {rc=0} 08:44:00.542107 --- ParallelTerminationStrategy: PID 29648 died... 08:44:00.561042 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29648): Terminated: ok {rc=0} 08:44:00.605281 --- ParallelTerminationStrategy: PID 29651 died... 08:44:00.624088 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29651): Terminated: ok {rc=0} 08:44:00.711104 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2402 ussd:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 08:44:01.932714 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:44:01.941638 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 08:44:01.984627 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 08:44:02.018171 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 08:44:02.084581 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 08:44:02.121606 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 08:44:02.150793 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 08:44:02.694039 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2402 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 08:44:02.746415 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:44:02.758128 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 08:44:02.827723 tst mo_mt_call.py: using LAC 39745 08:44:02.953449 tst mo_mt_call.py: using RAC 220 08:44:03.077775 tst mo_mt_call.py: using CellId 39745 08:44:03.201431 tst mo_mt_call.py: using BVCI 39746 08:44:03.322100 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:44:03.333851 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:44:03.345510 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:44:03.357209 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:44:03.368698 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:44:03.380283 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 08:44:03.499036 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 08:44:03.620588 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:44:04.122867 run create_hlr_db(pid=29657): Launched 08:44:04.254326 bus /sierra_2: Setting Powered False 08:44:05.318556 run create_hlr_db(pid=29657): Terminated: ok {rc=0} 08:44:05.750971 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29659): Launched 08:44:06.055207 run osmo-hlr_10.42.42.2(pid=29660): Launched 08:44:06.173346 run osmo-stp_10.42.42.5: Starting osmo-stp 08:44:06.696771 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29662): Launched 08:44:06.999865 run osmo-stp_10.42.42.5(pid=29663): Launched 08:44:07.116044 run osmo-msc_10.42.42.6: Starting osmo-msc 08:44:07.680484 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29665): Launched 08:44:07.983823 run osmo-msc_10.42.42.6(pid=29666): Launched 08:44:08.155050 run osmo-stp_10.42.42.5(pid=29663): ERR: Terminated: ERROR {rc=1} [trial-2402↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29663)] 08:44:08.283369 run osmo-stp_10.42.42.5(pid=29663): stdout: | (launched: 2022-12-14_08:44:06.943996) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:44:08.411466 run osmo-stp_10.42.42.5(pid=29663): stderr: | 20221214084407114 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214084407114 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214084407114 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214084407115 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214084407115 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214084407115 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214084407115 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:44:08.537371 run osmo-stp_10.42.42.5(pid=29663): stdout: | (launched: 2022-12-14_08:44:06.943996) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:44:08.657633 run osmo-stp_10.42.42.5(pid=29663): stderr: | 20221214084407114 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214084407114 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214084407114 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214084407115 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214084407115 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214084407115 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214084407115 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:44:08.801961 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29663): Process ended prematurely: osmo-stp_10.42.42.5(pid=29663) [trial-2402↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29663)] [trial-2402↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 08:44:08.811053 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 08:44:08.837177 run osmo-hlr_10.42.42.2(pid=29660): ERR: Terminated: ERROR {rc=237} [trial-2402↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29660)] 08:44:08.885270 run osmo-hlr_10.42.42.2(pid=29660): stdout: | (launched: 2022-12-14_08:44:05.998802) 08:44:08.934881 run osmo-hlr_10.42.42.2(pid=29660): stderr: | 20221214084406172 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214084406172 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214084406172 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214084406172 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214084406172 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214084406172 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214084406187 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214084406198 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214084406198 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214084406198 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:44:09.004300 run osmo-msc_10.42.42.6(pid=29666): ERR: Terminated: ERROR {rc=2} [trial-2402↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29666)] 08:44:09.051796 run osmo-msc_10.42.42.6(pid=29666): stdout: | (launched: 2022-12-14_08:44:07.927940) 08:44:09.101477 run osmo-msc_10.42.42.6(pid=29666): stderr: | 20221214084408198 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214084408198 DLGLOBAL DEBUG validating counter group 0x7f35cc584c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214084408198 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214084408198 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214084408198 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214084408198 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214084408200 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214084408201 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214084408201 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214084408201 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:44:09.151319 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29659): Terminating (SIGTERM) 08:44:09.190899 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29662): Terminating (SIGTERM) 08:44:09.230601 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29665): Terminating (SIGTERM) 08:44:09.270643 --- ParallelTerminationStrategy: PID 29659 died... 08:44:09.290042 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29659): Terminated: ok {rc=0} 08:44:09.334042 --- ParallelTerminationStrategy: PID 29662 died... 08:44:09.352803 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29662): Terminated: ok {rc=0} 08:44:09.397119 --- ParallelTerminationStrategy: PID 29665 died... 08:44:09.415992 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29665): Terminated: ok {rc=0} 08:44:09.500318 bus /sierra_3: Setting Powered False 08:44:10.596045 bus /sierra_3: Setting Powered False 08:44:11.708083 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2402 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 08:44:12.850629 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:44:12.862281 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 08:44:12.935540 tst mo_mt_call_osmux.py: using LAC 39746 08:44:13.055059 tst mo_mt_call_osmux.py: using RAC 221 08:44:13.174611 tst mo_mt_call_osmux.py: using CellId 39746 08:44:13.294234 tst mo_mt_call_osmux.py: using BVCI 39747 08:44:13.404517 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:44:13.415633 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:44:13.426504 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:44:13.437406 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:44:13.448564 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:44:13.459731 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 08:44:13.575264 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 08:44:13.696104 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:44:14.198544 run create_hlr_db(pid=29668): Launched 08:44:14.331315 bus /sierra_2: Setting Powered False 08:44:15.395283 run create_hlr_db(pid=29668): Terminated: ok {rc=0} 08:44:15.827408 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29670): Launched 08:44:16.187445 run osmo-hlr_10.42.42.2(pid=29671): Launched 08:44:16.347307 run osmo-stp_10.42.42.5: Starting osmo-stp 08:44:17.085770 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29673): Launched 08:44:17.426971 run osmo-stp_10.42.42.5(pid=29674): Launched 08:44:17.554419 run osmo-msc_10.42.42.6: Starting osmo-msc 08:44:18.143635 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29676): Launched 08:44:18.467286 run osmo-msc_10.42.42.6(pid=29677): Launched 08:44:18.649678 run osmo-stp_10.42.42.5(pid=29674): ERR: Terminated: ERROR {rc=1} [trial-2402↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29674)] 08:44:18.786046 run osmo-stp_10.42.42.5(pid=29674): stdout: | (launched: 2022-12-14_08:44:17.367816) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:44:18.922340 run osmo-stp_10.42.42.5(pid=29674): stderr: | 20221214084417558 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214084417558 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214084417559 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214084417559 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214084417560 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214084417560 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214084417560 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:44:19.058090 run osmo-stp_10.42.42.5(pid=29674): stdout: | (launched: 2022-12-14_08:44:17.367816) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:44:19.185726 run osmo-stp_10.42.42.5(pid=29674): stderr: | 20221214084417558 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214084417558 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214084417559 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214084417559 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214084417560 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214084417560 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214084417560 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:44:19.338849 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29674): Process ended prematurely: osmo-stp_10.42.42.5(pid=29674) [trial-2402↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29674)] [trial-2402↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 08:44:19.348458 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 08:44:19.376513 run osmo-hlr_10.42.42.2(pid=29671): ERR: Terminated: ERROR {rc=237} [trial-2402↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29671)] 08:44:19.427176 run osmo-hlr_10.42.42.2(pid=29671): stdout: | (launched: 2022-12-14_08:44:16.126704) 08:44:19.479751 run osmo-hlr_10.42.42.2(pid=29671): stderr: | 20221214084416439 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214084416440 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214084416440 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214084416440 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214084416440 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214084416440 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214084416465 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214084416482 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214084416482 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214084416482 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:44:19.553066 run osmo-msc_10.42.42.6(pid=29677): ERR: Terminated: ERROR {rc=2} [trial-2402↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29677)] 08:44:19.604001 run osmo-msc_10.42.42.6(pid=29677): stdout: | (launched: 2022-12-14_08:44:18.408315) 08:44:19.656407 run osmo-msc_10.42.42.6(pid=29677): stderr: | 20221214084418728 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214084418729 DLGLOBAL DEBUG validating counter group 0x7f19a58f9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214084418729 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214084418729 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214084418729 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214084418729 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214084418731 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214084418731 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214084418731 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214084418731 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:44:19.708784 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29670): Terminating (SIGTERM) 08:44:19.750819 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29673): Terminating (SIGTERM) 08:44:19.792789 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29676): Terminating (SIGTERM) 08:44:19.835080 --- ParallelTerminationStrategy: PID 29670 died... 08:44:19.855257 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29670): Terminated: ok {rc=0} 08:44:19.901515 --- ParallelTerminationStrategy: PID 29673 died... 08:44:19.920889 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29673): Terminated: ok {rc=0} 08:44:19.967305 --- ParallelTerminationStrategy: PID 29676 died... 08:44:19.986930 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29676): Terminated: ok {rc=0} 08:44:20.076252 bus /sierra_3: Setting Powered False 08:44:21.175923 bus /sierra_3: Setting Powered False 08:44:22.292097 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2402 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 08:44:23.547905 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:44:23.555996 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 08:44:23.590171 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 08:44:23.617131 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 08:44:23.669325 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 08:44:23.703930 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 08:44:23.732470 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 08:44:24.278856 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2402 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 08:44:24.329308 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:44:24.340424 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 08:44:24.410717 tst mo_mt_call.py: using LAC 39747 08:44:24.532512 tst mo_mt_call.py: using RAC 222 08:44:24.654425 tst mo_mt_call.py: using CellId 39747 08:44:24.779489 tst mo_mt_call.py: using BVCI 39748 08:44:24.891100 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:44:24.902171 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:44:24.913087 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:44:24.923902 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:44:24.935308 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:44:24.946710 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 08:44:25.066261 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 08:44:25.184242 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:44:25.656438 run create_hlr_db(pid=29682): Launched 08:44:25.772501 bus /sierra_2: Setting Powered False 08:44:26.832769 run create_hlr_db(pid=29682): Terminated: ok {rc=0} 08:44:27.273775 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29684): Launched 08:44:27.599614 run osmo-hlr_10.42.42.2(pid=29685): Launched 08:44:27.723102 run osmo-stp_10.42.42.5: Starting osmo-stp 08:44:28.283544 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29687): Launched 08:44:28.606756 run osmo-stp_10.42.42.5(pid=29688): Launched 08:44:28.730079 run osmo-msc_10.42.42.6: Starting osmo-msc 08:44:29.315120 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29690): Launched 08:44:29.641496 run osmo-msc_10.42.42.6(pid=29691): Launched 08:44:29.823267 run osmo-stp_10.42.42.5(pid=29688): ERR: Terminated: ERROR {rc=1} [trial-2402↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29688)] 08:44:29.958914 run osmo-stp_10.42.42.5(pid=29688): stdout: | (launched: 2022-12-14_08:44:28.546990) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:44:30.095588 run osmo-stp_10.42.42.5(pid=29688): stderr: | 20221214084428741 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214084428741 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214084428741 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214084428741 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214084428742 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214084428742 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214084428742 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:44:30.231790 run osmo-stp_10.42.42.5(pid=29688): stdout: | (launched: 2022-12-14_08:44:28.546990) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:44:30.360483 run osmo-stp_10.42.42.5(pid=29688): stderr: | 20221214084428741 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214084428741 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214084428741 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214084428741 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214084428742 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214084428742 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214084428742 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:44:30.514971 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29688): Process ended prematurely: osmo-stp_10.42.42.5(pid=29688) [trial-2402↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29688)] [trial-2402↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 08:44:30.524730 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 08:44:30.552663 run osmo-hlr_10.42.42.2(pid=29685): ERR: Terminated: ERROR {rc=237} [trial-2402↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29685)] 08:44:30.603539 run osmo-hlr_10.42.42.2(pid=29685): stdout: | (launched: 2022-12-14_08:44:27.538416) 08:44:30.655464 run osmo-hlr_10.42.42.2(pid=29685): stderr: | 20221214084427739 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214084427739 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214084427739 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214084427739 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214084427739 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214084427739 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214084427752 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214084427760 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214084427760 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214084427760 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:44:30.728140 run osmo-msc_10.42.42.6(pid=29691): ERR: Terminated: ERROR {rc=2} [trial-2402↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29691)] 08:44:30.778277 run osmo-msc_10.42.42.6(pid=29691): stdout: | (launched: 2022-12-14_08:44:29.581632) 08:44:30.830143 run osmo-msc_10.42.42.6(pid=29691): stderr: | 20221214084429906 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214084429906 DLGLOBAL DEBUG validating counter group 0x7f033e90cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214084429906 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214084429906 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214084429906 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214084429906 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214084429908 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214084429909 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214084429909 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214084429909 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:44:30.897974 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29684): Terminating (SIGTERM) 08:44:30.940730 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29687): Terminating (SIGTERM) 08:44:30.983350 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29690): Terminating (SIGTERM) 08:44:31.026776 --- ParallelTerminationStrategy: PID 29684 died... 08:44:31.047383 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29684): Terminated: ok {rc=0} 08:44:31.096177 --- ParallelTerminationStrategy: PID 29687 died... 08:44:31.116880 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29687): Terminated: ok {rc=0} 08:44:31.164462 --- ParallelTerminationStrategy: PID 29690 died... 08:44:31.185196 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29690): Terminated: ok {rc=0} 08:44:31.276521 bus /sierra_3: Setting Powered False 08:44:32.375217 bus /sierra_3: Setting Powered False 08:44:33.490854 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2402 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 08:44:34.641438 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:44:34.653968 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 08:44:34.727560 tst mo_mt_call_osmux.py: using LAC 39748 08:44:34.857004 tst mo_mt_call_osmux.py: using RAC 223 08:44:34.984277 tst mo_mt_call_osmux.py: using CellId 39748 08:44:35.111783 tst mo_mt_call_osmux.py: using BVCI 39749 08:44:35.229442 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:44:35.241278 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:44:35.252729 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:44:35.264366 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:44:35.275911 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:44:35.287387 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 08:44:35.404544 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 08:44:35.523890 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:44:35.996374 run create_hlr_db(pid=29693): Launched 08:44:36.112381 bus /sierra_2: Setting Powered False 08:44:37.172810 run create_hlr_db(pid=29693): Terminated: ok {rc=0} 08:44:37.616477 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29695): Launched 08:44:37.941447 run osmo-hlr_10.42.42.2(pid=29696): Launched 08:44:38.065258 run osmo-stp_10.42.42.5: Starting osmo-stp 08:44:38.629653 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29698): Launched 08:44:38.953528 run osmo-stp_10.42.42.5(pid=29699): Launched 08:44:39.078269 run osmo-msc_10.42.42.6: Starting osmo-msc 08:44:39.669486 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29701): Launched 08:44:39.993620 run osmo-msc_10.42.42.6(pid=29702): Launched 08:44:40.176310 run osmo-stp_10.42.42.5(pid=29699): ERR: Terminated: ERROR {rc=1} [trial-2402↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29699)] 08:44:40.311738 run osmo-stp_10.42.42.5(pid=29699): stdout: | (launched: 2022-12-14_08:44:38.894176) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:44:40.448222 run osmo-stp_10.42.42.5(pid=29699): stderr: | 20221214084439088 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214084439088 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214084439088 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214084439089 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214084439089 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214084439089 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214084439089 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:44:40.584295 run osmo-stp_10.42.42.5(pid=29699): stdout: | (launched: 2022-12-14_08:44:38.894176) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:44:40.712806 run osmo-stp_10.42.42.5(pid=29699): stderr: | 20221214084439088 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214084439088 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214084439088 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214084439089 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214084439089 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214084439089 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214084439089 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:44:40.866253 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29699): Process ended prematurely: osmo-stp_10.42.42.5(pid=29699) [trial-2402↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29699)] [trial-2402↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 08:44:40.875898 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 08:44:40.903481 run osmo-hlr_10.42.42.2(pid=29696): ERR: Terminated: ERROR {rc=237} [trial-2402↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29696)] 08:44:40.953469 run osmo-hlr_10.42.42.2(pid=29696): stdout: | (launched: 2022-12-14_08:44:37.881652) 08:44:41.005227 run osmo-hlr_10.42.42.2(pid=29696): stderr: | 20221214084438081 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214084438081 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214084438081 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214084438081 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214084438081 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214084438081 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214084438094 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214084438102 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214084438102 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214084438102 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:44:41.077577 run osmo-msc_10.42.42.6(pid=29702): ERR: Terminated: ERROR {rc=2} [trial-2402↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29702)] 08:44:41.127667 run osmo-msc_10.42.42.6(pid=29702): stdout: | (launched: 2022-12-14_08:44:39.934069) 08:44:41.179256 run osmo-msc_10.42.42.6(pid=29702): stderr: | 20221214084440257 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214084440257 DLGLOBAL DEBUG validating counter group 0x7fbe1695bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214084440258 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214084440258 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214084440258 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214084440258 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214084440260 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214084440260 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214084440260 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214084440260 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:44:41.231201 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29695): Terminating (SIGTERM) 08:44:41.272508 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29698): Terminating (SIGTERM) 08:44:41.314035 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29701): Terminating (SIGTERM) 08:44:41.355816 --- ParallelTerminationStrategy: PID 29695 died... 08:44:41.375874 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29695): Terminated: ok {rc=0} 08:44:41.421714 --- ParallelTerminationStrategy: PID 29698 died... 08:44:41.441109 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29698): Terminated: ok {rc=0} 08:44:41.486609 --- ParallelTerminationStrategy: PID 29701 died... 08:44:41.505937 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29701): Terminated: ok {rc=0} 08:44:41.593930 bus /sierra_3: Setting Powered False 08:44:42.691110 bus /sierra_3: Setting Powered False 08:44:43.806380 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2402 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 08:44:45.060608 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:44:45.067734 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 08:44:45.101605 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 08:44:45.129184 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 08:44:45.181397 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 08:44:45.215243 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 08:44:45.242373 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 08:44:45.795882 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2402 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 08:44:45.852222 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:44:45.872415 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 08:44:45.960023 tst mo_mt_call.py: using LAC 39749 08:44:46.088644 tst mo_mt_call.py: using RAC 224 08:44:46.221549 tst mo_mt_call.py: using CellId 39749 08:44:46.347685 tst mo_mt_call.py: using BVCI 39750 08:44:46.465669 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:44:46.478122 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:44:46.490261 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:44:46.502392 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:44:46.515984 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:44:46.529696 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 08:44:46.678163 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 08:44:46.805891 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:44:47.315507 run create_hlr_db(pid=29709): Launched 08:44:47.446639 bus /sierra_2: Setting Powered False 08:44:48.510532 run create_hlr_db(pid=29709): Terminated: ok {rc=0} 08:44:48.959608 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29711): Launched 08:44:49.283473 run osmo-hlr_10.42.42.2(pid=29712): Launched 08:44:49.407141 run osmo-stp_10.42.42.5: Starting osmo-stp 08:44:49.964883 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29714): Launched 08:44:50.287206 run osmo-stp_10.42.42.5(pid=29715): Launched 08:44:50.410978 run osmo-msc_10.42.42.6: Starting osmo-msc 08:44:50.995452 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29717): Launched 08:44:51.318576 run osmo-msc_10.42.42.6(pid=29718): Launched 08:44:51.500423 run osmo-stp_10.42.42.5(pid=29715): ERR: Terminated: ERROR {rc=1} [trial-2402↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29715)] 08:44:51.637860 run osmo-stp_10.42.42.5(pid=29715): stdout: | (launched: 2022-12-14_08:44:50.227866) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:44:51.773791 run osmo-stp_10.42.42.5(pid=29715): stderr: | 20221214084450419 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214084450419 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214084450419 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214084450420 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214084450420 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214084450420 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214084450420 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:44:51.909146 run osmo-stp_10.42.42.5(pid=29715): stdout: | (launched: 2022-12-14_08:44:50.227866) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:44:52.037274 run osmo-stp_10.42.42.5(pid=29715): stderr: | 20221214084450419 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214084450419 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214084450419 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214084450420 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214084450420 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214084450420 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214084450420 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:44:52.191048 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29715): Process ended prematurely: osmo-stp_10.42.42.5(pid=29715) [trial-2402↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29715)] [trial-2402↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 08:44:52.200534 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 08:44:52.228217 run osmo-hlr_10.42.42.2(pid=29712): ERR: Terminated: ERROR {rc=237} [trial-2402↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29712)] 08:44:52.278336 run osmo-hlr_10.42.42.2(pid=29712): stdout: | (launched: 2022-12-14_08:44:49.224048) 08:44:52.330262 run osmo-hlr_10.42.42.2(pid=29712): stderr: | 20221214084449421 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214084449421 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214084449421 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214084449421 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214084449421 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214084449421 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214084449434 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214084449442 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214084449442 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214084449442 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:44:52.402532 run osmo-msc_10.42.42.6(pid=29718): ERR: Terminated: ERROR {rc=2} [trial-2402↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29718)] 08:44:52.452720 run osmo-msc_10.42.42.6(pid=29718): stdout: | (launched: 2022-12-14_08:44:51.259326) 08:44:52.504540 run osmo-msc_10.42.42.6(pid=29718): stderr: | 20221214084451580 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214084451580 DLGLOBAL DEBUG validating counter group 0x7f7fef509c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214084451581 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214084451581 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214084451581 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214084451581 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214084451583 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214084451583 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214084451583 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214084451583 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:44:52.556831 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29711): Terminating (SIGTERM) 08:44:52.598999 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29714): Terminating (SIGTERM) 08:44:52.640626 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29717): Terminating (SIGTERM) 08:44:52.682599 --- ParallelTerminationStrategy: PID 29711 died... 08:44:52.702555 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29711): Terminated: ok {rc=0} 08:44:52.748497 --- ParallelTerminationStrategy: PID 29714 died... 08:44:52.767938 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29714): Terminated: ok {rc=0} 08:44:52.814301 --- ParallelTerminationStrategy: PID 29717 died... 08:44:52.833758 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29717): Terminated: ok {rc=0} 08:44:52.920787 bus /sierra_3: Setting Powered False 08:44:54.019281 bus /sierra_3: Setting Powered False 08:44:55.135468 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2402 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 08:44:56.284041 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:44:56.296352 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 08:44:56.367946 tst mo_mt_call_osmux.py: using LAC 39750 08:44:56.488428 tst mo_mt_call_osmux.py: using RAC 225 08:44:56.608213 tst mo_mt_call_osmux.py: using CellId 39750 08:44:56.730849 tst mo_mt_call_osmux.py: using BVCI 39751 08:44:56.843390 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:44:56.854660 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:44:56.865876 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:44:56.876725 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:44:56.888010 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:44:56.899130 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 08:44:57.019209 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 08:44:57.136227 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:44:57.607389 run create_hlr_db(pid=29720): Launched 08:44:57.722888 bus /sierra_2: Setting Powered False 08:44:58.783336 run create_hlr_db(pid=29720): Terminated: ok {rc=0} 08:44:59.223972 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29722): Launched 08:44:59.545977 run osmo-hlr_10.42.42.2(pid=29723): Launched 08:44:59.672280 run osmo-stp_10.42.42.5: Starting osmo-stp 08:45:00.231221 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29725): Launched 08:45:00.554537 run osmo-stp_10.42.42.5(pid=29726): Launched 08:45:00.680212 run osmo-msc_10.42.42.6: Starting osmo-msc 08:45:01.285781 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29728): Launched 08:45:01.638796 run osmo-msc_10.42.42.6(pid=29732): Launched 08:45:02.196176 run osmo-stp_10.42.42.5(pid=29726): ERR: Terminated: ERROR {rc=1} [trial-2402↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29726)] 08:45:02.482962 run osmo-stp_10.42.42.5(pid=29726): stdout: | (launched: 2022-12-14_08:45:00.495359) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:45:02.618402 run osmo-stp_10.42.42.5(pid=29726): stderr: | 20221214084500687 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214084500687 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214084500687 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214084500688 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214084500688 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214084500688 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214084500688 DLGLOBAL[0;m ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:45:02.753556 run osmo-stp_10.42.42.5(pid=29726): stdout: | (launched: 2022-12-14_08:45:00.495359) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:45:02.881926 run osmo-stp_10.42.42.5(pid=29726): stderr: | 20221214084500687 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214084500687 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214084500687 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214084500688 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214084500688 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214084500688 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214084500688 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:45:03.035732 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29726): Process ended prematurely: osmo-stp_10.42.42.5(pid=29726) [trial-2402↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29726)] [trial-2402↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 08:45:03.045405 tst mo_mt_call_osmux.py:8: Test FAILED (6.8 sec) 08:45:03.073085 run osmo-hlr_10.42.42.2(pid=29723): ERR: Terminated: ERROR {rc=237} [trial-2402↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29723)] 08:45:03.123132 run osmo-hlr_10.42.42.2(pid=29723): stdout: | (launched: 2022-12-14_08:44:59.486794) 08:45:03.174745 run osmo-hlr_10.42.42.2(pid=29723): stderr: | 20221214084459685 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214084459685 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214084459685 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214084459685 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214084459685 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214084459685 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214084459698 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214084459706 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214084459707 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214084459707 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:45:03.246719 run osmo-msc_10.42.42.6(pid=29732): ERR: Terminated: ERROR {rc=2} [trial-2402↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29732)] 08:45:03.296512 run osmo-msc_10.42.42.6(pid=29732): stdout: | (launched: 2022-12-14_08:45:01.575171) 08:45:03.348117 run osmo-msc_10.42.42.6(pid=29732): stderr: | 20221214084502036 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214084502036 DLGLOBAL DEBUG validating counter group 0x7f7a12992c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214084502037 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214084502037 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214084502037 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214084502038 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214084502042 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214084502044 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214084502044 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214084502044 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:45:03.399715 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29722): Terminating (SIGTERM) 08:45:03.441436 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29725): Terminating (SIGTERM) 08:45:03.483541 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29728): Terminating (SIGTERM) 08:45:03.525952 --- ParallelTerminationStrategy: PID 29722 died... 08:45:03.545914 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29722): Terminated: ok {rc=0} 08:45:03.592150 --- ParallelTerminationStrategy: PID 29725 died... 08:45:03.611881 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29725): Terminated: ok {rc=0} 08:45:03.657866 --- ParallelTerminationStrategy: PID 29728 died... 08:45:03.677495 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29728): Terminated: ok {rc=0} 08:45:03.765353 bus /sierra_3: Setting Powered False 08:45:04.863347 bus /sierra_3: Setting Powered False 08:45:05.978300 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2402 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 08:45:07.230872 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:45:07.238076 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 08:45:07.271721 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 08:45:07.299093 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 08:45:07.351515 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 08:45:07.385140 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 08:45:07.412234 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 08:45:07.965589 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2402 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 08:45:08.017817 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 08:45:08.029494 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 08:45:08.102144 tst mo_mt_call.py: using LAC 39751 08:45:08.229411 tst mo_mt_call.py: using RAC 226 08:45:08.356354 tst mo_mt_call.py: using CellId 39751 08:45:08.482443 tst mo_mt_call.py: using BVCI 39752 08:45:08.600580 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 08:45:08.612220 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 08:45:08.623569 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 08:45:08.634893 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 08:45:08.646582 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 08:45:08.658004 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 08:45:08.775267 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 08:45:08.895813 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:45:09.398197 run create_hlr_db(pid=29737): Launched 08:45:09.530763 bus /sierra_2: Setting Powered False 08:45:10.594457 run create_hlr_db(pid=29737): Terminated: ok {rc=0} 08:45:11.045150 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29739): Launched 08:45:11.368843 run osmo-hlr_10.42.42.2(pid=29740): Launched 08:45:11.492895 run osmo-stp_10.42.42.5: Starting osmo-stp 08:45:12.049734 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29742): Launched 08:45:12.372834 run osmo-stp_10.42.42.5(pid=29743): Launched 08:45:12.496284 run osmo-msc_10.42.42.6: Starting osmo-msc 08:45:13.084265 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29745): Launched 08:45:13.407584 run osmo-msc_10.42.42.6(pid=29746): Launched 08:45:13.590195 run osmo-stp_10.42.42.5(pid=29743): ERR: Terminated: ERROR {rc=1} [trial-2402↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29743)] 08:45:13.727714 run osmo-stp_10.42.42.5(pid=29743): stdout: | (launched: 2022-12-14_08:45:12.313356) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:45:13.865791 run osmo-stp_10.42.42.5(pid=29743): stderr: | 20221214084512505 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214084512505 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214084512505 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214084512506 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214084512506 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214084512506 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214084512506 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:45:14.001127 run osmo-stp_10.42.42.5(pid=29743): stdout: | (launched: 2022-12-14_08:45:12.313356) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:45:14.129473 run osmo-stp_10.42.42.5(pid=29743): stderr: | 20221214084512505 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214084512505 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214084512505 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214084512506 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214084512506 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214084512506 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214084512506 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:45:14.282967 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29743): Process ended prematurely: osmo-stp_10.42.42.5(pid=29743) [trial-2402↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29743)] [trial-2402↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 08:45:14.292527 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 08:45:14.320265 run osmo-hlr_10.42.42.2(pid=29740): ERR: Terminated: ERROR {rc=237} [trial-2402↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29740)] 08:45:14.370531 run osmo-hlr_10.42.42.2(pid=29740): stdout: | (launched: 2022-12-14_08:45:11.309056) 08:45:14.422355 run osmo-hlr_10.42.42.2(pid=29740): stderr: | 20221214084511506 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214084511506 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214084511506 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214084511506 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214084511506 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214084511506 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214084511522 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214084511531 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214084511531 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214084511531 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:45:14.494452 run osmo-msc_10.42.42.6(pid=29746): ERR: Terminated: ERROR {rc=2} [trial-2402↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29746)] 08:45:14.544486 run osmo-msc_10.42.42.6(pid=29746): stdout: | (launched: 2022-12-14_08:45:13.348305) 08:45:14.596268 run osmo-msc_10.42.42.6(pid=29746): stderr: | 20221214084513671 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214084513671 DLGLOBAL DEBUG validating counter group 0x7fd89c3d6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214084513671 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214084513671 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214084513672 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214084513672 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214084513673 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214084513674 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214084513674 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214084513674 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:45:14.648566 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29739): Terminating (SIGTERM) 08:45:14.690168 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29742): Terminating (SIGTERM) 08:45:14.731731 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29745): Terminating (SIGTERM) 08:45:14.773595 --- ParallelTerminationStrategy: PID 29739 died... 08:45:14.793555 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29739): Terminated: ok {rc=0} 08:45:14.839678 --- ParallelTerminationStrategy: PID 29742 died... 08:45:14.859242 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29742): Terminated: ok {rc=0} 08:45:14.905463 --- ParallelTerminationStrategy: PID 29745 died... 08:45:14.925177 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29745): Terminated: ok {rc=0} 08:45:15.013472 bus /sierra_3: Setting Powered False 08:45:16.111645 bus /sierra_3: Setting Powered False 08:45:17.235588 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2402 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 08:45:18.390440 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 08:45:18.402816 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 08:45:18.473425 tst mo_mt_call_osmux.py: using LAC 39752 08:45:18.594178 tst mo_mt_call_osmux.py: using RAC 227 08:45:18.716005 tst mo_mt_call_osmux.py: using CellId 39752 08:45:18.839891 tst mo_mt_call_osmux.py: using BVCI 39753 08:45:18.951768 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 08:45:18.962915 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 08:45:18.973949 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 08:45:18.984729 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 08:45:18.996254 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 08:45:19.007512 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 08:45:19.123324 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 08:45:19.242811 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:45:19.745631 run create_hlr_db(pid=29748): Launched 08:45:19.878325 bus /sierra_2: Setting Powered False 08:45:20.942260 run create_hlr_db(pid=29748): Terminated: ok {rc=0} 08:45:21.375000 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29750): Launched 08:45:21.680333 run osmo-hlr_10.42.42.2(pid=29751): Launched 08:45:21.796123 run osmo-stp_10.42.42.5: Starting osmo-stp 08:45:22.331643 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29753): Launched 08:45:22.635263 run osmo-stp_10.42.42.5(pid=29754): Launched 08:45:22.750810 run osmo-msc_10.42.42.6: Starting osmo-msc 08:45:23.301730 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29756): Launched 08:45:23.606248 run osmo-msc_10.42.42.6(pid=29757): Launched 08:45:23.776051 run osmo-stp_10.42.42.5(pid=29754): ERR: Terminated: ERROR {rc=1} [trial-2402↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29754)] 08:45:23.905196 run osmo-stp_10.42.42.5(pid=29754): stdout: | (launched: 2022-12-14_08:45:22.579094) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:45:24.033556 run osmo-stp_10.42.42.5(pid=29754): stderr: | 20221214084522751 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214084522751 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214084522751 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214084522751 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214084522752 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214084522752 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214084522752 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:45:24.160473 run osmo-stp_10.42.42.5(pid=29754): stdout: | (launched: 2022-12-14_08:45:22.579094) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:45:24.280602 run osmo-stp_10.42.42.5(pid=29754): stderr: | 20221214084522751 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214084522751 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214084522751 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214084522751 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214084522752 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214084522752 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214084522752 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:45:24.425460 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29754): Process ended prematurely: osmo-stp_10.42.42.5(pid=29754) [trial-2402↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29754)] [trial-2402↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 08:45:24.434464 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 08:45:24.460892 run osmo-hlr_10.42.42.2(pid=29751): ERR: Terminated: ERROR {rc=237} [trial-2402↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29751)] 08:45:24.509896 run osmo-hlr_10.42.42.2(pid=29751): stdout: | (launched: 2022-12-14_08:45:21.624125) 08:45:24.560113 run osmo-hlr_10.42.42.2(pid=29751): stderr: | 20221214084521797 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214084521797 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214084521797 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214084521797 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214084521797 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214084521797 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214084521810 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214084521818 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214084521818 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214084521818 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:45:24.630394 run osmo-msc_10.42.42.6(pid=29757): ERR: Terminated: ERROR {rc=2} [trial-2402↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29757)] 08:45:24.678599 run osmo-msc_10.42.42.6(pid=29757): stdout: | (launched: 2022-12-14_08:45:23.549532) 08:45:24.728605 run osmo-msc_10.42.42.6(pid=29757): stderr: | 20221214084523821 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214084523821 DLGLOBAL DEBUG validating counter group 0x7f2560367c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214084523821 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214084523821 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214084523822 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214084523822 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214084523823 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214084523824 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214084523824 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214084523824 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:45:24.778940 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29750): Terminating (SIGTERM) 08:45:24.819301 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29753): Terminating (SIGTERM) 08:45:24.859633 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29756): Terminating (SIGTERM) 08:45:24.899818 --- ParallelTerminationStrategy: PID 29750 died... 08:45:24.919258 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29750): Terminated: ok {rc=0} 08:45:24.963901 --- ParallelTerminationStrategy: PID 29753 died... 08:45:24.982755 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29753): Terminated: ok {rc=0} 08:45:25.026793 --- ParallelTerminationStrategy: PID 29756 died... 08:45:25.045693 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29756): Terminated: ok {rc=0} 08:45:25.141955 bus /sierra_3: Setting Powered False 08:45:26.240875 bus /sierra_3: Setting Powered False 08:45:27.355799 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2402 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 08:45:28.602813 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:45:28.609318 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 08:45:28.642009 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 08:45:28.669561 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 08:45:28.720680 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 08:45:28.753324 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 08:45:28.780017 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 08:45:29.333904 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2402 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 08:45:29.382929 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:45:29.394294 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 08:45:29.461622 tst mo_mt_call.py: using LAC 39753 08:45:29.587837 tst mo_mt_call.py: using RAC 228 08:45:29.715682 tst mo_mt_call.py: using CellId 39753 08:45:29.841142 tst mo_mt_call.py: using BVCI 39754 08:45:29.959096 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:45:29.970773 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:45:29.982216 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:45:29.993806 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:45:30.005419 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:45:30.016880 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 08:45:30.133315 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 08:45:30.252266 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:45:30.755000 run create_hlr_db(pid=29762): Launched 08:45:30.889563 bus /sierra_2: Setting Powered False 08:45:31.948733 run create_hlr_db(pid=29762): Terminated: ok {rc=0} 08:45:32.403901 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29764): Launched 08:45:32.728796 run osmo-hlr_10.42.42.2(pid=29765): Launched 08:45:32.852168 run osmo-stp_10.42.42.5: Starting osmo-stp 08:45:33.413365 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29767): Launched 08:45:33.737149 run osmo-stp_10.42.42.5(pid=29768): Launched 08:45:33.861662 run osmo-msc_10.42.42.6: Starting osmo-msc 08:45:34.446928 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29770): Launched 08:45:34.771877 run osmo-msc_10.42.42.6(pid=29771): Launched 08:45:34.951148 run osmo-stp_10.42.42.5(pid=29768): ERR: Terminated: ERROR {rc=1} [trial-2402↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29768)] 08:45:35.086534 run osmo-stp_10.42.42.5(pid=29768): stdout: | (launched: 2022-12-14_08:45:33.677569) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:45:35.222276 run osmo-stp_10.42.42.5(pid=29768): stderr: | 20221214084533871 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214084533871 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214084533872 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214084533872 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214084533873 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214084533873 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214084533873 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:45:35.358286 run osmo-stp_10.42.42.5(pid=29768): stdout: | (launched: 2022-12-14_08:45:33.677569) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:45:35.486786 run osmo-stp_10.42.42.5(pid=29768): stderr: | 20221214084533871 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214084533871 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214084533872 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214084533872 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214084533873 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214084533873 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214084533873 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:45:35.640745 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29768): Process ended prematurely: osmo-stp_10.42.42.5(pid=29768) [trial-2402↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29768)] [trial-2402↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 08:45:35.650686 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 08:45:35.678300 run osmo-hlr_10.42.42.2(pid=29765): ERR: Terminated: ERROR {rc=237} [trial-2402↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29765)] 08:45:35.728013 run osmo-hlr_10.42.42.2(pid=29765): stdout: | (launched: 2022-12-14_08:45:32.669315) 08:45:35.779830 run osmo-hlr_10.42.42.2(pid=29765): stderr: | 20221214084532869 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214084532869 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214084532869 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214084532869 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214084532869 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214084532869 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214084532881 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214084532889 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214084532889 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214084532889 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:45:35.851723 run osmo-msc_10.42.42.6(pid=29771): ERR: Terminated: ERROR {rc=2} [trial-2402↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29771)] 08:45:35.901484 run osmo-msc_10.42.42.6(pid=29771): stdout: | (launched: 2022-12-14_08:45:34.712387) 08:45:35.953355 run osmo-msc_10.42.42.6(pid=29771): stderr: | 20221214084535034 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214084535035 DLGLOBAL DEBUG validating counter group 0x7f0e8bf3ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214084535035 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214084535035 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214084535035 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214084535035 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214084535037 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214084535037 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214084535037 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214084535038 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:45:36.005426 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29764): Terminating (SIGTERM) 08:45:36.046721 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29767): Terminating (SIGTERM) 08:45:36.088116 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29770): Terminating (SIGTERM) 08:45:36.129804 --- ParallelTerminationStrategy: PID 29764 died... 08:45:36.149686 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29764): Terminated: ok {rc=0} 08:45:36.195861 --- ParallelTerminationStrategy: PID 29767 died... 08:45:36.215401 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29767): Terminated: ok {rc=0} 08:45:36.261500 --- ParallelTerminationStrategy: PID 29770 died... 08:45:36.281270 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29770): Terminated: ok {rc=0} 08:45:36.369329 bus /sierra_3: Setting Powered False 08:45:37.467374 bus /sierra_3: Setting Powered False 08:45:38.580196 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2402 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 08:45:39.729061 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:45:39.741438 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 08:45:39.811828 tst mo_mt_call_osmux.py: using LAC 39754 08:45:39.931686 tst mo_mt_call_osmux.py: using RAC 229 08:45:40.050279 tst mo_mt_call_osmux.py: using CellId 39754 08:45:40.169394 tst mo_mt_call_osmux.py: using BVCI 39755 08:45:40.279868 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:45:40.291137 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:45:40.302242 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:45:40.313382 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:45:40.324886 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:45:40.336232 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 08:45:40.453278 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 08:45:40.569662 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:45:41.041604 run create_hlr_db(pid=29773): Launched 08:45:41.157077 bus /sierra_2: Setting Powered False 08:45:42.217600 run create_hlr_db(pid=29773): Terminated: ok {rc=0} 08:45:42.659778 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29775): Launched 08:45:42.986718 run osmo-hlr_10.42.42.2(pid=29776): Launched 08:45:43.112045 run osmo-stp_10.42.42.5: Starting osmo-stp 08:45:43.669100 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29778): Launched 08:45:43.992142 run osmo-stp_10.42.42.5(pid=29779): Launched 08:45:44.118430 run osmo-msc_10.42.42.6: Starting osmo-msc 08:45:44.710524 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29781): Launched 08:45:45.035577 run osmo-msc_10.42.42.6(pid=29782): Launched 08:45:45.216094 run osmo-stp_10.42.42.5(pid=29779): ERR: Terminated: ERROR {rc=1} [trial-2402↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29779)] 08:45:45.352299 run osmo-stp_10.42.42.5(pid=29779): stdout: | (launched: 2022-12-14_08:45:43.932432) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:45:45.488592 run osmo-stp_10.42.42.5(pid=29779): stderr: | 20221214084544126 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214084544126 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214084544126 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214084544126 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214084544127 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214084544127 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214084544127 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:45:45.625497 run osmo-stp_10.42.42.5(pid=29779): stdout: | (launched: 2022-12-14_08:45:43.932432) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:45:45.754269 run osmo-stp_10.42.42.5(pid=29779): stderr: | 20221214084544126 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214084544126 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214084544126 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214084544126 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214084544127 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214084544127 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214084544127 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:45:45.910437 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29779): Process ended prematurely: osmo-stp_10.42.42.5(pid=29779) [trial-2402↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29779)] [trial-2402↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 08:45:45.920743 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 08:45:45.949321 run osmo-hlr_10.42.42.2(pid=29776): ERR: Terminated: ERROR {rc=237} [trial-2402↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29776)] 08:45:46.000662 run osmo-hlr_10.42.42.2(pid=29776): stdout: | (launched: 2022-12-14_08:45:42.927075) 08:45:46.054215 run osmo-hlr_10.42.42.2(pid=29776): stderr: | 20221214084543126 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214084543126 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214084543126 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214084543126 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214084543126 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214084543126 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214084543141 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214084543149 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214084543149 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214084543149 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:45:46.128417 run osmo-msc_10.42.42.6(pid=29782): ERR: Terminated: ERROR {rc=2} [trial-2402↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29782)] 08:45:46.179240 run osmo-msc_10.42.42.6(pid=29782): stdout: | (launched: 2022-12-14_08:45:44.975905) 08:45:46.232022 run osmo-msc_10.42.42.6(pid=29782): stderr: | 20221214084545300 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214084545301 DLGLOBAL DEBUG validating counter group 0x7f669967ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214084545301 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214084545301 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214084545301 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214084545301 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214084545303 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214084545303 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214084545303 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214084545303 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:45:46.284642 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29775): Terminating (SIGTERM) 08:45:46.327896 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29778): Terminating (SIGTERM) 08:45:46.370391 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29781): Terminating (SIGTERM) 08:45:46.413287 --- ParallelTerminationStrategy: PID 29775 died... 08:45:46.433445 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29775): Terminated: ok {rc=0} 08:45:46.480519 --- ParallelTerminationStrategy: PID 29778 died... 08:45:46.500810 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29778): Terminated: ok {rc=0} 08:45:46.547307 --- ParallelTerminationStrategy: PID 29781 died... 08:45:46.567603 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29781): Terminated: ok {rc=0} 08:45:46.656816 bus /sierra_3: Setting Powered False 08:45:47.753993 bus /sierra_3: Setting Powered False 08:45:48.870096 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2402 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 08:45:50.125329 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:45:50.132856 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 08:45:50.166821 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 08:45:50.194557 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 08:45:50.247233 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 08:45:50.281225 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 08:45:50.309074 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 08:45:50.866494 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2402 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 08:45:50.918943 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:45:50.930842 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 08:45:51.003658 tst mo_mt_call.py: using LAC 39755 08:45:51.135959 tst mo_mt_call.py: using RAC 230 08:45:51.263577 tst mo_mt_call.py: using CellId 39755 08:45:51.389612 tst mo_mt_call.py: using BVCI 39756 08:45:51.501600 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:45:51.512607 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:45:51.523689 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:45:51.534874 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:45:51.546171 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:45:51.557408 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 08:45:51.675276 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 08:45:51.794483 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:45:52.288692 run create_hlr_db(pid=29788): Launched 08:45:52.421311 bus /sierra_2: Setting Powered False 08:45:53.485084 run create_hlr_db(pid=29788): Terminated: ok {rc=0} 08:45:53.937763 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29790): Launched 08:45:54.244790 run osmo-hlr_10.42.42.2(pid=29791): Launched 08:45:54.361410 run osmo-stp_10.42.42.5: Starting osmo-stp 08:45:54.900259 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29793): Launched 08:45:55.204554 run osmo-stp_10.42.42.5(pid=29794): Launched 08:45:55.321122 run osmo-msc_10.42.42.6: Starting osmo-msc 08:45:55.870973 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29796): Launched 08:45:56.175958 run osmo-msc_10.42.42.6(pid=29797): Launched 08:45:56.346190 run osmo-stp_10.42.42.5(pid=29794): ERR: Terminated: ERROR {rc=1} [trial-2402↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29794)] 08:45:56.474237 run osmo-stp_10.42.42.5(pid=29794): stdout: | (launched: 2022-12-14_08:45:55.148676) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:45:56.602554 run osmo-stp_10.42.42.5(pid=29794): stderr: | 20221214084555319 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214084555319 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214084555319 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214084555320 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214084555320 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214084555320 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214084555320 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:45:56.729407 run osmo-stp_10.42.42.5(pid=29794): stdout: | (launched: 2022-12-14_08:45:55.148676) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:45:56.850465 run osmo-stp_10.42.42.5(pid=29794): stderr: | 20221214084555319 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214084555319 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214084555319 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214084555320 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214084555320 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214084555320 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214084555320 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:45:56.995116 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29794): Process ended prematurely: osmo-stp_10.42.42.5(pid=29794) [trial-2402↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29794)] [trial-2402↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 08:45:57.004039 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 08:45:57.030237 run osmo-hlr_10.42.42.2(pid=29791): ERR: Terminated: ERROR {rc=237} [trial-2402↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29791)] 08:45:57.079780 run osmo-hlr_10.42.42.2(pid=29791): stdout: | (launched: 2022-12-14_08:45:54.188055) 08:45:57.129982 run osmo-hlr_10.42.42.2(pid=29791): stderr: | 20221214084554365 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214084554365 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214084554365 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214084554365 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214084554365 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214084554365 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214084554378 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214084554386 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214084554387 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214084554387 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:45:57.200296 run osmo-msc_10.42.42.6(pid=29797): ERR: Terminated: ERROR {rc=2} [trial-2402↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29797)] 08:45:57.247701 run osmo-msc_10.42.42.6(pid=29797): stdout: | (launched: 2022-12-14_08:45:56.119680) 08:45:57.297791 run osmo-msc_10.42.42.6(pid=29797): stderr: | 20221214084556391 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214084556391 DLGLOBAL DEBUG validating counter group 0x7f6debd3fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214084556391 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214084556391 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214084556392 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214084556392 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214084556394 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214084556394 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214084556394 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214084556394 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:45:57.348078 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29790): Terminating (SIGTERM) 08:45:57.388482 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29793): Terminating (SIGTERM) 08:45:57.429045 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29796): Terminating (SIGTERM) 08:45:57.469598 --- ParallelTerminationStrategy: PID 29790 died... 08:45:57.489547 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29790): Terminated: ok {rc=0} 08:45:57.534299 --- ParallelTerminationStrategy: PID 29793 died... 08:45:57.553585 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29793): Terminated: ok {rc=0} 08:45:57.598091 --- ParallelTerminationStrategy: PID 29796 died... 08:45:57.617548 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29796): Terminated: ok {rc=0} 08:45:57.704522 bus /sierra_3: Setting Powered False 08:45:58.803958 bus /sierra_3: Setting Powered False 08:45:59.918233 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2402 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 08:46:01.068256 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:46:01.081377 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 08:46:01.159826 tst mo_mt_call_osmux.py: using LAC 39756 08:46:01.325136 tst mo_mt_call_osmux.py: using RAC 231 08:46:01.456537 tst mo_mt_call_osmux.py: using CellId 39756 08:46:01.585573 tst mo_mt_call_osmux.py: using BVCI 39757 08:46:01.708391 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:46:01.720743 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:46:01.732791 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:46:01.745467 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:46:01.759009 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:46:01.772332 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 08:46:01.896595 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 08:46:02.038748 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:46:02.529997 run create_hlr_db(pid=29799): Launched 08:46:02.646101 bus /sierra_2: Setting Powered False 08:46:03.706650 run create_hlr_db(pid=29799): Terminated: ok {rc=0} 08:46:04.149554 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29801): Launched 08:46:04.475647 run osmo-hlr_10.42.42.2(pid=29802): Launched 08:46:04.600227 run osmo-stp_10.42.42.5: Starting osmo-stp 08:46:05.161060 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29804): Launched 08:46:05.485703 run osmo-stp_10.42.42.5(pid=29805): Launched 08:46:05.609789 run osmo-msc_10.42.42.6: Starting osmo-msc 08:46:06.195206 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29807): Launched 08:46:06.520435 run osmo-msc_10.42.42.6(pid=29808): Launched 08:46:06.700758 run osmo-stp_10.42.42.5(pid=29805): ERR: Terminated: ERROR {rc=1} [trial-2402↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29805)] 08:46:06.836813 run osmo-stp_10.42.42.5(pid=29805): stdout: | (launched: 2022-12-14_08:46:05.425509) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:46:06.973447 run osmo-stp_10.42.42.5(pid=29805): stderr: | 20221214084605618 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214084605618 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214084605619 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214084605619 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214084605619 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214084605619 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214084605620 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:46:07.108422 run osmo-stp_10.42.42.5(pid=29805): stdout: | (launched: 2022-12-14_08:46:05.425509) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:46:07.236497 run osmo-stp_10.42.42.5(pid=29805): stderr: | 20221214084605618 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214084605618 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214084605619 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214084605619 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214084605619 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214084605619 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214084605620 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:46:07.389962 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29805): Process ended prematurely: osmo-stp_10.42.42.5(pid=29805) [trial-2402↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29805)] [trial-2402↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 08:46:07.399547 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 08:46:07.427246 run osmo-hlr_10.42.42.2(pid=29802): ERR: Terminated: ERROR {rc=237} [trial-2402↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29802)] 08:46:07.477450 run osmo-hlr_10.42.42.2(pid=29802): stdout: | (launched: 2022-12-14_08:46:04.415721) 08:46:07.529254 run osmo-hlr_10.42.42.2(pid=29802): stderr: | 20221214084604614 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214084604615 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214084604615 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214084604615 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214084604615 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214084604615 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214084604676 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214084604684 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214084604684 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214084604684 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:46:07.602174 run osmo-msc_10.42.42.6(pid=29808): ERR: Terminated: ERROR {rc=2} [trial-2402↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29808)] 08:46:07.652432 run osmo-msc_10.42.42.6(pid=29808): stdout: | (launched: 2022-12-14_08:46:06.460710) 08:46:07.705056 run osmo-msc_10.42.42.6(pid=29808): stderr: | 20221214084606783 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214084606783 DLGLOBAL DEBUG validating counter group 0x7f61a1fb9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214084606783 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214084606783 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214084606783 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214084606784 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214084606785 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214084606786 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214084606786 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214084606786 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:46:07.756917 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29801): Terminating (SIGTERM) 08:46:07.798669 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29804): Terminating (SIGTERM) 08:46:07.840221 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29807): Terminating (SIGTERM) 08:46:07.881802 --- ParallelTerminationStrategy: PID 29801 died... 08:46:07.901654 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29801): Terminated: ok {rc=0} 08:46:07.947604 --- ParallelTerminationStrategy: PID 29804 died... 08:46:07.966861 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29804): Terminated: ok {rc=0} 08:46:08.012613 --- ParallelTerminationStrategy: PID 29807 died... 08:46:08.032049 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29807): Terminated: ok {rc=0} 08:46:08.119538 bus /sierra_3: Setting Powered False 08:46:09.217737 bus /sierra_3: Setting Powered False 08:46:10.331709 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2402 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 voice:trx-b200+mod-bts0-dynts-osmo --------------------------------------------------------------------- 08:46:11.586747 tst voice:trx-b200+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:46:11.593057 tst voice:trx-b200+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 08:46:11.627483 tst voice:trx-b200+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 08:46:11.654983 tst voice:trx-b200+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 08:46:11.708092 tst voice:trx-b200+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 08:46:11.742069 tst voice:trx-b200+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 08:46:11.769488 tst voice:trx-b200+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 08:46:12.320811 tst voice:trx-b200+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2402 voice:trx-b200+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 08:46:12.372444 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 08:46:12.383895 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 08:46:12.456537 tst mo_mt_call.py: using LAC 39757 08:46:12.585770 tst mo_mt_call.py: using RAC 232 08:46:12.713115 tst mo_mt_call.py: using CellId 39757 08:46:12.839956 tst mo_mt_call.py: using BVCI 39758 08:46:12.957993 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 08:46:12.969399 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 08:46:12.980569 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 08:46:12.991797 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 08:46:13.003170 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 08:46:13.014549 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 08:46:13.134510 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 08:46:13.250469 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:46:13.723378 run create_hlr_db(pid=29813): Launched 08:46:13.839912 bus /sierra_2: Setting Powered False 08:46:14.901238 run create_hlr_db(pid=29813): Terminated: ok {rc=0} 08:46:15.343345 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29815): Launched 08:46:15.670320 run osmo-hlr_10.42.42.2(pid=29816): Launched 08:46:15.794714 run osmo-stp_10.42.42.5: Starting osmo-stp 08:46:16.445980 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29818): Launched 08:46:16.817944 run osmo-stp_10.42.42.5(pid=29819): Launched 08:46:17.123011 run osmo-msc_10.42.42.6: Starting osmo-msc 08:46:17.790521 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29821): Launched 08:46:18.116079 run osmo-msc_10.42.42.6(pid=29822): Launched 08:46:18.296287 run osmo-stp_10.42.42.5(pid=29819): ERR: Terminated: ERROR {rc=1} [trial-2402↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29819)] 08:46:18.431911 run osmo-stp_10.42.42.5(pid=29819): stdout: | (launched: 2022-12-14_08:46:16.760722) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:46:18.567478 run osmo-stp_10.42.42.5(pid=29819): stderr: | 20221214084616993 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214084616994 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214084616994 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214084616994 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214084616995 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214084616995 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214084616995 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:46:18.703446 run osmo-stp_10.42.42.5(pid=29819): stdout: | (launched: 2022-12-14_08:46:16.760722) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:46:18.831818 run osmo-stp_10.42.42.5(pid=29819): stderr: | 20221214084616993 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214084616994 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214084616994 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214084616994 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214084616995 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214084616995 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214084616995 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:46:18.985468 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29819): Process ended prematurely: osmo-stp_10.42.42.5(pid=29819) [trial-2402↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29819)] [trial-2402↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 08:46:18.995067 tst mo_mt_call.py:8: Test FAILED (6.7 sec) 08:46:19.022601 run osmo-hlr_10.42.42.2(pid=29816): ERR: Terminated: ERROR {rc=237} [trial-2402↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29816)] 08:46:19.072459 run osmo-hlr_10.42.42.2(pid=29816): stdout: | (launched: 2022-12-14_08:46:15.610444) 08:46:19.124196 run osmo-hlr_10.42.42.2(pid=29816): stderr: | 20221214084615807 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214084615807 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214084615807 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214084615808 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214084615808 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214084615808 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214084615821 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/voice:trx-b200+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214084615831 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214084615831 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214084615831 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:46:19.196446 run osmo-msc_10.42.42.6(pid=29822): ERR: Terminated: ERROR {rc=2} [trial-2402↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29822)] 08:46:19.246358 run osmo-msc_10.42.42.6(pid=29822): stdout: | (launched: 2022-12-14_08:46:18.056000) 08:46:19.298092 run osmo-msc_10.42.42.6(pid=29822): stderr: | 20221214084618378 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214084618378 DLGLOBAL DEBUG validating counter group 0x7f506f5a9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214084618378 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214084618378 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214084618378 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214084618378 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214084618380 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214084618380 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214084618381 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214084618381 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:46:19.350039 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29815): Terminating (SIGTERM) 08:46:19.391429 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29818): Terminating (SIGTERM) 08:46:19.433751 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29821): Terminating (SIGTERM) 08:46:19.476218 --- ParallelTerminationStrategy: PID 29815 died... 08:46:19.496332 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29815): Terminated: ok {rc=0} 08:46:19.543161 --- ParallelTerminationStrategy: PID 29818 died... 08:46:19.562874 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29818): Terminated: ok {rc=0} 08:46:19.609278 --- ParallelTerminationStrategy: PID 29821 died... 08:46:19.628766 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29821): Terminated: ok {rc=0} 08:46:19.718163 bus /sierra_3: Setting Powered False 08:46:20.817781 bus /sierra_3: Setting Powered False 08:46:21.933357 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2402 voice:trx-b200+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 08:46:23.083108 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 08:46:23.095342 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 08:46:23.168720 tst mo_mt_call_osmux.py: using LAC 39758 08:46:23.290323 tst mo_mt_call_osmux.py: using RAC 233 08:46:23.410375 tst mo_mt_call_osmux.py: using CellId 39758 08:46:23.532687 tst mo_mt_call_osmux.py: using BVCI 39759 08:46:23.645461 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 08:46:23.656341 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 08:46:23.667276 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 08:46:23.678060 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 08:46:23.689097 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 08:46:23.700089 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 08:46:23.819773 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 08:46:23.938800 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:46:24.412709 run create_hlr_db(pid=29824): Launched 08:46:24.528286 bus /sierra_2: Setting Powered False 08:46:25.589672 run create_hlr_db(pid=29824): Terminated: ok {rc=0} 08:46:26.032034 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29826): Launched 08:46:26.358821 run osmo-hlr_10.42.42.2(pid=29827): Launched 08:46:26.484778 run osmo-stp_10.42.42.5: Starting osmo-stp 08:46:27.043907 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29829): Launched 08:46:27.368099 run osmo-stp_10.42.42.5(pid=29830): Launched 08:46:27.491338 run osmo-msc_10.42.42.6: Starting osmo-msc 08:46:28.079860 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29832): Launched 08:46:28.407048 run osmo-msc_10.42.42.6(pid=29833): Launched 08:46:28.589573 run osmo-stp_10.42.42.5(pid=29830): ERR: Terminated: ERROR {rc=1} [trial-2402↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29830)] 08:46:28.726473 run osmo-stp_10.42.42.5(pid=29830): stdout: | (launched: 2022-12-14_08:46:27.308387) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:46:28.863043 run osmo-stp_10.42.42.5(pid=29830): stderr: | 20221214084627501 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214084627501 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214084627502 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214084627502 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214084627503 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214084627503 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214084627503 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:46:28.999689 run osmo-stp_10.42.42.5(pid=29830): stdout: | (launched: 2022-12-14_08:46:27.308387) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:46:29.128759 run osmo-stp_10.42.42.5(pid=29830): stderr: | 20221214084627501 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214084627501 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214084627502 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214084627502 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214084627503 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214084627503 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214084627503 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:46:29.283810 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29830): Process ended prematurely: osmo-stp_10.42.42.5(pid=29830) [trial-2402↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29830)] [trial-2402↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 08:46:29.293754 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 08:46:29.321932 run osmo-hlr_10.42.42.2(pid=29827): ERR: Terminated: ERROR {rc=237} [trial-2402↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29827)] 08:46:29.372553 run osmo-hlr_10.42.42.2(pid=29827): stdout: | (launched: 2022-12-14_08:46:26.298925) 08:46:29.425322 run osmo-hlr_10.42.42.2(pid=29827): stderr: | 20221214084626497 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214084626497 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214084626497 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214084626497 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214084626497 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214084626497 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214084626559 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/voice:trx-b200+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214084626567 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214084626567 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214084626568 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:46:29.497949 run osmo-msc_10.42.42.6(pid=29833): ERR: Terminated: ERROR {rc=2} [trial-2402↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29833)] 08:46:29.548528 run osmo-msc_10.42.42.6(pid=29833): stdout: | (launched: 2022-12-14_08:46:28.346512) 08:46:29.600785 run osmo-msc_10.42.42.6(pid=29833): stderr: | 20221214084628672 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214084628672 DLGLOBAL DEBUG validating counter group 0x7f4617ad1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214084628672 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214084628672 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214084628672 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214084628673 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214084628674 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214084628675 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214084628675 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214084628675 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:46:29.653813 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29826): Terminating (SIGTERM) 08:46:29.695710 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29829): Terminating (SIGTERM) 08:46:29.737481 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29832): Terminating (SIGTERM) 08:46:29.779630 --- ParallelTerminationStrategy: PID 29826 died... 08:46:29.799742 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29826): Terminated: ok {rc=0} 08:46:29.846311 --- ParallelTerminationStrategy: PID 29829 died... 08:46:29.866019 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29829): Terminated: ok {rc=0} 08:46:29.912483 --- ParallelTerminationStrategy: PID 29832 died... 08:46:29.932097 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29832): Terminated: ok {rc=0} 08:46:30.020194 bus /sierra_3: Setting Powered False 08:46:31.117474 bus /sierra_3: Setting Powered False 08:46:32.237937 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2402 voice:trx-b200+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 voice:trx-b200+mod-bts0-trxdversion0 --------------------------------------------------------------------- 08:46:33.497122 tst voice:trx-b200+mod-bts0-trxdversion0: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:46:33.502620 tst voice:trx-b200+mod-bts0-trxdversion0: Verifying 1 x bts (candidates: 11) 08:46:33.536246 tst voice:trx-b200+mod-bts0-trxdversion0: Verifying 6 x ip_address (candidates: 9) 08:46:33.563759 tst voice:trx-b200+mod-bts0-trxdversion0: Verifying 2 x modem (candidates: 12) 08:46:33.616188 tst voice:trx-b200+mod-bts0-trxdversion0: Reserving 1 x bts (candidates: 11) 08:46:33.650332 tst voice:trx-b200+mod-bts0-trxdversion0: Reserving 6 x ip_address (candidates: 9) 08:46:33.677488 tst voice:trx-b200+mod-bts0-trxdversion0: Reserving 2 x modem (candidates: 12) 08:46:34.228454 tst voice:trx-b200+mod-bts0-trxdversion0: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2402 voice:trx-b200+mod-bts0-trxdversion0 mo_mt_call.py ---------------------------------------------- 08:46:34.279799 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 08:46:34.291193 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x bts (candidates: 1) 08:46:34.342857 tst mo_mt_call.py: using LAC 39759 08:46:34.471126 tst mo_mt_call.py: using RAC 234 08:46:34.600910 tst mo_mt_call.py: using CellId 39759 08:46:34.729585 tst mo_mt_call.py: using BVCI 39760 08:46:34.849068 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 08:46:34.860587 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 08:46:34.871831 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 08:46:34.883027 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 08:46:34.894203 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 08:46:34.905523 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 08:46:35.023392 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 08:46:35.140223 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:46:35.615010 run create_hlr_db(pid=29838): Launched 08:46:35.731540 bus /sierra_2: Setting Powered False 08:46:36.791868 run create_hlr_db(pid=29838): Terminated: ok {rc=0} 08:46:37.236069 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29840): Launched 08:46:37.561866 run osmo-hlr_10.42.42.2(pid=29841): Launched 08:46:37.687115 run osmo-stp_10.42.42.5: Starting osmo-stp 08:46:38.247481 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29843): Launched 08:46:38.573063 run osmo-stp_10.42.42.5(pid=29844): Launched 08:46:38.699521 run osmo-msc_10.42.42.6: Starting osmo-msc 08:46:39.286736 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29846): Launched 08:46:39.612449 run osmo-msc_10.42.42.6(pid=29847): Launched 08:46:39.794402 run osmo-stp_10.42.42.5(pid=29844): ERR: Terminated: ERROR {rc=1} [trial-2402↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29844)] 08:46:39.929607 run osmo-stp_10.42.42.5(pid=29844): stdout: | (launched: 2022-12-14_08:46:38.513491) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:46:40.065646 run osmo-stp_10.42.42.5(pid=29844): stderr: | 20221214084638709 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214084638709 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214084638709 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214084638709 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214084638710 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214084638710 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214084638710 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:46:40.201601 run osmo-stp_10.42.42.5(pid=29844): stdout: | (launched: 2022-12-14_08:46:38.513491) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:46:40.329904 run osmo-stp_10.42.42.5(pid=29844): stderr: | 20221214084638709 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214084638709 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214084638709 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214084638709 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214084638710 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214084638710 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214084638710 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:46:40.484189 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29844): Process ended prematurely: osmo-stp_10.42.42.5(pid=29844) [trial-2402↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29844)] [trial-2402↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8] 08:46:40.494013 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 08:46:40.521949 run osmo-hlr_10.42.42.2(pid=29841): ERR: Terminated: ERROR {rc=237} [trial-2402↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29841)] 08:46:40.572096 run osmo-hlr_10.42.42.2(pid=29841): stdout: | (launched: 2022-12-14_08:46:37.501869) 08:46:40.623865 run osmo-hlr_10.42.42.2(pid=29841): stderr: | 20221214084637700 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214084637700 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214084637700 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214084637700 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214084637700 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214084637701 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214084637736 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/voice:trx-b200+mod-bts0-trxdversion0/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214084637745 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214084637745 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214084637745 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:46:40.697815 run osmo-msc_10.42.42.6(pid=29847): ERR: Terminated: ERROR {rc=2} [trial-2402↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29847)] 08:46:40.747835 run osmo-msc_10.42.42.6(pid=29847): stdout: | (launched: 2022-12-14_08:46:39.552691) 08:46:40.799460 run osmo-msc_10.42.42.6(pid=29847): stderr: | 20221214084639876 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214084639877 DLGLOBAL DEBUG validating counter group 0x7f1b9f8c4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214084639877 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214084639877 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214084639877 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214084639877 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214084639879 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214084639879 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214084639879 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214084639879 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:46:40.851550 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29840): Terminating (SIGTERM) 08:46:40.893153 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29843): Terminating (SIGTERM) 08:46:40.935096 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29846): Terminating (SIGTERM) 08:46:40.977411 --- ParallelTerminationStrategy: PID 29840 died... 08:46:40.997796 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29840): Terminated: ok {rc=0} 08:46:41.044342 --- ParallelTerminationStrategy: PID 29843 died... 08:46:41.064221 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29843): Terminated: ok {rc=0} 08:46:41.110408 --- ParallelTerminationStrategy: PID 29846 died... 08:46:41.130540 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29846): Terminated: ok {rc=0} 08:46:41.218945 bus /sierra_3: Setting Powered False 08:46:42.318097 bus /sierra_3: Setting Powered False 08:46:43.436413 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2402 voice:trx-b200+mod-bts0-trxdversion0 mo_mt_call_osmux.py ---------------------------------------------- 08:46:44.584097 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 08:46:44.595634 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x bts (candidates: 1) 08:46:44.645500 tst mo_mt_call_osmux.py: using LAC 39760 08:46:44.765608 tst mo_mt_call_osmux.py: using RAC 235 08:46:44.885254 tst mo_mt_call_osmux.py: using CellId 39760 08:46:45.004724 tst mo_mt_call_osmux.py: using BVCI 39761 08:46:45.115402 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 08:46:45.126476 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 08:46:45.137355 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 08:46:45.147998 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 08:46:45.159151 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 08:46:45.170710 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 08:46:45.286758 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 08:46:45.405437 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:46:45.921821 run create_hlr_db(pid=29849): Launched 08:46:46.096476 bus /sierra_2: Setting Powered False 08:46:47.156412 run create_hlr_db(pid=29849): Terminated: ok {rc=0} 08:46:47.613534 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29851): Launched 08:46:47.938901 run osmo-hlr_10.42.42.2(pid=29852): Launched 08:46:48.064514 run osmo-stp_10.42.42.5: Starting osmo-stp 08:46:48.627328 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29854): Launched 08:46:48.953809 run osmo-stp_10.42.42.5(pid=29855): Launched 08:46:49.079342 run osmo-msc_10.42.42.6: Starting osmo-msc 08:46:49.667690 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29857): Launched 08:46:49.994494 run osmo-msc_10.42.42.6(pid=29858): Launched 08:46:50.177695 run osmo-stp_10.42.42.5(pid=29855): ERR: Terminated: ERROR {rc=1} [trial-2402↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29855)] 08:46:50.313772 run osmo-stp_10.42.42.5(pid=29855): stdout: | (launched: 2022-12-14_08:46:48.894171) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:46:50.450690 run osmo-stp_10.42.42.5(pid=29855): stderr: | 20221214084649088 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214084649088 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214084649088 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214084649088 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214084649089 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214084649089 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214084649089 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:46:50.588079 run osmo-stp_10.42.42.5(pid=29855): stdout: | (launched: 2022-12-14_08:46:48.894171) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:46:50.718484 run osmo-stp_10.42.42.5(pid=29855): stderr: | 20221214084649088 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214084649088 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214084649088 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214084649088 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214084649089 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214084649089 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214084649089 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:46:50.873083 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29855): Process ended prematurely: osmo-stp_10.42.42.5(pid=29855) [trial-2402↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29855)] [trial-2402↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8] 08:46:50.882709 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 08:46:50.910484 run osmo-hlr_10.42.42.2(pid=29852): ERR: Terminated: ERROR {rc=237} [trial-2402↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29852)] 08:46:50.961120 run osmo-hlr_10.42.42.2(pid=29852): stdout: | (launched: 2022-12-14_08:46:47.879185) 08:46:51.013129 run osmo-hlr_10.42.42.2(pid=29852): stderr: | 20221214084648078 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214084648078 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214084648078 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214084648078 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214084648078 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214084648078 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214084648092 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/voice:trx-b200+mod-bts0-trxdversion0/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214084648100 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214084648100 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214084648100 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:46:51.085559 run osmo-msc_10.42.42.6(pid=29858): ERR: Terminated: ERROR {rc=2} [trial-2402↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29858)] 08:46:51.135797 run osmo-msc_10.42.42.6(pid=29858): stdout: | (launched: 2022-12-14_08:46:49.934707) 08:46:51.187634 run osmo-msc_10.42.42.6(pid=29858): stderr: | 20221214084650258 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214084650258 DLGLOBAL DEBUG validating counter group 0x7feb1be7cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214084650258 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214084650258 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214084650258 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214084650259 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214084650260 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214084650262 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214084650262 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214084650262 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:46:51.239822 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29851): Terminating (SIGTERM) 08:46:51.281375 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29854): Terminating (SIGTERM) 08:46:51.323168 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29857): Terminating (SIGTERM) 08:46:51.365117 --- ParallelTerminationStrategy: PID 29851 died... 08:46:51.385206 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29851): Terminated: ok {rc=0} 08:46:51.431295 --- ParallelTerminationStrategy: PID 29854 died... 08:46:51.450906 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29854): Terminated: ok {rc=0} 08:46:51.496678 --- ParallelTerminationStrategy: PID 29857 died... 08:46:51.516220 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29857): Terminated: ok {rc=0} 08:46:51.603293 bus /sierra_3: Setting Powered False 08:46:52.701572 bus /sierra_3: Setting Powered False 08:46:53.816022 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2402 voice:trx-b200+mod-bts0-trxdversion0 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 08:46:55.070562 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:46:55.077515 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 08:46:55.111414 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 6 x ip_address (candidates: 9) 08:46:55.138725 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 2 x modem (candidates: 12) 08:46:55.190830 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 08:46:55.225233 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 6 x ip_address (candidates: 9) 08:46:55.252867 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 2 x modem (candidates: 12) 08:46:55.806887 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2402 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call.py ---------------------------------------------- 08:46:55.859730 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 08:46:55.871668 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 08:46:55.925322 tst mo_mt_call.py: using LAC 39761 08:46:56.051744 tst mo_mt_call.py: using RAC 236 08:46:56.177493 tst mo_mt_call.py: using CellId 39761 08:46:56.302448 tst mo_mt_call.py: using BVCI 39762 08:46:56.420618 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 08:46:56.432447 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 08:46:56.444083 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 08:46:56.455770 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 08:46:56.467492 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 08:46:56.479165 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 08:46:56.597887 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 08:46:56.716604 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:46:57.189056 run create_hlr_db(pid=29863): Launched 08:46:57.306023 bus /sierra_2: Setting Powered False 08:46:58.366586 run create_hlr_db(pid=29863): Terminated: ok {rc=0} 08:46:58.811928 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29865): Launched 08:46:59.138416 run osmo-hlr_10.42.42.2(pid=29866): Launched 08:46:59.263190 run osmo-stp_10.42.42.5: Starting osmo-stp 08:46:59.822455 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29868): Launched 08:47:00.148462 run osmo-stp_10.42.42.5(pid=29869): Launched 08:47:00.273669 run osmo-msc_10.42.42.6: Starting osmo-msc 08:47:00.874043 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29871): Launched 08:47:01.213252 run osmo-msc_10.42.42.6(pid=29872): Launched 08:47:01.506742 run osmo-stp_10.42.42.5(pid=29869): ERR: Terminated: ERROR {rc=1} [trial-2402↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29869)] 08:47:01.671212 run osmo-stp_10.42.42.5(pid=29869): stdout: | (launched: 2022-12-14_08:47:00.088588) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:47:01.962659 run osmo-stp_10.42.42.5(pid=29869): stderr: | 20221214084700282 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214084700282 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214084700283 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214084700283 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214084700283 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214084700284 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214084700284 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:47:02.140020 run osmo-stp_10.42.42.5(pid=29869): stdout: | (launched: 2022-12-14_08:47:00.088588) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:47:02.267229 run osmo-stp_10.42.42.5(pid=29869): stderr: | 20221214084700282 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214084700282 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214084700283 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214084700283 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214084700283 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214084700284 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214084700284 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:47:02.421784 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29869): Process ended prematurely: osmo-stp_10.42.42.5(pid=29869) [trial-2402↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29869)] [trial-2402↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8] 08:47:02.431496 tst mo_mt_call.py:8: Test FAILED (6.6 sec) 08:47:02.458701 run osmo-hlr_10.42.42.2(pid=29866): ERR: Terminated: ERROR {rc=237} [trial-2402↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29866)] 08:47:02.507879 run osmo-hlr_10.42.42.2(pid=29866): stdout: | (launched: 2022-12-14_08:46:59.078743) 08:47:02.558179 run osmo-hlr_10.42.42.2(pid=29866): stderr: | 20221214084659277 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214084659277 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214084659277 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214084659277 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214084659277 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214084659277 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214084659289 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214084659297 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214084659297 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214084659297 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:47:02.628667 run osmo-msc_10.42.42.6(pid=29872): ERR: Terminated: ERROR {rc=2} [trial-2402↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29872)] 08:47:02.677285 run osmo-msc_10.42.42.6(pid=29872): stdout: | (launched: 2022-12-14_08:47:01.151663) 08:47:02.727374 run osmo-msc_10.42.42.6(pid=29872): stderr: | 20221214084701776 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214084701777 DLGLOBAL DEBUG validating counter group 0x7fe167213c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214084701777 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214084701777 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214084701777 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214084701777 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214084701785 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214084701785 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214084701785 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214084701786 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:47:02.778061 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29865): Terminating (SIGTERM) 08:47:02.818752 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29868): Terminating (SIGTERM) 08:47:02.859431 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29871): Terminating (SIGTERM) 08:47:02.900357 --- ParallelTerminationStrategy: PID 29865 died... 08:47:02.919856 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29865): Terminated: ok {rc=0} 08:47:02.964845 --- ParallelTerminationStrategy: PID 29868 died... 08:47:02.984292 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29868): Terminated: ok {rc=0} 08:47:03.029505 --- ParallelTerminationStrategy: PID 29871 died... 08:47:03.048940 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29871): Terminated: ok {rc=0} 08:47:03.135494 bus /sierra_3: Setting Powered False 08:47:04.233605 bus /sierra_3: Setting Powered False 08:47:05.348271 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2402 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call_osmux.py ---------------------------------------------- 08:47:06.494091 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 08:47:06.506201 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 08:47:06.562857 tst mo_mt_call_osmux.py: using LAC 39762 08:47:06.684813 tst mo_mt_call_osmux.py: using RAC 237 08:47:06.804180 tst mo_mt_call_osmux.py: using CellId 39762 08:47:06.921338 tst mo_mt_call_osmux.py: using BVCI 39763 08:47:07.031587 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 08:47:07.042973 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 08:47:07.054197 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 08:47:07.065326 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 08:47:07.076806 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 08:47:07.088191 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 08:47:07.209113 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 08:47:07.331078 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:47:07.804809 run create_hlr_db(pid=29874): Launched 08:47:07.921226 bus /sierra_2: Setting Powered False 08:47:08.981667 run create_hlr_db(pid=29874): Terminated: ok {rc=0} 08:47:09.405216 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29876): Launched 08:47:09.709436 run osmo-hlr_10.42.42.2(pid=29877): Launched 08:47:09.826348 run osmo-stp_10.42.42.5: Starting osmo-stp 08:47:10.357339 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29879): Launched 08:47:10.660714 run osmo-stp_10.42.42.5(pid=29880): Launched 08:47:10.778645 run osmo-msc_10.42.42.6: Starting osmo-msc 08:47:11.328678 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29882): Launched 08:47:11.632905 run osmo-msc_10.42.42.6(pid=29883): Launched 08:47:11.804566 run osmo-stp_10.42.42.5(pid=29880): ERR: Terminated: ERROR {rc=1} [trial-2402↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29880)] 08:47:11.933885 run osmo-stp_10.42.42.5(pid=29880): stdout: | (launched: 2022-12-14_08:47:10.604272) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:47:12.062187 run osmo-stp_10.42.42.5(pid=29880): stderr: | 20221214084710777 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214084710777 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214084710777 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214084710778 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214084710778 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214084710778 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214084710778 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:47:12.188298 run osmo-stp_10.42.42.5(pid=29880): stdout: | (launched: 2022-12-14_08:47:10.604272) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:47:12.308632 run osmo-stp_10.42.42.5(pid=29880): stderr: | 20221214084710777 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214084710777 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214084710777 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214084710778 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214084710778 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214084710778 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214084710778 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:47:12.452340 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29880): Process ended prematurely: osmo-stp_10.42.42.5(pid=29880) [trial-2402↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29880)] [trial-2402↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8] 08:47:12.461443 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 08:47:12.487506 run osmo-hlr_10.42.42.2(pid=29877): ERR: Terminated: ERROR {rc=237} [trial-2402↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29877)] 08:47:12.535740 run osmo-hlr_10.42.42.2(pid=29877): stdout: | (launched: 2022-12-14_08:47:09.653285) 08:47:12.585070 run osmo-hlr_10.42.42.2(pid=29877): stderr: | 20221214084709828 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214084709828 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214084709829 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214084709829 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214084709829 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214084709829 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214084709840 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214084709848 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214084709849 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214084709849 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:47:12.654338 run osmo-msc_10.42.42.6(pid=29883): ERR: Terminated: ERROR {rc=2} [trial-2402↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29883)] 08:47:12.701613 run osmo-msc_10.42.42.6(pid=29883): stdout: | (launched: 2022-12-14_08:47:11.576787) 08:47:12.751165 run osmo-msc_10.42.42.6(pid=29883): stderr: | 20221214084711850 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214084711850 DLGLOBAL DEBUG validating counter group 0x7ff9928e2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214084711850 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214084711850 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214084711850 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214084711851 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214084711852 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214084711853 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214084711853 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214084711853 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:47:12.800770 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29876): Terminating (SIGTERM) 08:47:12.840381 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29879): Terminating (SIGTERM) 08:47:12.879940 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29882): Terminating (SIGTERM) 08:47:12.919671 --- ParallelTerminationStrategy: PID 29876 died... 08:47:12.939127 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29876): Terminated: ok {rc=0} 08:47:12.983008 --- ParallelTerminationStrategy: PID 29879 died... 08:47:13.001740 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29879): Terminated: ok {rc=0} 08:47:13.045454 --- ParallelTerminationStrategy: PID 29882 died... 08:47:13.064094 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29882): Terminated: ok {rc=0} 08:47:13.150197 bus /sierra_3: Setting Powered False 08:47:14.248170 bus /sierra_3: Setting Powered False 08:47:15.363379 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2402 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 emergency:trx-b200 --------------------------------------------------------------------- 08:47:16.623196 tst emergency:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:47:16.628558 tst emergency:trx-b200: Verifying 1 x bts (candidates: 11) 08:47:16.673898 tst emergency:trx-b200: Verifying 6 x ip_address (candidates: 9) 08:47:16.705730 tst emergency:trx-b200: Verifying 4 x modem (candidates: 12) 08:47:16.816387 tst emergency:trx-b200: Reserving 1 x bts (candidates: 11) 08:47:16.872396 tst emergency:trx-b200: Reserving 6 x ip_address (candidates: 9) 08:47:16.905734 tst emergency:trx-b200: Reserving 4 x modem (candidates: 12) 08:47:17.457917 tst emergency:trx-b200: RESERVED RESOURCES for emergency: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2402 emergency:trx-b200 emergency_mo_mt_call.py ---------------------------------------------- 08:47:17.463723 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 08:47:17.474672 tst emergency:trx-b200: Using 1 x bts (candidates: 1) 08:47:17.523754 tst emergency_mo_mt_call.py: using LAC 39763 08:47:17.650502 tst emergency_mo_mt_call.py: using RAC 238 08:47:17.777146 tst emergency_mo_mt_call.py: using CellId 39763 08:47:17.901850 tst emergency_mo_mt_call.py: using BVCI 39764 08:47:18.017470 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 08:47:18.028781 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 08:47:18.039965 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 08:47:18.050959 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 08:47:18.061963 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 08:47:18.073486 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 08:47:18.189361 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 08:47:18.306245 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:47:18.768482 run create_hlr_db(pid=29889): Launched 08:47:18.883289 bus /sierra_2: Setting Powered False 08:47:19.942120 run create_hlr_db(pid=29889): Terminated: ok {rc=0} 08:47:20.378284 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29891): Launched 08:47:20.697854 run osmo-hlr_10.42.42.2(pid=29892): Launched 08:47:20.820319 run osmo-stp_10.42.42.5: Starting osmo-stp 08:47:21.366203 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29894): Launched 08:47:21.685984 run osmo-stp_10.42.42.5(pid=29895): Launched 08:47:21.817077 tst emergency_mo_mt_call.py: using MSISDN 8599 08:47:21.979626 run osmo-msc_10.42.42.6: Starting osmo-msc 08:47:22.551541 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29897): Launched 08:47:22.871035 run osmo-msc_10.42.42.6(pid=29898): Launched 08:47:23.047710 run osmo-stp_10.42.42.5(pid=29895): ERR: Terminated: ERROR {rc=1} [trial-2402↪emergency:trx-b200↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29895)] 08:47:23.181317 run osmo-stp_10.42.42.5(pid=29895): stdout: | (launched: 2022-12-14_08:47:21.626696) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:47:23.315898 run osmo-stp_10.42.42.5(pid=29895): stderr: | 20221214084721819 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214084721819 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214084721819 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214084721820 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214084721820 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214084721820 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214084721820 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:47:23.449304 run osmo-stp_10.42.42.5(pid=29895): stdout: | (launched: 2022-12-14_08:47:21.626696) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:47:23.574824 run osmo-stp_10.42.42.5(pid=29895): stderr: | 20221214084721819 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214084721819 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214084721819 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214084721820 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214084721820 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214084721820 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214084721820 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:47:23.725651 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=29895): Process ended prematurely: osmo-stp_10.42.42.5(pid=29895) [trial-2402↪emergency:trx-b200↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29895)] [trial-2402↪emergency:trx-b200↪emergency_mo_mt_call.py:19] 08:47:23.734737 tst emergency_mo_mt_call.py:19: Test FAILED (6.3 sec) 08:47:23.761813 run osmo-hlr_10.42.42.2(pid=29892): ERR: Terminated: ERROR {rc=237} [trial-2402↪emergency:trx-b200↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29892)] 08:47:23.811590 run osmo-hlr_10.42.42.2(pid=29892): stdout: | (launched: 2022-12-14_08:47:20.638588) 08:47:23.863134 run osmo-hlr_10.42.42.2(pid=29892): stderr: | 20221214084720835 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214084720835 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214084720835 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214084720835 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214084720835 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214084720835 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214084720847 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/emergency:trx-b200/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214084720855 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214084720855 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214084720856 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:47:23.935141 run osmo-msc_10.42.42.6(pid=29898): ERR: Terminated: ERROR {rc=2} [trial-2402↪emergency:trx-b200↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29898)] 08:47:23.984761 run osmo-msc_10.42.42.6(pid=29898): stdout: | (launched: 2022-12-14_08:47:22.812123) 08:47:24.036286 run osmo-msc_10.42.42.6(pid=29898): stderr: | 20221214084723133 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214084723133 DLGLOBAL DEBUG validating counter group 0x7fbf4ae80c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214084723134 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214084723134 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214084723134 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214084723134 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214084723136 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214084723136 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214084723136 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214084723136 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:47:24.088013 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29891): Terminating (SIGTERM) 08:47:24.129716 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29894): Terminating (SIGTERM) 08:47:24.171236 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29897): Terminating (SIGTERM) 08:47:24.213330 --- ParallelTerminationStrategy: PID 29891 died... 08:47:24.233195 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29891): Terminated: ok {rc=0} 08:47:24.278952 --- ParallelTerminationStrategy: PID 29894 died... 08:47:24.298323 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29894): Terminated: ok {rc=0} 08:47:24.344000 --- ParallelTerminationStrategy: PID 29897 died... 08:47:24.363322 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29897): Terminated: ok {rc=0} 08:47:24.449631 bus /sierra_3: Setting Powered False 08:47:25.548527 bus /sierra_3: Setting Powered False 08:47:26.664801 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2402 emergency:trx-b200 emergency_preemptive_call.py ---------------------------------------------- 08:47:27.751146 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 08:47:27.763219 tst emergency:trx-b200: Using 1 x bts (candidates: 1) 08:47:27.815266 tst emergency_preemptive_call.py: using LAC 39764 08:47:27.941868 tst emergency_preemptive_call.py: using RAC 239 08:47:28.066096 tst emergency_preemptive_call.py: using CellId 39764 08:47:28.190365 tst emergency_preemptive_call.py: using BVCI 39765 08:47:28.305547 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 08:47:28.316761 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 08:47:28.327931 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 08:47:28.339096 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 08:47:28.350231 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 08:47:28.361432 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 08:47:28.479350 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 08:47:28.595198 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 08:47:28.708785 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 08:47:28.826726 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:47:29.323361 run create_hlr_db(pid=29900): Launched 08:47:29.453981 bus /sierra_2: Setting Powered False 08:47:30.517088 run create_hlr_db(pid=29900): Terminated: ok {rc=0} 08:47:30.967542 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29902): Launched 08:47:31.284505 run osmo-hlr_10.42.42.2(pid=29903): Launched 08:47:31.537609 run osmo-stp_10.42.42.5: Starting osmo-stp 08:47:32.327824 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29905): Launched 08:47:32.647688 run osmo-stp_10.42.42.5(pid=29906): Launched 08:47:32.773295 tst emergency_preemptive_call.py: using MSISDN 8600 08:47:32.926426 run osmo-msc_10.42.42.6: Starting osmo-msc 08:47:33.462374 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29908): Launched 08:47:33.761995 run osmo-msc_10.42.42.6(pid=29909): Launched 08:47:33.930699 run osmo-stp_10.42.42.5(pid=29906): ERR: Terminated: ERROR {rc=1} [trial-2402↪emergency:trx-b200↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29906)] 08:47:34.057429 run osmo-stp_10.42.42.5(pid=29906): stdout: | (launched: 2022-12-14_08:47:32.592539) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:47:34.183723 run osmo-stp_10.42.42.5(pid=29906): stderr: | 20221214084732764 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214084732764 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214084732765 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214084732765 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214084732766 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214084732766 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214084732766 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:47:34.308305 run osmo-stp_10.42.42.5(pid=29906): stdout: | (launched: 2022-12-14_08:47:32.592539) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:47:34.426251 run osmo-stp_10.42.42.5(pid=29906): stderr: | 20221214084732764 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214084732764 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214084732765 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214084732765 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214084732766 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214084732766 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214084732766 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:47:34.567382 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=29906): Process ended prematurely: osmo-stp_10.42.42.5(pid=29906) [trial-2402↪emergency:trx-b200↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29906)] [trial-2402↪emergency:trx-b200↪emergency_preemptive_call.py:32] 08:47:34.576010 tst emergency_preemptive_call.py:32: Test FAILED (6.8 sec) 08:47:34.602513 run osmo-hlr_10.42.42.2(pid=29903): ERR: Terminated: ERROR {rc=237} [trial-2402↪emergency:trx-b200↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29903)] 08:47:34.651734 run osmo-hlr_10.42.42.2(pid=29903): stdout: | (launched: 2022-12-14_08:47:31.227134) 08:47:34.701924 run osmo-hlr_10.42.42.2(pid=29903): stderr: | 20221214084731521 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214084731521 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214084731521 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214084731521 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214084731521 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214084731521 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214084731540 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/emergency:trx-b200/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214084731567 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214084731567 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214084731567 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:47:34.772471 run osmo-msc_10.42.42.6(pid=29909): ERR: Terminated: ERROR {rc=2} [trial-2402↪emergency:trx-b200↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29909)] 08:47:34.820659 run osmo-msc_10.42.42.6(pid=29909): stdout: | (launched: 2022-12-14_08:47:33.706615) 08:47:34.870645 run osmo-msc_10.42.42.6(pid=29909): stderr: | 20221214084733975 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214084733975 DLGLOBAL DEBUG validating counter group 0x7fd7bd7efc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214084733975 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214084733975 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214084733975 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214084733976 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214084733977 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214084733978 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214084733978 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214084733978 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:47:34.921336 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29902): Terminating (SIGTERM) 08:47:34.961473 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29905): Terminating (SIGTERM) 08:47:35.001550 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29908): Terminating (SIGTERM) 08:47:35.042021 --- ParallelTerminationStrategy: PID 29902 died... 08:47:35.061744 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29902): Terminated: ok {rc=0} 08:47:35.106386 --- ParallelTerminationStrategy: PID 29905 died... 08:47:35.125638 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29905): Terminated: ok {rc=0} 08:47:35.170167 --- ParallelTerminationStrategy: PID 29908 died... 08:47:35.189432 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29908): Terminated: ok {rc=0} 08:47:35.275810 bus /sierra_9: Setting Powered False 08:47:36.374833 bus /sierra_9: Setting Powered False 08:47:37.487516 bus /sierra_8: Setting Powered False 08:47:38.585387 bus /sierra_8: Setting Powered False 08:47:39.701715 bus /sierra_3: Setting Powered False 08:47:40.800542 bus /sierra_3: Setting Powered False 08:47:41.920168 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2402 emergency:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 gprs:trx-b200 --------------------------------------------------------------------- 08:47:43.205049 tst gprs:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:47:43.209997 tst gprs:trx-b200: Verifying 1 x bts (candidates: 11) 08:47:43.243673 tst gprs:trx-b200: Verifying 9 x ip_address (candidates: 9) 08:47:43.283277 tst gprs:trx-b200: Verifying 4 x modem (candidates: 12) 08:47:43.370792 tst gprs:trx-b200: Reserving 1 x bts (candidates: 11) 08:47:43.404368 tst gprs:trx-b200: Reserving 9 x ip_address (candidates: 9) 08:47:43.443265 tst gprs:trx-b200: Reserving 4 x modem (candidates: 12) 08:47:44.038040 tst gprs:trx-b200: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2402 gprs:trx-b200 cs_paging_gprs_active.py ---------------------------------------------- 08:47:44.090297 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 08:47:44.101076 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 08:47:44.147788 tst cs_paging_gprs_active.py: using LAC 39765 08:47:44.265435 tst cs_paging_gprs_active.py: using RAC 240 08:47:44.392760 tst cs_paging_gprs_active.py: using CellId 39765 08:47:44.518159 tst cs_paging_gprs_active.py: using BVCI 39766 08:47:44.636017 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 08:47:44.647266 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 08:47:44.658332 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 08:47:44.669278 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 08:47:44.680438 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 08:47:44.691382 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 08:47:44.702515 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 08:47:44.713512 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 08:47:44.724570 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 08:47:44.841453 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 08:47:44.963306 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 08:47:45.183494 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:47:45.510134 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29914): Launched 08:47:45.793187 run iperf3-srv_10.42.42.10(pid=29915): Launched 08:47:45.950226 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 08:47:46.159940 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:47:46.482152 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29916): Launched 08:47:46.769273 run iperf3-srv_10.42.42.10(pid=29917): Launched 08:47:46.903203 tst cs_paging_gprs_active.py:38: start network... 08:47:47.112878 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:47:47.591489 run create_hlr_db(pid=29918): Launched 08:47:47.709239 bus /sierra_2: Setting Powered False 08:47:48.769251 run create_hlr_db(pid=29918): Terminated: ok {rc=0} 08:47:49.193681 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29920): Launched 08:47:49.498337 run osmo-hlr_10.42.42.2(pid=29921): Launched 08:47:49.615006 run osmo-stp_10.42.42.5: Starting osmo-stp 08:47:50.152429 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29923): Launched 08:47:50.457619 run osmo-stp_10.42.42.5(pid=29924): Launched 08:47:50.573842 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:47:51.100238 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29926): Launched 08:47:51.217071 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:47:51.474639 run patchelf(pid=29927): Launched 08:47:51.644095 run osmo-stp_10.42.42.5(pid=29924): ERR: Terminated: ERROR {rc=1} [trial-2402↪gprs:trx-b200↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29924)] 08:47:51.773419 run osmo-stp_10.42.42.5(pid=29924): stdout: | (launched: 2022-12-14_08:47:50.401522) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:47:51.904084 run osmo-stp_10.42.42.5(pid=29924): stderr: | 20221214084750570 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214084750570 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214084750570 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214084750571 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214084750571 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214084750571 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214084750571 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:47:52.034685 run osmo-stp_10.42.42.5(pid=29924): stdout: | (launched: 2022-12-14_08:47:50.401522) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:47:52.159636 run osmo-stp_10.42.42.5(pid=29924): stderr: | 20221214084750570 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214084750570 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214084750570 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214084750571 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214084750571 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214084750571 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214084750571 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:47:52.307657 run patchelf(pid=29927): Terminating (SIGINT) 08:47:52.477740 run patchelf(pid=29927): Terminated: ok {rc=0} 08:47:52.600267 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=29924): Process ended prematurely: osmo-stp_10.42.42.5(pid=29924) [trial-2402↪gprs:trx-b200↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29924)] [trial-2402↪gprs:trx-b200↪cs_paging_gprs_active.py:38] 08:47:52.610071 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 08:47:52.637170 run osmo-hlr_10.42.42.2(pid=29921): ERR: Terminated: ERROR {rc=237} [trial-2402↪gprs:trx-b200↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29921)] 08:47:52.685373 run osmo-hlr_10.42.42.2(pid=29921): stdout: | (launched: 2022-12-14_08:47:49.441965) 08:47:52.734927 run osmo-hlr_10.42.42.2(pid=29921): stderr: | 20221214084749617 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214084749617 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214084749617 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214084749617 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214084749617 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214084749618 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214084749640 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/gprs:trx-b200/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214084749649 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214084749649 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214084749649 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:47:52.785243 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29914): Terminating (SIGTERM) 08:47:52.825191 run iperf3-srv_10.42.42.10(pid=29915): Terminating (SIGTERM) 08:47:52.865244 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29916): Terminating (SIGTERM) 08:47:52.905583 run iperf3-srv_10.42.42.10(pid=29917): Terminating (SIGTERM) 08:47:52.945295 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29920): Terminating (SIGTERM) 08:47:52.985126 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29923): Terminating (SIGTERM) 08:47:53.024940 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29926): Terminating (SIGTERM) 08:47:53.065787 --- ParallelTerminationStrategy: PID 29914 died... 08:47:53.085382 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29914): Terminated: ok {rc=0} 08:47:53.130214 --- ParallelTerminationStrategy: PID 29915 died... 08:47:53.149108 run iperf3-srv_10.42.42.10(pid=29915): Terminated {rc=256} 08:47:53.193274 --- ParallelTerminationStrategy: PID 29916 died... 08:47:53.211892 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29916): Terminated: ok {rc=0} 08:47:53.255777 --- ParallelTerminationStrategy: PID 29917 died... 08:47:53.274628 run iperf3-srv_10.42.42.10(pid=29917): Terminated {rc=256} 08:47:53.318528 --- ParallelTerminationStrategy: PID 29920 died... 08:47:53.337458 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29920): Terminated: ok {rc=0} 08:47:53.381319 --- ParallelTerminationStrategy: PID 29923 died... 08:47:53.400119 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29923): Terminated: ok {rc=0} 08:47:53.444059 --- ParallelTerminationStrategy: PID 29926 died... 08:47:53.463043 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29926): Terminated: ok {rc=0} 08:47:53.547542 bus /gobi_0: Setting Powered False 08:47:54.646556 bus /gobi_0: Setting Powered False 08:47:55.767694 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2402 gprs:trx-b200 iperf3.py ---------------------------------------------- 08:47:56.914450 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 08:47:56.925800 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 08:47:56.977539 tst iperf3.py: using LAC 39766 08:47:57.108337 tst iperf3.py: using RAC 241 08:47:57.238141 tst iperf3.py: using CellId 39766 08:47:57.366872 tst iperf3.py: using BVCI 39767 08:47:57.487104 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 08:47:57.498668 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 08:47:57.509900 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 08:47:57.520832 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 08:47:57.532399 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 08:47:57.544260 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 08:47:57.556034 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 08:47:57.567753 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 08:47:57.579606 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 08:47:57.696811 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 08:47:57.901259 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:47:58.207053 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29928): Launched 08:47:58.473627 run iperf3-srv_10.42.42.10(pid=29929): Launched 08:47:58.587628 tst iperf3.py:8: start network... 08:47:58.790726 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:47:59.262578 run create_hlr_db(pid=29930): Launched 08:47:59.381781 bus /gobi_6: Setting Powered False 08:48:00.442634 run create_hlr_db(pid=29930): Terminated: ok {rc=0} 08:48:00.869934 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29932): Launched 08:48:01.190903 run osmo-hlr_10.42.42.2(pid=29933): Launched 08:48:01.401355 run osmo-stp_10.42.42.5: Starting osmo-stp 08:48:02.057755 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29935): Launched 08:48:02.394002 run osmo-stp_10.42.42.5(pid=29936): Launched 08:48:02.521147 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:48:03.074505 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29938): Launched 08:48:03.191128 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:48:03.448219 run patchelf(pid=29939): Launched 08:48:03.616809 run osmo-stp_10.42.42.5(pid=29936): ERR: Terminated: ERROR {rc=1} [trial-2402↪gprs:trx-b200↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29936)] 08:48:03.745460 run osmo-stp_10.42.42.5(pid=29936): stdout: | (launched: 2022-12-14_08:48:02.334433) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:48:03.875488 run osmo-stp_10.42.42.5(pid=29936): stderr: | 20221214084802526 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214084802527 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214084802527 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214084802527 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214084802528 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214084802528 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214084802528 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:48:04.006784 run osmo-stp_10.42.42.5(pid=29936): stdout: | (launched: 2022-12-14_08:48:02.334433) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:48:04.131109 run osmo-stp_10.42.42.5(pid=29936): stderr: | 20221214084802526 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214084802527 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214084802527 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214084802527 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214084802528 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214084802528 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214084802528 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:48:04.278723 run patchelf(pid=29939): Terminating (SIGINT) 08:48:04.447899 run patchelf(pid=29939): Terminated: ok {rc=0} 08:48:04.569860 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29936): Process ended prematurely: osmo-stp_10.42.42.5(pid=29936) [trial-2402↪gprs:trx-b200↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29936)] [trial-2402↪gprs:trx-b200↪iperf3.py:8] 08:48:04.579435 tst iperf3.py:8: Test FAILED (7.7 sec) 08:48:04.606474 run osmo-hlr_10.42.42.2(pid=29933): ERR: Terminated: ERROR {rc=237} [trial-2402↪gprs:trx-b200↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29933)] 08:48:04.654344 run osmo-hlr_10.42.42.2(pid=29933): stdout: | (launched: 2022-12-14_08:48:01.133141) 08:48:04.703575 run osmo-hlr_10.42.42.2(pid=29933): stderr: | 20221214084801475 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214084801475 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214084801476 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214084801476 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214084801476 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214084801476 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214084801495 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/gprs:trx-b200/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214084801503 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214084801504 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214084801504 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:48:04.753298 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29928): Terminating (SIGTERM) 08:48:04.793468 run iperf3-srv_10.42.42.10(pid=29929): Terminating (SIGTERM) 08:48:04.833387 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29932): Terminating (SIGTERM) 08:48:04.873488 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29935): Terminating (SIGTERM) 08:48:04.913336 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29938): Terminating (SIGTERM) 08:48:04.953806 --- ParallelTerminationStrategy: PID 29928 died... 08:48:04.973202 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29928): Terminated: ok {rc=0} 08:48:05.017291 --- ParallelTerminationStrategy: PID 29929 died... 08:48:05.036041 run iperf3-srv_10.42.42.10(pid=29929): Terminated {rc=256} 08:48:05.079641 --- ParallelTerminationStrategy: PID 29932 died... 08:48:05.098366 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29932): Terminated: ok {rc=0} 08:48:05.142258 --- ParallelTerminationStrategy: PID 29935 died... 08:48:05.161300 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29935): Terminated: ok {rc=0} 08:48:05.205090 --- ParallelTerminationStrategy: PID 29938 died... 08:48:05.223829 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29938): Terminated: ok {rc=0} 08:48:05.307982 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2402 gprs:trx-b200 iperf3m4.py ---------------------------------------------- 08:48:06.457150 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 08:48:06.469065 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 08:48:06.521561 tst iperf3m4.py: using LAC 39767 08:48:06.650508 tst iperf3m4.py: using RAC 242 08:48:06.780494 tst iperf3m4.py: using CellId 39767 08:48:06.909456 tst iperf3m4.py: using BVCI 39768 08:48:07.029226 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 08:48:07.040427 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 08:48:07.051456 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 08:48:07.062490 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 08:48:07.073470 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 08:48:07.084366 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 08:48:07.095488 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 08:48:07.106531 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 08:48:07.117660 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 08:48:07.237845 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 08:48:07.356047 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 08:48:07.475596 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 08:48:07.592447 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 08:48:07.798802 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:48:08.106886 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29940): Launched 08:48:08.375153 run iperf3-srv_10.42.42.10(pid=29941): Launched 08:48:08.490091 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 08:48:08.693608 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:48:08.999912 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29942): Launched 08:48:09.267938 run iperf3-srv_10.42.42.10(pid=29943): Launched 08:48:09.382330 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 08:48:09.585608 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:48:09.891277 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29944): Launched 08:48:10.155841 run iperf3-srv_10.42.42.10(pid=29945): Launched 08:48:10.270047 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 08:48:10.472509 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:48:10.777285 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29946): Launched 08:48:11.041111 run iperf3-srv_10.42.42.10(pid=29947): Launched 08:48:11.155171 tst iperf3m4.py:8: start network... 08:48:11.358827 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:48:11.830427 run create_hlr_db(pid=29948): Launched 08:48:11.949260 bus /gobi_6: Setting Powered False 08:48:13.010057 run create_hlr_db(pid=29948): Terminated: ok {rc=0} 08:48:13.434926 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29950): Launched 08:48:13.741383 run osmo-hlr_10.42.42.2(pid=29951): Launched 08:48:13.857752 run osmo-stp_10.42.42.5: Starting osmo-stp 08:48:14.384923 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29953): Launched 08:48:14.689155 run osmo-stp_10.42.42.5(pid=29954): Launched 08:48:14.805946 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:48:15.329661 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29956): Launched 08:48:15.447732 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:48:15.705364 run patchelf(pid=29957): Launched 08:48:15.885313 run osmo-stp_10.42.42.5(pid=29954): ERR: Terminated: ERROR {rc=1} [trial-2402↪gprs:trx-b200↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29954)] 08:48:16.019847 run osmo-stp_10.42.42.5(pid=29954): stdout: | (launched: 2022-12-14_08:48:14.632600) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:48:16.154032 run osmo-stp_10.42.42.5(pid=29954): stderr: | 20221214084814802 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214084814802 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214084814803 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214084814803 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214084814804 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214084814804 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214084814804 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:48:16.288942 run osmo-stp_10.42.42.5(pid=29954): stdout: | (launched: 2022-12-14_08:48:14.632600) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:48:16.417999 run osmo-stp_10.42.42.5(pid=29954): stderr: | 20221214084814802 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214084814802 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214084814803 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214084814803 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214084814804 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214084814804 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214084814804 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:48:16.571132 run patchelf(pid=29957): Terminating (SIGINT) 08:48:16.746060 run patchelf(pid=29957): Terminated: ok {rc=0} 08:48:16.873209 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29954): Process ended prematurely: osmo-stp_10.42.42.5(pid=29954) [trial-2402↪gprs:trx-b200↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29954)] [trial-2402↪gprs:trx-b200↪iperf3m4.py:8] 08:48:16.884060 tst iperf3m4.py:8: Test FAILED (10.5 sec) 08:48:16.912628 run osmo-hlr_10.42.42.2(pid=29951): ERR: Terminated: ERROR {rc=237} [trial-2402↪gprs:trx-b200↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29951)] 08:48:16.963924 run osmo-hlr_10.42.42.2(pid=29951): stdout: | (launched: 2022-12-14_08:48:13.684875) 08:48:17.015640 run osmo-hlr_10.42.42.2(pid=29951): stderr: | 20221214084813857 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214084813857 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214084813857 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214084813857 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214084813857 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214084813857 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214084813870 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/gprs:trx-b200/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214084813878 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214084813878 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214084813878 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:48:17.067812 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29940): Terminating (SIGTERM) 08:48:17.110378 run iperf3-srv_10.42.42.10(pid=29941): Terminating (SIGTERM) 08:48:17.153752 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29942): Terminating (SIGTERM) 08:48:17.196281 run iperf3-srv_10.42.42.10(pid=29943): Terminating (SIGTERM) 08:48:17.238487 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29944): Terminating (SIGTERM) 08:48:17.281243 run iperf3-srv_10.42.42.10(pid=29945): Terminating (SIGTERM) 08:48:17.321584 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29946): Terminating (SIGTERM) 08:48:17.361371 run iperf3-srv_10.42.42.10(pid=29947): Terminating (SIGTERM) 08:48:17.401041 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29950): Terminating (SIGTERM) 08:48:17.441271 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29953): Terminating (SIGTERM) 08:48:17.482039 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29956): Terminating (SIGTERM) 08:48:17.522933 --- ParallelTerminationStrategy: PID 29940 died... 08:48:17.542467 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29940): Terminated: ok {rc=0} 08:48:17.587069 --- ParallelTerminationStrategy: PID 29941 died... 08:48:17.606052 run iperf3-srv_10.42.42.10(pid=29941): Terminated {rc=256} 08:48:17.650239 --- ParallelTerminationStrategy: PID 29942 died... 08:48:17.669144 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29942): Terminated: ok {rc=0} 08:48:17.713548 --- ParallelTerminationStrategy: PID 29943 died... 08:48:17.732523 run iperf3-srv_10.42.42.10(pid=29943): Terminated {rc=256} 08:48:17.776753 --- ParallelTerminationStrategy: PID 29944 died... 08:48:17.795772 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29944): Terminated: ok {rc=0} 08:48:17.840092 --- ParallelTerminationStrategy: PID 29945 died... 08:48:17.859151 run iperf3-srv_10.42.42.10(pid=29945): Terminated {rc=256} 08:48:17.903299 --- ParallelTerminationStrategy: PID 29946 died... 08:48:17.922190 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29946): Terminated: ok {rc=0} 08:48:17.966584 --- ParallelTerminationStrategy: PID 29947 died... 08:48:17.985535 run iperf3-srv_10.42.42.10(pid=29947): Terminated {rc=256} 08:48:18.029799 --- ParallelTerminationStrategy: PID 29950 died... 08:48:18.048810 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29950): Terminated: ok {rc=0} 08:48:18.093085 --- ParallelTerminationStrategy: PID 29953 died... 08:48:18.112079 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29953): Terminated: ok {rc=0} 08:48:18.156291 --- ParallelTerminationStrategy: PID 29956 died... 08:48:18.175455 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29956): Terminated: ok {rc=0} 08:48:18.262784 bus /gobi_4: Setting Powered False 08:48:19.362470 bus /gobi_4: Setting Powered False 08:48:20.477567 bus /gobi_1: Setting Powered False 08:48:21.577140 bus /gobi_1: Setting Powered False 08:48:22.692664 bus /gobi_0: Setting Powered False 08:48:23.789869 bus /gobi_0: Setting Powered False 08:48:24.903670 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2402 gprs:trx-b200 ping.py ---------------------------------------------- 08:48:26.005377 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 08:48:26.017076 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 08:48:26.067611 tst ping.py: using LAC 39768 08:48:26.187600 tst ping.py: using RAC 243 08:48:26.306907 tst ping.py: using CellId 39768 08:48:26.426529 tst ping.py: using BVCI 39769 08:48:26.535696 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 08:48:26.546536 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 08:48:26.556924 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 08:48:26.567364 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 08:48:26.577680 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 08:48:26.588242 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 08:48:26.598923 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 08:48:26.609626 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 08:48:26.730437 tst ping.py:19: start network... 08:48:26.946577 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:48:27.442697 run create_hlr_db(pid=29959): Launched 08:48:27.574638 bus /gobi_6: Setting Powered False 08:48:28.637911 run create_hlr_db(pid=29959): Terminated: ok {rc=0} 08:48:29.067151 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29961): Launched 08:48:29.367682 run osmo-hlr_10.42.42.2(pid=29962): Launched 08:48:29.481621 run osmo-stp_10.42.42.5: Starting osmo-stp 08:48:30.014958 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29964): Launched 08:48:30.316906 run osmo-stp_10.42.42.5(pid=29965): Launched 08:48:30.431771 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:48:30.973907 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29967): Launched 08:48:31.107113 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:48:31.389682 run patchelf(pid=29968): Launched 08:48:31.568598 run osmo-stp_10.42.42.5(pid=29965): ERR: Terminated: ERROR {rc=1} [trial-2402↪gprs:trx-b200↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29965)] 08:48:31.698837 run osmo-stp_10.42.42.5(pid=29965): stdout: | (launched: 2022-12-14_08:48:30.260906) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:48:31.831027 run osmo-stp_10.42.42.5(pid=29965): stderr: | 20221214084830430 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214084830430 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214084830430 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214084830431 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214084830431 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214084830431 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214084830431 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:48:31.963811 run osmo-stp_10.42.42.5(pid=29965): stdout: | (launched: 2022-12-14_08:48:30.260906) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:48:32.090435 run osmo-stp_10.42.42.5(pid=29965): stderr: | 20221214084830430 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214084830430 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214084830430 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214084830431 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214084830431 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214084830431 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214084830431 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:48:32.240389 run patchelf(pid=29968): Terminating (SIGINT) 08:48:32.412747 run patchelf(pid=29968): Terminated: ok {rc=0} 08:48:32.537295 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=29965): Process ended prematurely: osmo-stp_10.42.42.5(pid=29965) [trial-2402↪gprs:trx-b200↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29965)] [trial-2402↪gprs:trx-b200↪ping.py:22] 08:48:32.546490 tst ping.py:22: Test FAILED (6.5 sec) 08:48:32.574080 run osmo-hlr_10.42.42.2(pid=29962): ERR: Terminated: ERROR {rc=237} [trial-2402↪gprs:trx-b200↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29962)] 08:48:32.623129 run osmo-hlr_10.42.42.2(pid=29962): stdout: | (launched: 2022-12-14_08:48:29.311582) 08:48:32.673539 run osmo-hlr_10.42.42.2(pid=29962): stderr: | 20221214084829489 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214084829489 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214084829489 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214084829489 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214084829489 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214084829489 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214084829502 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/gprs:trx-b200/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214084829513 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214084829513 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214084829513 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:48:32.724400 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29961): Terminating (SIGTERM) 08:48:32.765841 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29964): Terminating (SIGTERM) 08:48:32.807040 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29967): Terminating (SIGTERM) 08:48:32.848058 --- ParallelTerminationStrategy: PID 29961 died... 08:48:32.867717 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29961): Terminated: ok {rc=0} 08:48:32.912437 --- ParallelTerminationStrategy: PID 29964 died... 08:48:32.931846 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29964): Terminated: ok {rc=0} 08:48:32.976263 --- ParallelTerminationStrategy: PID 29967 died... 08:48:32.995327 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29967): Terminated: ok {rc=0} 08:48:33.080127 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2402 gprs:trx-b200 ping_idle_ping.py ---------------------------------------------- 08:48:34.167139 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 08:48:34.179344 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 08:48:34.230615 tst ping_idle_ping.py: using LAC 39769 08:48:34.351564 tst ping_idle_ping.py: using RAC 244 08:48:34.471623 tst ping_idle_ping.py: using CellId 39769 08:48:34.598684 tst ping_idle_ping.py: using BVCI 39770 08:48:34.719193 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 08:48:34.730412 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 08:48:34.741520 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 08:48:34.752582 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 08:48:34.763560 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 08:48:34.774462 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 08:48:34.785500 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 08:48:34.796351 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 08:48:34.915346 tst ping_idle_ping.py:24: start network... 08:48:35.130379 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:48:35.629525 run create_hlr_db(pid=29969): Launched 08:48:35.761868 bus /gobi_6: Setting Powered False 08:48:36.825531 run create_hlr_db(pid=29969): Terminated: ok {rc=0} 08:48:37.254568 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29971): Launched 08:48:37.555570 run osmo-hlr_10.42.42.2(pid=29972): Launched 08:48:37.669641 run osmo-stp_10.42.42.5: Starting osmo-stp 08:48:38.200603 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29974): Launched 08:48:38.500157 run osmo-stp_10.42.42.5(pid=29975): Launched 08:48:38.615443 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:48:39.131953 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29977): Launched 08:48:39.247294 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:48:39.501081 run patchelf(pid=29978): Launched 08:48:39.667758 run osmo-stp_10.42.42.5(pid=29975): ERR: Terminated: ERROR {rc=1} [trial-2402↪gprs:trx-b200↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29975)] 08:48:39.794483 run osmo-stp_10.42.42.5(pid=29975): stdout: | (launched: 2022-12-14_08:48:38.444538) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:48:39.922805 run osmo-stp_10.42.42.5(pid=29975): stderr: | 20221214084838614 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214084838614 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214084838615 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214084838615 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214084838616 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214084838616 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214084838616 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:48:40.052018 run osmo-stp_10.42.42.5(pid=29975): stdout: | (launched: 2022-12-14_08:48:38.444538) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:48:40.174991 run osmo-stp_10.42.42.5(pid=29975): stderr: | 20221214084838614 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214084838614 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214084838615 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214084838615 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214084838616 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214084838616 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214084838616 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:48:40.320580 run patchelf(pid=29978): Terminating (SIGINT) 08:48:40.487738 run patchelf(pid=29978): Terminated: ok {rc=0} 08:48:40.608309 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=29975): Process ended prematurely: osmo-stp_10.42.42.5(pid=29975) [trial-2402↪gprs:trx-b200↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29975)] [trial-2402↪gprs:trx-b200↪ping_idle_ping.py:27] 08:48:40.617402 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 08:48:40.644186 run osmo-hlr_10.42.42.2(pid=29972): ERR: Terminated: ERROR {rc=237} [trial-2402↪gprs:trx-b200↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29972)] 08:48:40.692215 run osmo-hlr_10.42.42.2(pid=29972): stdout: | (launched: 2022-12-14_08:48:37.500134) 08:48:40.741817 run osmo-hlr_10.42.42.2(pid=29972): stderr: | 20221214084837676 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214084837676 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214084837676 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214084837676 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214084837676 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214084837676 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214084837688 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/gprs:trx-b200/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214084837697 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214084837697 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214084837697 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:48:40.792056 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29971): Terminating (SIGTERM) 08:48:40.831891 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29974): Terminating (SIGTERM) 08:48:40.871471 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29977): Terminating (SIGTERM) 08:48:40.911352 --- ParallelTerminationStrategy: PID 29971 died... 08:48:40.930829 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29971): Terminated: ok {rc=0} 08:48:40.975125 --- ParallelTerminationStrategy: PID 29974 died... 08:48:40.994029 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29974): Terminated: ok {rc=0} 08:48:41.038000 --- ParallelTerminationStrategy: PID 29977 died... 08:48:41.056860 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29977): Terminated: ok {rc=0} 08:48:41.143099 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2402 gprs:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 gprs:trx-b200+mod-bts0-egprs --------------------------------------------------------------------- 08:48:42.446330 tst gprs:trx-b200+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:48:42.451547 tst gprs:trx-b200+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 08:48:42.483742 tst gprs:trx-b200+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 08:48:42.523119 tst gprs:trx-b200+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 08:48:42.610439 tst gprs:trx-b200+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 08:48:42.642602 tst gprs:trx-b200+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 08:48:42.680793 tst gprs:trx-b200+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 08:48:43.273121 tst gprs:trx-b200+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2402 gprs:trx-b200+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 08:48:43.323026 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:48:43.333809 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 08:48:43.383343 tst cs_paging_gprs_active.py: using LAC 39770 08:48:43.506889 tst cs_paging_gprs_active.py: using RAC 245 08:48:43.627026 tst cs_paging_gprs_active.py: using CellId 39770 08:48:43.746603 tst cs_paging_gprs_active.py: using BVCI 39771 08:48:43.859132 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:48:43.870058 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:48:43.880576 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:48:43.891151 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:48:43.902043 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:48:43.912836 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:48:43.924350 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:48:43.935153 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:48:43.946170 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 08:48:44.067019 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 08:48:44.183872 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 08:48:44.388790 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:48:44.695175 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29984): Launched 08:48:44.961789 run iperf3-srv_10.42.42.10(pid=29985): Launched 08:48:45.075845 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 08:48:45.279433 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:48:45.585245 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29986): Launched 08:48:45.850595 run iperf3-srv_10.42.42.10(pid=29987): Launched 08:48:46.002450 tst cs_paging_gprs_active.py:38: start network... 08:48:46.287449 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:48:46.786246 run create_hlr_db(pid=29988): Launched 08:48:46.962378 bus /gobi_6: Setting Powered False 08:48:48.026345 run create_hlr_db(pid=29988): Terminated: ok {rc=0} 08:48:48.460855 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29990): Launched 08:48:48.766226 run osmo-hlr_10.42.42.2(pid=29991): Launched 08:48:48.882120 run osmo-stp_10.42.42.5: Starting osmo-stp 08:48:49.409674 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29993): Launched 08:48:49.714180 run osmo-stp_10.42.42.5(pid=29994): Launched 08:48:49.829892 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:48:50.353515 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29996): Launched 08:48:50.469598 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:48:50.726786 run patchelf(pid=29997): Launched 08:48:50.897538 run osmo-stp_10.42.42.5(pid=29994): ERR: Terminated: ERROR {rc=1} [trial-2402↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29994)] 08:48:51.026169 run osmo-stp_10.42.42.5(pid=29994): stdout: | (launched: 2022-12-14_08:48:49.657802) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:48:51.156619 run osmo-stp_10.42.42.5(pid=29994): stderr: | 20221214084849826 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214084849826 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214084849826 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214084849827 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214084849827 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214084849827 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214084849827 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:48:51.286614 run osmo-stp_10.42.42.5(pid=29994): stdout: | (launched: 2022-12-14_08:48:49.657802) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:48:51.411675 run osmo-stp_10.42.42.5(pid=29994): stderr: | 20221214084849826 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214084849826 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214084849826 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214084849827 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214084849827 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214084849827 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214084849827 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:48:51.560162 run patchelf(pid=29997): Terminating (SIGINT) 08:48:51.730437 run patchelf(pid=29997): Terminated: ok {rc=0} 08:48:51.853409 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=29994): Process ended prematurely: osmo-stp_10.42.42.5(pid=29994) [trial-2402↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29994)] [trial-2402↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 08:48:51.862984 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 08:48:51.889925 run osmo-hlr_10.42.42.2(pid=29991): ERR: Terminated: ERROR {rc=237} [trial-2402↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29991)] 08:48:51.938011 run osmo-hlr_10.42.42.2(pid=29991): stdout: | (launched: 2022-12-14_08:48:48.709929) 08:48:51.987301 run osmo-hlr_10.42.42.2(pid=29991): stderr: | 20221214084848885 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214084848885 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214084848885 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214084848885 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214084848885 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214084848885 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214084848896 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/gprs:trx-b200+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214084848904 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214084848905 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214084848905 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:48:52.037100 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29984): Terminating (SIGTERM) 08:48:52.076865 run iperf3-srv_10.42.42.10(pid=29985): Terminating (SIGTERM) 08:48:52.116512 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29986): Terminating (SIGTERM) 08:48:52.156112 run iperf3-srv_10.42.42.10(pid=29987): Terminating (SIGTERM) 08:48:52.195397 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29990): Terminating (SIGTERM) 08:48:52.234851 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29993): Terminating (SIGTERM) 08:48:52.274597 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29996): Terminating (SIGTERM) 08:48:52.314581 --- ParallelTerminationStrategy: PID 29984 died... 08:48:52.333911 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29984): Terminated: ok {rc=0} 08:48:52.377598 --- ParallelTerminationStrategy: PID 29985 died... 08:48:52.396037 run iperf3-srv_10.42.42.10(pid=29985): Terminated {rc=256} 08:48:52.439371 --- ParallelTerminationStrategy: PID 29986 died... 08:48:52.458117 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29986): Terminated: ok {rc=0} 08:48:52.501454 --- ParallelTerminationStrategy: PID 29987 died... 08:48:52.520335 run iperf3-srv_10.42.42.10(pid=29987): Terminated {rc=256} 08:48:52.563857 --- ParallelTerminationStrategy: PID 29990 died... 08:48:52.582499 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29990): Terminated: ok {rc=0} 08:48:52.626039 --- ParallelTerminationStrategy: PID 29993 died... 08:48:52.644560 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29993): Terminated: ok {rc=0} 08:48:52.688247 --- ParallelTerminationStrategy: PID 29996 died... 08:48:52.706913 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29996): Terminated: ok {rc=0} 08:48:52.791968 bus /gobi_0: Setting Powered False 08:48:53.890939 bus /gobi_0: Setting Powered False 08:48:55.004314 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2402 gprs:trx-b200+mod-bts0-egprs iperf3.py ---------------------------------------------- 08:48:56.150686 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:48:56.162446 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 08:48:56.218662 tst iperf3.py: using LAC 39771 08:48:56.339352 tst iperf3.py: using RAC 246 08:48:56.467260 tst iperf3.py: using CellId 39771 08:48:56.593872 tst iperf3.py: using BVCI 39772 08:48:56.711892 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:48:56.723774 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:48:56.735180 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:48:56.746318 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:48:56.757470 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:48:56.768573 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:48:56.779842 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:48:56.790847 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:48:56.802129 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 08:48:56.919185 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 08:48:57.124241 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:48:57.431832 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29998): Launched 08:48:57.698818 run iperf3-srv_10.42.42.10(pid=29999): Launched 08:48:57.813434 tst iperf3.py:8: start network... 08:48:58.016915 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:48:58.490612 run create_hlr_db(pid=30000): Launched 08:48:58.610110 bus /gobi_6: Setting Powered False 08:48:59.670861 run create_hlr_db(pid=30000): Terminated: ok {rc=0} 08:49:00.115713 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30002): Launched 08:49:00.443591 run osmo-hlr_10.42.42.2(pid=30003): Launched 08:49:00.570371 run osmo-stp_10.42.42.5: Starting osmo-stp 08:49:01.165719 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30005): Launched 08:49:01.502972 run osmo-stp_10.42.42.5(pid=30006): Launched 08:49:01.768423 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:49:02.378211 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30008): Launched 08:49:02.503005 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:49:02.778356 run patchelf(pid=30009): Launched 08:49:02.957738 run osmo-stp_10.42.42.5(pid=30006): ERR: Terminated: ERROR {rc=1} [trial-2402↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30006)] 08:49:03.094412 run osmo-stp_10.42.42.5(pid=30006): stdout: | (launched: 2022-12-14_08:49:01.443252) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:49:03.232619 run osmo-stp_10.42.42.5(pid=30006): stderr: | 20221214084901702 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214084901702 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214084901702 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214084901703 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214084901703 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214084901703 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214084901703 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:49:03.371098 run osmo-stp_10.42.42.5(pid=30006): stdout: | (launched: 2022-12-14_08:49:01.443252) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:49:03.503351 run osmo-stp_10.42.42.5(pid=30006): stderr: | 20221214084901702 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214084901702 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214084901702 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214084901703 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214084901703 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214084901703 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214084901703 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:49:03.661352 run patchelf(pid=30009): Terminating (SIGINT) 08:49:03.841963 run patchelf(pid=30009): Terminated: ok {rc=0} 08:49:03.971822 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30006): Process ended prematurely: osmo-stp_10.42.42.5(pid=30006) [trial-2402↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30006)] [trial-2402↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8] 08:49:03.982124 tst iperf3.py:8: Test FAILED (7.9 sec) 08:49:04.010326 run osmo-hlr_10.42.42.2(pid=30003): ERR: Terminated: ERROR {rc=237} [trial-2402↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30003)] 08:49:04.060404 run osmo-hlr_10.42.42.2(pid=30003): stdout: | (launched: 2022-12-14_08:49:00.383665) 08:49:04.111809 run osmo-hlr_10.42.42.2(pid=30003): stderr: | 20221214084900582 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214084900582 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214084900582 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214084900582 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214084900582 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214084900582 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214084900596 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/gprs:trx-b200+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214084900605 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214084900606 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214084900606 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:49:04.163423 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29998): Terminating (SIGTERM) 08:49:04.205061 run iperf3-srv_10.42.42.10(pid=29999): Terminating (SIGTERM) 08:49:04.246244 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30002): Terminating (SIGTERM) 08:49:04.287386 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30005): Terminating (SIGTERM) 08:49:04.328868 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30008): Terminating (SIGTERM) 08:49:04.371261 --- ParallelTerminationStrategy: PID 29998 died... 08:49:04.391324 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29998): Terminated: ok {rc=0} 08:49:04.437313 --- ParallelTerminationStrategy: PID 29999 died... 08:49:04.456756 run iperf3-srv_10.42.42.10(pid=29999): Terminated {rc=256} 08:49:04.502067 --- ParallelTerminationStrategy: PID 30002 died... 08:49:04.521427 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30002): Terminated: ok {rc=0} 08:49:04.566740 --- ParallelTerminationStrategy: PID 30005 died... 08:49:04.586186 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30005): Terminated: ok {rc=0} 08:49:04.631780 --- ParallelTerminationStrategy: PID 30008 died... 08:49:04.651205 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30008): Terminated: ok {rc=0} 08:49:04.738802 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2402 gprs:trx-b200+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 08:49:05.889000 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:49:05.901145 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 08:49:05.952869 tst iperf3m4.py: using LAC 39772 08:49:06.082511 tst iperf3m4.py: using RAC 247 08:49:06.211948 tst iperf3m4.py: using CellId 39772 08:49:06.339634 tst iperf3m4.py: using BVCI 39773 08:49:06.458171 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:49:06.469531 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:49:06.480544 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:49:06.491634 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:49:06.503229 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:49:06.514874 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:49:06.526755 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:49:06.538273 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:49:06.550078 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 08:49:06.667880 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 08:49:06.786979 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 08:49:06.906834 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 08:49:07.024537 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 08:49:07.228212 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:49:07.534080 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30010): Launched 08:49:07.802619 run iperf3-srv_10.42.42.10(pid=30011): Launched 08:49:07.919369 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 08:49:08.123016 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:49:08.428780 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30012): Launched 08:49:08.694143 run iperf3-srv_10.42.42.10(pid=30013): Launched 08:49:08.810802 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 08:49:09.013518 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:49:09.319139 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30014): Launched 08:49:09.584295 run iperf3-srv_10.42.42.10(pid=30015): Launched 08:49:09.698750 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 08:49:09.901790 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:49:10.206866 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30016): Launched 08:49:10.479201 run iperf3-srv_10.42.42.10(pid=30017): Launched 08:49:10.593489 tst iperf3m4.py:8: start network... 08:49:10.796310 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:49:11.269631 run create_hlr_db(pid=30018): Launched 08:49:11.386443 bus /gobi_6: Setting Powered False 08:49:12.446851 run create_hlr_db(pid=30018): Terminated: ok {rc=0} 08:49:12.871323 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30020): Launched 08:49:13.176871 run osmo-hlr_10.42.42.2(pid=30021): Launched 08:49:13.293663 run osmo-stp_10.42.42.5: Starting osmo-stp 08:49:13.834977 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30023): Launched 08:49:14.139946 run osmo-stp_10.42.42.5(pid=30024): Launched 08:49:14.256866 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:49:14.783870 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30026): Launched 08:49:14.900922 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:49:15.158932 run patchelf(pid=30027): Launched 08:49:15.329393 run osmo-stp_10.42.42.5(pid=30024): ERR: Terminated: ERROR {rc=1} [trial-2402↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30024)] 08:49:15.458020 run osmo-stp_10.42.42.5(pid=30024): stdout: | (launched: 2022-12-14_08:49:14.083101) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:49:15.588175 run osmo-stp_10.42.42.5(pid=30024): stderr: | 20221214084914250 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214084914251 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214084914251 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214084914251 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214084914252 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214084914252 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214084914252 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:49:15.718858 run osmo-stp_10.42.42.5(pid=30024): stdout: | (launched: 2022-12-14_08:49:14.083101) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:49:15.849227 run osmo-stp_10.42.42.5(pid=30024): stderr: | 20221214084914250 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214084914251 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214084914251 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214084914251 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214084914252 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214084914252 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214084914252 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:49:16.018829 run patchelf(pid=30027): Terminating (SIGINT) 08:49:16.205212 run patchelf(pid=30027): Terminated: ok {rc=0} 08:49:16.339252 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30024): Process ended prematurely: osmo-stp_10.42.42.5(pid=30024) [trial-2402↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30024)] [trial-2402↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8] 08:49:16.350826 tst iperf3m4.py:8: Test FAILED (10.5 sec) 08:49:16.380309 run osmo-hlr_10.42.42.2(pid=30021): ERR: Terminated: ERROR {rc=237} [trial-2402↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30021)] 08:49:16.432938 run osmo-hlr_10.42.42.2(pid=30021): stdout: | (launched: 2022-12-14_08:49:13.120320) 08:49:16.486611 run osmo-hlr_10.42.42.2(pid=30021): stderr: | 20221214084913293 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214084913293 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214084913293 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214084913293 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214084913293 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214084913293 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214084913307 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/gprs:trx-b200+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214084913315 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214084913315 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214084913315 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:49:16.539795 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30010): Terminating (SIGTERM) 08:49:16.583570 run iperf3-srv_10.42.42.10(pid=30011): Terminating (SIGTERM) 08:49:16.629312 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30012): Terminating (SIGTERM) 08:49:16.674570 run iperf3-srv_10.42.42.10(pid=30013): Terminating (SIGTERM) 08:49:16.720556 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30014): Terminating (SIGTERM) 08:49:16.765800 run iperf3-srv_10.42.42.10(pid=30015): Terminating (SIGTERM) 08:49:16.811558 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30016): Terminating (SIGTERM) 08:49:16.855280 run iperf3-srv_10.42.42.10(pid=30017): Terminating (SIGTERM) 08:49:16.900576 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30020): Terminating (SIGTERM) 08:49:16.944294 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30023): Terminating (SIGTERM) 08:49:16.989550 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30026): Terminating (SIGTERM) 08:49:17.034504 --- ParallelTerminationStrategy: PID 30010 died... 08:49:17.055457 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30010): Terminated: ok {rc=0} 08:49:17.105267 --- ParallelTerminationStrategy: PID 30011 died... 08:49:17.125329 run iperf3-srv_10.42.42.10(pid=30011): Terminated {rc=256} 08:49:17.173647 --- ParallelTerminationStrategy: PID 30012 died... 08:49:17.193874 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30012): Terminated: ok {rc=0} 08:49:17.240444 --- ParallelTerminationStrategy: PID 30013 died... 08:49:17.260054 run iperf3-srv_10.42.42.10(pid=30013): Terminated {rc=256} 08:49:17.305661 --- ParallelTerminationStrategy: PID 30014 died... 08:49:17.325127 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30014): Terminated: ok {rc=0} 08:49:17.370795 --- ParallelTerminationStrategy: PID 30015 died... 08:49:17.390290 run iperf3-srv_10.42.42.10(pid=30015): Terminated {rc=256} 08:49:17.436816 --- ParallelTerminationStrategy: PID 30016 died... 08:49:17.456705 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30016): Terminated: ok {rc=0} 08:49:17.502586 --- ParallelTerminationStrategy: PID 30017 died... 08:49:17.522093 run iperf3-srv_10.42.42.10(pid=30017): Terminated {rc=256} 08:49:17.567816 --- ParallelTerminationStrategy: PID 30020 died... 08:49:17.587369 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30020): Terminated: ok {rc=0} 08:49:17.633652 --- ParallelTerminationStrategy: PID 30023 died... 08:49:17.653273 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30023): Terminated: ok {rc=0} 08:49:17.699732 --- ParallelTerminationStrategy: PID 30026 died... 08:49:17.719493 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30026): Terminated: ok {rc=0} 08:49:17.807687 bus /gobi_4: Setting Powered False 08:49:18.907279 bus /gobi_4: Setting Powered False 08:49:20.026808 bus /gobi_1: Setting Powered False 08:49:21.124262 bus /gobi_1: Setting Powered False 08:49:22.240243 bus /gobi_0: Setting Powered False 08:49:23.338409 bus /gobi_0: Setting Powered False 08:49:24.453294 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2402 gprs:trx-b200+mod-bts0-egprs ping.py ---------------------------------------------- 08:49:25.558473 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:49:25.570518 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 08:49:25.622871 tst ping.py: using LAC 39773 08:49:25.741437 tst ping.py: using RAC 248 08:49:25.861374 tst ping.py: using CellId 39773 08:49:25.978894 tst ping.py: using BVCI 39774 08:49:26.089620 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:49:26.100455 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:49:26.111187 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:49:26.121891 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:49:26.132749 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:49:26.143595 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:49:26.155375 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:49:26.166533 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 08:49:26.286186 tst ping.py:19: start network... 08:49:26.501121 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:49:26.997334 run create_hlr_db(pid=30028): Launched 08:49:27.128760 bus /gobi_6: Setting Powered False 08:49:28.191979 run create_hlr_db(pid=30028): Terminated: ok {rc=0} 08:49:28.637164 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30030): Launched 08:49:28.957613 run osmo-hlr_10.42.42.2(pid=30031): Launched 08:49:29.079203 run osmo-stp_10.42.42.5: Starting osmo-stp 08:49:29.631419 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30033): Launched 08:49:29.951621 run osmo-stp_10.42.42.5(pid=30034): Launched 08:49:30.073279 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:49:30.623521 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30036): Launched 08:49:30.747071 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:49:31.030216 run patchelf(pid=30037): Launched 08:49:31.245394 run osmo-stp_10.42.42.5(pid=30034): ERR: Terminated: ERROR {rc=1} [trial-2402↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30034)] 08:49:31.384546 run osmo-stp_10.42.42.5(pid=30034): stdout: | (launched: 2022-12-14_08:49:29.892460) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:49:31.524914 run osmo-stp_10.42.42.5(pid=30034): stderr: | 20221214084930083 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214084930084 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214084930084 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214084930084 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214084930085 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214084930085 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214084930085 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:49:31.675555 run osmo-stp_10.42.42.5(pid=30034): stdout: | (launched: 2022-12-14_08:49:29.892460) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:49:31.831731 run osmo-stp_10.42.42.5(pid=30034): stderr: | 20221214084930083 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214084930084 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214084930084 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214084930084 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214084930085 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214084930085 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214084930085 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:49:31.991554 run patchelf(pid=30037): Terminating (SIGINT) 08:49:32.174439 run patchelf(pid=30037): Terminated: ok {rc=0} 08:49:32.306372 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=30034): Process ended prematurely: osmo-stp_10.42.42.5(pid=30034) [trial-2402↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30034)] [trial-2402↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22] 08:49:32.316585 tst ping.py:22: Test FAILED (6.8 sec) 08:49:32.345610 run osmo-hlr_10.42.42.2(pid=30031): ERR: Terminated: ERROR {rc=237} [trial-2402↪gprs:trx-b200+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30031)] 08:49:32.396016 run osmo-hlr_10.42.42.2(pid=30031): stdout: | (launched: 2022-12-14_08:49:28.898234) 08:49:32.448424 run osmo-hlr_10.42.42.2(pid=30031): stderr: | 20221214084929097 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214084929097 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214084929097 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214084929097 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214084929097 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214084929097 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214084929114 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/gprs:trx-b200+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214084929123 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214084929123 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214084929124 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:49:32.501106 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30030): Terminating (SIGTERM) 08:49:32.543212 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30033): Terminating (SIGTERM) 08:49:32.585807 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30036): Terminating (SIGTERM) 08:49:32.628295 --- ParallelTerminationStrategy: PID 30030 died... 08:49:32.648553 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30030): Terminated: ok {rc=0} 08:49:32.695299 --- ParallelTerminationStrategy: PID 30033 died... 08:49:32.715023 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30033): Terminated: ok {rc=0} 08:49:32.761881 --- ParallelTerminationStrategy: PID 30036 died... 08:49:32.781647 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30036): Terminated: ok {rc=0} 08:49:32.870031 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2402 gprs:trx-b200+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 08:49:33.956885 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:49:33.969075 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 08:49:34.026583 tst ping_idle_ping.py: using LAC 39774 08:49:34.151486 tst ping_idle_ping.py: using RAC 249 08:49:34.275301 tst ping_idle_ping.py: using CellId 39774 08:49:34.399529 tst ping_idle_ping.py: using BVCI 39775 08:49:34.516041 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:49:34.527620 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:49:34.538954 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:49:34.550248 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:49:34.561614 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:49:34.572755 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:49:34.584264 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:49:34.595577 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 08:49:34.711401 tst ping_idle_ping.py:24: start network... 08:49:34.912503 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:49:35.379697 run create_hlr_db(pid=30038): Launched 08:49:35.494865 bus /gobi_6: Setting Powered False 08:49:36.555463 run create_hlr_db(pid=30038): Terminated: ok {rc=0} 08:49:36.995119 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30040): Launched 08:49:37.316999 run osmo-hlr_10.42.42.2(pid=30041): Launched 08:49:37.441782 run osmo-stp_10.42.42.5: Starting osmo-stp 08:49:37.995837 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30043): Launched 08:49:38.318095 run osmo-stp_10.42.42.5(pid=30044): Launched 08:49:38.441676 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:49:38.997687 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30046): Launched 08:49:39.120457 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:49:39.392334 run patchelf(pid=30047): Launched 08:49:39.572538 run osmo-stp_10.42.42.5(pid=30044): ERR: Terminated: ERROR {rc=1} [trial-2402↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30044)] 08:49:39.709103 run osmo-stp_10.42.42.5(pid=30044): stdout: | (launched: 2022-12-14_08:49:38.259007) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:49:39.847094 run osmo-stp_10.42.42.5(pid=30044): stderr: | 20221214084938450 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214084938450 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214084938450 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214084938451 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214084938451 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214084938451 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214084938451 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:49:39.985879 run osmo-stp_10.42.42.5(pid=30044): stdout: | (launched: 2022-12-14_08:49:38.259007) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:49:40.117940 run osmo-stp_10.42.42.5(pid=30044): stderr: | 20221214084938450 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214084938450 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214084938450 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214084938451 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214084938451 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214084938451 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214084938451 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:49:40.274231 run patchelf(pid=30047): Terminating (SIGINT) 08:49:40.454725 run patchelf(pid=30047): Terminated: ok {rc=0} 08:49:40.583993 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=30044): Process ended prematurely: osmo-stp_10.42.42.5(pid=30044) [trial-2402↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30044)] [trial-2402↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27] 08:49:40.593738 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 08:49:40.621991 run osmo-hlr_10.42.42.2(pid=30041): ERR: Terminated: ERROR {rc=237} [trial-2402↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30041)] 08:49:40.672439 run osmo-hlr_10.42.42.2(pid=30041): stdout: | (launched: 2022-12-14_08:49:37.257906) 08:49:40.724753 run osmo-hlr_10.42.42.2(pid=30041): stderr: | 20221214084937455 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214084937455 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214084937455 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214084937455 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214084937455 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214084937455 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214084937468 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/gprs:trx-b200+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214084937476 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214084937476 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214084937476 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:49:40.777630 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30040): Terminating (SIGTERM) 08:49:40.819813 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30043): Terminating (SIGTERM) 08:49:40.861739 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30046): Terminating (SIGTERM) 08:49:40.903942 --- ParallelTerminationStrategy: PID 30040 died... 08:49:40.924500 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30040): Terminated: ok {rc=0} 08:49:40.971140 --- ParallelTerminationStrategy: PID 30043 died... 08:49:40.991048 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30043): Terminated: ok {rc=0} 08:49:41.037302 --- ParallelTerminationStrategy: PID 30046 died... 08:49:41.057187 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30046): Terminated: ok {rc=0} 08:49:41.144439 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2402 gprs:trx-b200+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 gprs:trx-b200+mod-bts0-dynts-ipa --------------------------------------------------------------------- 08:49:42.460323 tst gprs:trx-b200+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:49:42.467075 tst gprs:trx-b200+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 08:49:42.500716 tst gprs:trx-b200+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 08:49:42.541469 tst gprs:trx-b200+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 08:49:42.631387 tst gprs:trx-b200+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 08:49:42.665303 tst gprs:trx-b200+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 08:49:42.704862 tst gprs:trx-b200+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 08:49:43.299928 tst gprs:trx-b200+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2402 gprs:trx-b200+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 08:49:43.352766 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:49:43.364177 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 08:49:43.439760 tst cs_paging_gprs_active.py: using LAC 39775 08:49:43.566206 tst cs_paging_gprs_active.py: using RAC 250 08:49:43.691708 tst cs_paging_gprs_active.py: using CellId 39775 08:49:43.817969 tst cs_paging_gprs_active.py: using BVCI 39776 08:49:43.936125 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:49:43.947542 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:49:43.958846 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:49:43.970113 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:49:43.981284 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:49:43.992665 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:49:44.004031 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:49:44.015238 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:49:44.026690 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 08:49:44.145237 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 08:49:44.266235 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 08:49:44.485624 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:49:44.811780 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30053): Launched 08:49:45.095959 run iperf3-srv_10.42.42.10(pid=30054): Launched 08:49:45.217500 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 08:49:45.435708 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:49:45.761186 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30055): Launched 08:49:46.046659 run iperf3-srv_10.42.42.10(pid=30056): Launched 08:49:46.198261 tst cs_paging_gprs_active.py:38: start network... 08:49:46.414363 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:49:46.908289 run create_hlr_db(pid=30057): Launched 08:49:47.070199 bus /gobi_6: Setting Powered False 08:49:48.131062 run create_hlr_db(pid=30057): Terminated: ok {rc=0} 08:49:48.555641 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30059): Launched 08:49:48.863205 run osmo-hlr_10.42.42.2(pid=30060): Launched 08:49:48.979085 run osmo-stp_10.42.42.5: Starting osmo-stp 08:49:49.518078 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30062): Launched 08:49:49.822377 run osmo-stp_10.42.42.5(pid=30063): Launched 08:49:49.938552 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:49:50.464189 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30065): Launched 08:49:50.580921 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:49:50.838425 run patchelf(pid=30066): Launched 08:49:51.007051 run osmo-stp_10.42.42.5(pid=30063): ERR: Terminated: ERROR {rc=1} [trial-2402↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30063)] 08:49:51.135720 run osmo-stp_10.42.42.5(pid=30063): stdout: | (launched: 2022-12-14_08:49:49.766135) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:49:51.265950 run osmo-stp_10.42.42.5(pid=30063): stderr: | 20221214084949934 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214084949934 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214084949934 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214084949935 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214084949935 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214084949935 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214084949935 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:49:51.396451 run osmo-stp_10.42.42.5(pid=30063): stdout: | (launched: 2022-12-14_08:49:49.766135) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:49:51.522006 run osmo-stp_10.42.42.5(pid=30063): stderr: | 20221214084949934 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214084949934 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214084949934 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214084949935 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214084949935 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214084949935 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214084949935 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:49:51.670165 run patchelf(pid=30066): Terminating (SIGINT) 08:49:51.839938 run patchelf(pid=30066): Terminated: ok {rc=0} 08:49:51.962666 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=30063): Process ended prematurely: osmo-stp_10.42.42.5(pid=30063) [trial-2402↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30063)] [trial-2402↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 08:49:51.972181 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 08:49:51.999428 run osmo-hlr_10.42.42.2(pid=30060): ERR: Terminated: ERROR {rc=237} [trial-2402↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30060)] 08:49:52.047421 run osmo-hlr_10.42.42.2(pid=30060): stdout: | (launched: 2022-12-14_08:49:48.806883) 08:49:52.096611 run osmo-hlr_10.42.42.2(pid=30060): stderr: | 20221214084948983 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214084948983 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214084948983 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214084948983 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214084948983 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214084948983 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214084948995 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/gprs:trx-b200+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214084949004 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214084949005 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214084949005 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:49:52.146378 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30053): Terminating (SIGTERM) 08:49:52.186361 run iperf3-srv_10.42.42.10(pid=30054): Terminating (SIGTERM) 08:49:52.225904 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30055): Terminating (SIGTERM) 08:49:52.265469 run iperf3-srv_10.42.42.10(pid=30056): Terminating (SIGTERM) 08:49:52.304810 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30059): Terminating (SIGTERM) 08:49:52.344347 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30062): Terminating (SIGTERM) 08:49:52.383790 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30065): Terminating (SIGTERM) 08:49:52.423603 --- ParallelTerminationStrategy: PID 30053 died... 08:49:52.443146 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30053): Terminated: ok {rc=0} 08:49:52.487237 --- ParallelTerminationStrategy: PID 30054 died... 08:49:52.506154 run iperf3-srv_10.42.42.10(pid=30054): Terminated {rc=256} 08:49:52.549793 --- ParallelTerminationStrategy: PID 30055 died... 08:49:52.568804 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30055): Terminated: ok {rc=0} 08:49:52.612393 --- ParallelTerminationStrategy: PID 30056 died... 08:49:52.631147 run iperf3-srv_10.42.42.10(pid=30056): Terminated {rc=256} 08:49:52.674895 --- ParallelTerminationStrategy: PID 30059 died... 08:49:52.693580 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30059): Terminated: ok {rc=0} 08:49:52.737265 --- ParallelTerminationStrategy: PID 30062 died... 08:49:52.756009 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30062): Terminated: ok {rc=0} 08:49:52.800031 --- ParallelTerminationStrategy: PID 30065 died... 08:49:52.819097 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30065): Terminated: ok {rc=0} 08:49:52.902206 bus /gobi_0: Setting Powered False 08:49:54.000736 bus /gobi_0: Setting Powered False 08:49:55.114756 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2402 gprs:trx-b200+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 08:49:56.262246 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:49:56.274359 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 08:49:56.349105 tst iperf3.py: using LAC 39776 08:49:56.477095 tst iperf3.py: using RAC 251 08:49:56.610311 tst iperf3.py: using CellId 39776 08:49:56.737328 tst iperf3.py: using BVCI 39777 08:49:56.855975 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:49:56.867430 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:49:56.878698 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:49:56.890031 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:49:56.901211 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:49:56.912432 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:49:56.923746 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:49:56.935012 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:49:56.946406 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 08:49:57.065181 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 08:49:57.283806 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:49:57.609792 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30067): Launched 08:49:57.893286 run iperf3-srv_10.42.42.10(pid=30068): Launched 08:49:58.014767 tst iperf3.py:8: start network... 08:49:58.234006 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:49:58.738388 run create_hlr_db(pid=30070): Launched 08:49:58.872505 bus /gobi_6: Setting Powered False 08:49:59.937104 run create_hlr_db(pid=30070): Terminated: ok {rc=0} 08:50:00.375010 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30072): Launched 08:50:00.680020 run osmo-hlr_10.42.42.2(pid=30073): Launched 08:50:00.796443 run osmo-stp_10.42.42.5: Starting osmo-stp 08:50:01.465386 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30075): Launched 08:50:01.844306 run osmo-stp_10.42.42.5(pid=30079): Launched 08:50:02.000240 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:50:02.678761 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30081): Launched 08:50:02.805924 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:50:03.080934 run patchelf(pid=30082): Launched 08:50:03.260793 run osmo-stp_10.42.42.5(pid=30079): ERR: Terminated: ERROR {rc=1} [trial-2402↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30079)] 08:50:03.398301 run osmo-stp_10.42.42.5(pid=30079): stdout: | (launched: 2022-12-14_08:50:01.781536) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:50:03.537320 run osmo-stp_10.42.42.5(pid=30079): stderr: | 20221214085002124 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214085002136 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214085002137 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214085002137 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214085002138 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214085002138 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214085002142 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:50:03.675843 run osmo-stp_10.42.42.5(pid=30079): stdout: | (launched: 2022-12-14_08:50:01.781536) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:50:03.809605 run osmo-stp_10.42.42.5(pid=30079): stderr: | 20221214085002124 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214085002136 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214085002137 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214085002137 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214085002138 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214085002138 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214085002142 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:50:03.967045 run patchelf(pid=30082): Terminating (SIGINT) 08:50:04.148045 run patchelf(pid=30082): Terminated: ok {rc=0} 08:50:04.278621 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30079): Process ended prematurely: osmo-stp_10.42.42.5(pid=30079) [trial-2402↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30079)] [trial-2402↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8] 08:50:04.288862 tst iperf3.py:8: Test FAILED (8.1 sec) 08:50:04.317654 run osmo-hlr_10.42.42.2(pid=30073): ERR: Terminated: ERROR {rc=237} [trial-2402↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30073)] 08:50:04.369293 run osmo-hlr_10.42.42.2(pid=30073): stdout: | (launched: 2022-12-14_08:50:00.623963) 08:50:04.421957 run osmo-hlr_10.42.42.2(pid=30073): stderr: | 20221214085000800 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214085000800 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214085000800 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214085000800 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214085000800 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214085000800 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214085000813 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/gprs:trx-b200+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214085000822 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214085000822 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214085000822 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:50:04.475170 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30067): Terminating (SIGTERM) 08:50:04.517781 run iperf3-srv_10.42.42.10(pid=30068): Terminating (SIGTERM) 08:50:04.560358 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30072): Terminating (SIGTERM) 08:50:04.603358 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30075): Terminating (SIGTERM) 08:50:04.646042 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30081): Terminating (SIGTERM) 08:50:04.689281 --- ParallelTerminationStrategy: PID 30067 died... 08:50:04.709977 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30067): Terminated: ok {rc=0} 08:50:04.757429 --- ParallelTerminationStrategy: PID 30068 died... 08:50:04.777556 run iperf3-srv_10.42.42.10(pid=30068): Terminated {rc=256} 08:50:04.824283 --- ParallelTerminationStrategy: PID 30072 died... 08:50:04.844437 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30072): Terminated: ok {rc=0} 08:50:04.891484 --- ParallelTerminationStrategy: PID 30075 died... 08:50:04.911731 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30075): Terminated: ok {rc=0} 08:50:04.958661 --- ParallelTerminationStrategy: PID 30081 died... 08:50:04.978929 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30081): Terminated: ok {rc=0} 08:50:05.068252 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2402 gprs:trx-b200+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 08:50:06.218735 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:50:06.230953 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 08:50:06.305812 tst iperf3m4.py: using LAC 39777 08:50:06.435285 tst iperf3m4.py: using RAC 252 08:50:06.563814 tst iperf3m4.py: using CellId 39777 08:50:06.693408 tst iperf3m4.py: using BVCI 39778 08:50:06.812667 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:50:06.824246 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:50:06.835677 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:50:06.847040 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:50:06.858795 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:50:06.870651 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:50:06.882600 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:50:06.894407 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:50:06.906356 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 08:50:07.024150 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 08:50:07.146811 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 08:50:07.267717 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 08:50:07.388864 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 08:50:07.608171 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:50:07.936135 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30083): Launched 08:50:08.221941 run iperf3-srv_10.42.42.10(pid=30084): Launched 08:50:08.346350 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 08:50:08.558959 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:50:08.867058 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30085): Launched 08:50:09.134714 run iperf3-srv_10.42.42.10(pid=30086): Launched 08:50:09.249449 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 08:50:09.453378 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:50:09.759905 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30087): Launched 08:50:10.025679 run iperf3-srv_10.42.42.10(pid=30088): Launched 08:50:10.140372 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 08:50:10.343839 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:50:10.650179 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30089): Launched 08:50:10.916410 run iperf3-srv_10.42.42.10(pid=30090): Launched 08:50:11.031177 tst iperf3m4.py:8: start network... 08:50:11.234832 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:50:11.708863 run create_hlr_db(pid=30091): Launched 08:50:11.826266 bus /gobi_6: Setting Powered False 08:50:12.887275 run create_hlr_db(pid=30091): Terminated: ok {rc=0} 08:50:13.333289 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30093): Launched 08:50:13.660244 run osmo-hlr_10.42.42.2(pid=30094): Launched 08:50:13.785728 run osmo-stp_10.42.42.5: Starting osmo-stp 08:50:14.350274 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30096): Launched 08:50:14.676651 run osmo-stp_10.42.42.5(pid=30097): Launched 08:50:14.801593 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:50:15.364001 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30099): Launched 08:50:15.489502 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:50:15.765299 run patchelf(pid=30100): Launched 08:50:15.949616 run osmo-stp_10.42.42.5(pid=30097): ERR: Terminated: ERROR {rc=1} [trial-2402↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30097)] 08:50:16.089726 run osmo-stp_10.42.42.5(pid=30097): stdout: | (launched: 2022-12-14_08:50:14.616331) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:50:16.232625 run osmo-stp_10.42.42.5(pid=30097): stderr: | 20221214085014805 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214085014805 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214085014806 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214085014806 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214085014807 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214085014807 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214085014807 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:50:16.374949 run osmo-stp_10.42.42.5(pid=30097): stdout: | (launched: 2022-12-14_08:50:14.616331) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:50:16.511698 run osmo-stp_10.42.42.5(pid=30097): stderr: | 20221214085014805 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214085014805 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214085014806 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214085014806 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214085014807 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214085014807 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214085014807 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:50:16.674043 run patchelf(pid=30100): Terminating (SIGINT) 08:50:16.859852 run patchelf(pid=30100): Terminated: ok {rc=0} 08:50:16.994232 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30097): Process ended prematurely: osmo-stp_10.42.42.5(pid=30097) [trial-2402↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30097)] [trial-2402↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8] 08:50:17.005164 tst iperf3m4.py:8: Test FAILED (10.8 sec) 08:50:17.035231 run osmo-hlr_10.42.42.2(pid=30094): ERR: Terminated: ERROR {rc=237} [trial-2402↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30094)] 08:50:17.087185 run osmo-hlr_10.42.42.2(pid=30094): stdout: | (launched: 2022-12-14_08:50:13.599819) 08:50:17.140651 run osmo-hlr_10.42.42.2(pid=30094): stderr: | 20221214085013796 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214085013796 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214085013796 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214085013796 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214085013796 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214085013796 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214085013808 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/gprs:trx-b200+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214085013818 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214085013819 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214085013819 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:50:17.194114 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30083): Terminating (SIGTERM) 08:50:17.237128 run iperf3-srv_10.42.42.10(pid=30084): Terminating (SIGTERM) 08:50:17.279393 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30085): Terminating (SIGTERM) 08:50:17.321659 run iperf3-srv_10.42.42.10(pid=30086): Terminating (SIGTERM) 08:50:17.364078 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30087): Terminating (SIGTERM) 08:50:17.406411 run iperf3-srv_10.42.42.10(pid=30088): Terminating (SIGTERM) 08:50:17.448317 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30089): Terminating (SIGTERM) 08:50:17.490873 run iperf3-srv_10.42.42.10(pid=30090): Terminating (SIGTERM) 08:50:17.533004 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30093): Terminating (SIGTERM) 08:50:17.575588 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30096): Terminating (SIGTERM) 08:50:17.617874 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30099): Terminating (SIGTERM) 08:50:17.660309 --- ParallelTerminationStrategy: PID 30083 died... 08:50:17.680482 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30083): Terminated: ok {rc=0} 08:50:17.727020 --- ParallelTerminationStrategy: PID 30084 died... 08:50:17.746669 run iperf3-srv_10.42.42.10(pid=30084): Terminated {rc=256} 08:50:17.793155 --- ParallelTerminationStrategy: PID 30085 died... 08:50:17.812755 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30085): Terminated: ok {rc=0} 08:50:17.859148 --- ParallelTerminationStrategy: PID 30086 died... 08:50:17.878812 run iperf3-srv_10.42.42.10(pid=30086): Terminated {rc=256} 08:50:17.924928 --- ParallelTerminationStrategy: PID 30087 died... 08:50:17.944658 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30087): Terminated: ok {rc=0} 08:50:17.990739 --- ParallelTerminationStrategy: PID 30088 died... 08:50:18.010327 run iperf3-srv_10.42.42.10(pid=30088): Terminated {rc=256} 08:50:18.056354 --- ParallelTerminationStrategy: PID 30089 died... 08:50:18.076087 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30089): Terminated: ok {rc=0} 08:50:18.122412 --- ParallelTerminationStrategy: PID 30090 died... 08:50:18.141985 run iperf3-srv_10.42.42.10(pid=30090): Terminated {rc=256} 08:50:18.188143 --- ParallelTerminationStrategy: PID 30093 died... 08:50:18.207985 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30093): Terminated: ok {rc=0} 08:50:18.254408 --- ParallelTerminationStrategy: PID 30096 died... 08:50:18.274103 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30096): Terminated: ok {rc=0} 08:50:18.320299 --- ParallelTerminationStrategy: PID 30099 died... 08:50:18.340160 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30099): Terminated: ok {rc=0} 08:50:18.428623 bus /gobi_4: Setting Powered False 08:50:19.527658 bus /gobi_4: Setting Powered False 08:50:20.643770 bus /gobi_1: Setting Powered False 08:50:21.741808 bus /gobi_1: Setting Powered False 08:50:22.858375 bus /gobi_0: Setting Powered False 08:50:23.955766 bus /gobi_0: Setting Powered False 08:50:25.072207 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2402 gprs:trx-b200+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 08:50:26.174123 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:50:26.186375 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 08:50:26.257428 tst ping.py: using LAC 39778 08:50:26.376643 tst ping.py: using RAC 253 08:50:26.494394 tst ping.py: using CellId 39778 08:50:26.618447 tst ping.py: using BVCI 39779 08:50:26.728453 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:50:26.739493 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:50:26.750393 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:50:26.761213 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:50:26.772099 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:50:26.783232 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:50:26.794394 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:50:26.805467 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 08:50:26.925112 tst ping.py:19: start network... 08:50:27.139150 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:50:27.634268 run create_hlr_db(pid=30101): Launched 08:50:27.766151 bus /gobi_6: Setting Powered False 08:50:28.830064 run create_hlr_db(pid=30101): Terminated: ok {rc=0} 08:50:29.256448 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30103): Launched 08:50:29.577669 run osmo-hlr_10.42.42.2(pid=30104): Launched 08:50:29.698691 run osmo-stp_10.42.42.5: Starting osmo-stp 08:50:30.250822 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30106): Launched 08:50:30.570619 run osmo-stp_10.42.42.5(pid=30107): Launched 08:50:30.693441 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:50:31.250693 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30109): Launched 08:50:31.384389 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:50:31.658553 run patchelf(pid=30110): Launched 08:50:31.847508 run osmo-stp_10.42.42.5(pid=30107): ERR: Terminated: ERROR {rc=1} [trial-2402↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30107)] 08:50:31.985742 run osmo-stp_10.42.42.5(pid=30107): stdout: | (launched: 2022-12-14_08:50:30.511812) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:50:32.125164 run osmo-stp_10.42.42.5(pid=30107): stderr: | 20221214085030704 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214085030704 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214085030704 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214085030704 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214085030705 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214085030705 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214085030705 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:50:32.263424 run osmo-stp_10.42.42.5(pid=30107): stdout: | (launched: 2022-12-14_08:50:30.511812) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:50:32.395696 run osmo-stp_10.42.42.5(pid=30107): stderr: | 20221214085030704 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214085030704 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214085030704 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214085030704 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214085030705 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214085030705 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214085030705 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:50:32.551439 run patchelf(pid=30110): Terminating (SIGINT) 08:50:32.730647 run patchelf(pid=30110): Terminated: ok {rc=0} 08:50:32.860012 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=30107): Process ended prematurely: osmo-stp_10.42.42.5(pid=30107) [trial-2402↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30107)] [trial-2402↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22] 08:50:32.869836 tst ping.py:22: Test FAILED (6.7 sec) 08:50:32.898364 run osmo-hlr_10.42.42.2(pid=30104): ERR: Terminated: ERROR {rc=237} [trial-2402↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30104)] 08:50:32.949285 run osmo-hlr_10.42.42.2(pid=30104): stdout: | (launched: 2022-12-14_08:50:29.518777) 08:50:33.001779 run osmo-hlr_10.42.42.2(pid=30104): stderr: | 20221214085029718 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214085029718 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214085029718 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214085029719 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214085029719 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214085029719 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214085029732 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/gprs:trx-b200+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214085029740 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214085029740 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214085029740 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:50:33.054907 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30103): Terminating (SIGTERM) 08:50:33.097494 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30106): Terminating (SIGTERM) 08:50:33.139971 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30109): Terminating (SIGTERM) 08:50:33.182717 --- ParallelTerminationStrategy: PID 30103 died... 08:50:33.203037 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30103): Terminated: ok {rc=0} 08:50:33.249687 --- ParallelTerminationStrategy: PID 30106 died... 08:50:33.269464 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30106): Terminated: ok {rc=0} 08:50:33.315851 --- ParallelTerminationStrategy: PID 30109 died... 08:50:33.335712 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30109): Terminated: ok {rc=0} 08:50:33.424631 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2402 gprs:trx-b200+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 08:50:34.509736 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:50:34.521468 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 08:50:34.592385 tst ping_idle_ping.py: using LAC 39779 08:50:34.710244 tst ping_idle_ping.py: using RAC 254 08:50:34.830020 tst ping_idle_ping.py: using CellId 39779 08:50:34.948163 tst ping_idle_ping.py: using BVCI 39780 08:50:35.066422 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:50:35.078267 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:50:35.089774 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:50:35.101308 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:50:35.112674 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:50:35.124125 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:50:35.135654 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:50:35.146988 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 08:50:35.268507 tst ping_idle_ping.py:24: start network... 08:50:35.484344 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:50:35.988118 run create_hlr_db(pid=30111): Launched 08:50:36.119363 bus /gobi_6: Setting Powered False 08:50:37.182500 run create_hlr_db(pid=30111): Terminated: ok {rc=0} 08:50:37.612593 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30113): Launched 08:50:37.913381 run osmo-hlr_10.42.42.2(pid=30114): Launched 08:50:38.027714 run osmo-stp_10.42.42.5: Starting osmo-stp 08:50:38.548414 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30116): Launched 08:50:38.847450 run osmo-stp_10.42.42.5(pid=30117): Launched 08:50:38.972777 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:50:39.527176 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30119): Launched 08:50:39.649121 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:50:39.919582 run patchelf(pid=30120): Launched 08:50:40.098452 run osmo-stp_10.42.42.5(pid=30117): ERR: Terminated: ERROR {rc=1} [trial-2402↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30117)] 08:50:40.233524 run osmo-stp_10.42.42.5(pid=30117): stdout: | (launched: 2022-12-14_08:50:38.791948) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:50:40.370534 run osmo-stp_10.42.42.5(pid=30117): stderr: | 20221214085038975 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214085038975 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214085038975 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214085038976 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214085038976 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214085038976 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214085038976 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:50:40.507287 run osmo-stp_10.42.42.5(pid=30117): stdout: | (launched: 2022-12-14_08:50:38.791948) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:50:40.638412 run osmo-stp_10.42.42.5(pid=30117): stderr: | 20221214085038975 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214085038975 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214085038975 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214085038976 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214085038976 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214085038976 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214085038976 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:50:40.793943 run patchelf(pid=30120): Terminating (SIGINT) 08:50:40.971653 run patchelf(pid=30120): Terminated: ok {rc=0} 08:50:41.100051 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=30117): Process ended prematurely: osmo-stp_10.42.42.5(pid=30117) [trial-2402↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30117)] [trial-2402↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 08:50:41.109810 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 08:50:41.137673 run osmo-hlr_10.42.42.2(pid=30114): ERR: Terminated: ERROR {rc=237} [trial-2402↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30114)] 08:50:41.187576 run osmo-hlr_10.42.42.2(pid=30114): stdout: | (launched: 2022-12-14_08:50:37.857990) 08:50:41.239027 run osmo-hlr_10.42.42.2(pid=30114): stderr: | 20221214085038031 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214085038031 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214085038031 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214085038031 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214085038031 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214085038031 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214085038044 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/gprs:trx-b200+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214085038053 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214085038053 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214085038053 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:50:41.291050 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30113): Terminating (SIGTERM) 08:50:41.332799 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30116): Terminating (SIGTERM) 08:50:41.374477 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30119): Terminating (SIGTERM) 08:50:41.416379 --- ParallelTerminationStrategy: PID 30113 died... 08:50:41.436341 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30113): Terminated: ok {rc=0} 08:50:41.482821 --- ParallelTerminationStrategy: PID 30116 died... 08:50:41.502457 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30116): Terminated: ok {rc=0} 08:50:41.548163 --- ParallelTerminationStrategy: PID 30119 died... 08:50:41.567722 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30119): Terminated: ok {rc=0} 08:50:41.654792 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2402 gprs:trx-b200+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 gprs:trx-b200+mod-bts0-dynts-osmo --------------------------------------------------------------------- 08:50:42.954034 tst gprs:trx-b200+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:50:42.959961 tst gprs:trx-b200+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 08:50:42.992352 tst gprs:trx-b200+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 08:50:43.031296 tst gprs:trx-b200+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 08:50:43.117413 tst gprs:trx-b200+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 08:50:43.150126 tst gprs:trx-b200+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 08:50:43.188183 tst gprs:trx-b200+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 08:50:43.782695 tst gprs:trx-b200+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2402 gprs:trx-b200+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 08:50:43.831830 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:50:43.843024 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 08:50:43.912714 tst cs_paging_gprs_active.py: using LAC 39780 08:50:44.032219 tst cs_paging_gprs_active.py: using RAC 255 08:50:44.151688 tst cs_paging_gprs_active.py: using CellId 39780 08:50:44.272910 tst cs_paging_gprs_active.py: using BVCI 39781 08:50:44.383312 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:50:44.394437 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:50:44.405197 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:50:44.415784 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:50:44.426698 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:50:44.437818 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:50:44.449292 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:50:44.460254 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:50:44.471480 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 08:50:44.591900 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 08:50:44.711275 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 08:50:44.916754 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:50:45.224542 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30127): Launched 08:50:45.491651 run iperf3-srv_10.42.42.10(pid=30128): Launched 08:50:45.606491 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 08:50:45.810852 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:50:46.169796 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30129): Launched 08:50:46.454810 run iperf3-srv_10.42.42.10(pid=30130): Launched 08:50:46.586883 tst cs_paging_gprs_active.py:38: start network... 08:50:46.796177 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:50:47.279861 run create_hlr_db(pid=30131): Launched 08:50:47.396353 bus /gobi_6: Setting Powered False 08:50:48.458173 run create_hlr_db(pid=30131): Terminated: ok {rc=0} 08:50:48.902328 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30133): Launched 08:50:49.229341 run osmo-hlr_10.42.42.2(pid=30134): Launched 08:50:49.355238 run osmo-stp_10.42.42.5: Starting osmo-stp 08:50:49.919443 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30136): Launched 08:50:50.245627 run osmo-stp_10.42.42.5(pid=30137): Launched 08:50:50.371470 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:50:50.935223 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30139): Launched 08:50:51.061314 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:50:51.336459 run patchelf(pid=30140): Launched 08:50:51.518833 run osmo-stp_10.42.42.5(pid=30137): ERR: Terminated: ERROR {rc=1} [trial-2402↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30137)] 08:50:51.656371 run osmo-stp_10.42.42.5(pid=30137): stdout: | (launched: 2022-12-14_08:50:50.185889) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:50:51.795328 run osmo-stp_10.42.42.5(pid=30137): stderr: | 20221214085050378 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214085050378 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214085050378 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214085050378 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214085050379 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214085050379 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214085050379 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:50:51.934179 run osmo-stp_10.42.42.5(pid=30137): stdout: | (launched: 2022-12-14_08:50:50.185889) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:50:52.069782 run osmo-stp_10.42.42.5(pid=30137): stderr: | 20221214085050378 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214085050378 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214085050378 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214085050378 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214085050379 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214085050379 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214085050379 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:50:52.227943 run patchelf(pid=30140): Terminating (SIGINT) 08:50:52.409424 run patchelf(pid=30140): Terminated: ok {rc=0} 08:50:52.540929 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=30137): Process ended prematurely: osmo-stp_10.42.42.5(pid=30137) [trial-2402↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30137)] [trial-2402↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 08:50:52.551342 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 08:50:52.580114 run osmo-hlr_10.42.42.2(pid=30134): ERR: Terminated: ERROR {rc=237} [trial-2402↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30134)] 08:50:52.630569 run osmo-hlr_10.42.42.2(pid=30134): stdout: | (launched: 2022-12-14_08:50:49.169709) 08:50:52.682603 run osmo-hlr_10.42.42.2(pid=30134): stderr: | 20221214085049369 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214085049369 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214085049369 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214085049369 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214085049369 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214085049369 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214085049381 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/gprs:trx-b200+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214085049389 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214085049390 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214085049390 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:50:52.734730 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30127): Terminating (SIGTERM) 08:50:52.776930 run iperf3-srv_10.42.42.10(pid=30128): Terminating (SIGTERM) 08:50:52.818683 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30129): Terminating (SIGTERM) 08:50:52.860521 run iperf3-srv_10.42.42.10(pid=30130): Terminating (SIGTERM) 08:50:52.902737 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30133): Terminating (SIGTERM) 08:50:52.944514 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30136): Terminating (SIGTERM) 08:50:52.986358 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30139): Terminating (SIGTERM) 08:50:53.028401 --- ParallelTerminationStrategy: PID 30127 died... 08:50:53.048668 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30127): Terminated: ok {rc=0} 08:50:53.095393 --- ParallelTerminationStrategy: PID 30128 died... 08:50:53.115242 run iperf3-srv_10.42.42.10(pid=30128): Terminated {rc=256} 08:50:53.161608 --- ParallelTerminationStrategy: PID 30129 died... 08:50:53.181458 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30129): Terminated: ok {rc=0} 08:50:53.227853 --- ParallelTerminationStrategy: PID 30130 died... 08:50:53.247643 run iperf3-srv_10.42.42.10(pid=30130): Terminated {rc=256} 08:50:53.294010 --- ParallelTerminationStrategy: PID 30133 died... 08:50:53.313661 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30133): Terminated: ok {rc=0} 08:50:53.360021 --- ParallelTerminationStrategy: PID 30136 died... 08:50:53.379663 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30136): Terminated: ok {rc=0} 08:50:53.426001 --- ParallelTerminationStrategy: PID 30139 died... 08:50:53.445803 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30139): Terminated: ok {rc=0} 08:50:53.533504 bus /gobi_0: Setting Powered False 08:50:54.633560 bus /gobi_0: Setting Powered False 08:50:55.748915 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2402 gprs:trx-b200+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 08:50:56.893763 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:50:56.905672 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 08:50:56.978264 tst iperf3.py: using LAC 39781 08:50:57.100759 tst iperf3.py: using RAC 1 08:50:57.220295 tst iperf3.py: using CellId 39781 08:50:57.341347 tst iperf3.py: using BVCI 39782 08:50:57.454820 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:50:57.465951 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:50:57.476670 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:50:57.487471 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:50:57.498524 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:50:57.509985 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:50:57.521276 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:50:57.532146 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:50:57.543380 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 08:50:57.659466 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 08:50:57.880925 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:50:58.208053 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30141): Launched 08:50:58.491980 run iperf3-srv_10.42.42.10(pid=30142): Launched 08:50:58.615110 tst iperf3.py:8: start network... 08:50:58.834863 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:50:59.339588 run create_hlr_db(pid=30143): Launched 08:50:59.474074 bus /gobi_6: Setting Powered False 08:51:00.537904 run create_hlr_db(pid=30143): Terminated: ok {rc=0} 08:51:00.984164 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30145): Launched 08:51:01.298771 run osmo-hlr_10.42.42.2(pid=30146): Launched 08:51:01.542829 run osmo-stp_10.42.42.5: Starting osmo-stp 08:51:02.211387 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30148): Launched 08:51:02.545747 run osmo-stp_10.42.42.5(pid=30149): Launched 08:51:02.672050 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:51:03.234524 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30151): Launched 08:51:03.359570 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:51:03.635025 run patchelf(pid=30152): Launched 08:51:03.816908 run osmo-stp_10.42.42.5(pid=30149): ERR: Terminated: ERROR {rc=1} [trial-2402↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30149)] 08:51:03.954414 run osmo-stp_10.42.42.5(pid=30149): stdout: | (launched: 2022-12-14_08:51:02.485663) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:51:04.093296 run osmo-stp_10.42.42.5(pid=30149): stderr: | 20221214085102679 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214085102679 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214085102679 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214085102679 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214085102680 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214085102680 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214085102680 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:51:04.232165 run osmo-stp_10.42.42.5(pid=30149): stdout: | (launched: 2022-12-14_08:51:02.485663) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:51:04.365807 run osmo-stp_10.42.42.5(pid=30149): stderr: | 20221214085102679 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214085102679 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214085102679 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214085102679 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214085102680 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214085102680 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214085102680 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:51:04.523759 run patchelf(pid=30152): Terminating (SIGINT) 08:51:04.704489 run patchelf(pid=30152): Terminated: ok {rc=0} 08:51:04.835616 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30149): Process ended prematurely: osmo-stp_10.42.42.5(pid=30149) [trial-2402↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30149)] [trial-2402↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8] 08:51:04.846040 tst iperf3.py:8: Test FAILED (8.0 sec) 08:51:04.874652 run osmo-hlr_10.42.42.2(pid=30146): ERR: Terminated: ERROR {rc=237} [trial-2402↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30146)] 08:51:04.925253 run osmo-hlr_10.42.42.2(pid=30146): stdout: | (launched: 2022-12-14_08:51:01.239547) 08:51:04.977627 run osmo-hlr_10.42.42.2(pid=30146): stderr: | 20221214085101586 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214085101586 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214085101586 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214085101586 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214085101586 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214085101586 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214085101602 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/gprs:trx-b200+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214085101614 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214085101614 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214085101614 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:51:05.030651 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30141): Terminating (SIGTERM) 08:51:05.072910 run iperf3-srv_10.42.42.10(pid=30142): Terminating (SIGTERM) 08:51:05.115802 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30145): Terminating (SIGTERM) 08:51:05.158443 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30148): Terminating (SIGTERM) 08:51:05.201289 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30151): Terminating (SIGTERM) 08:51:05.243800 --- ParallelTerminationStrategy: PID 30141 died... 08:51:05.263977 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30141): Terminated: ok {rc=0} 08:51:05.310499 --- ParallelTerminationStrategy: PID 30142 died... 08:51:05.330297 run iperf3-srv_10.42.42.10(pid=30142): Terminated {rc=256} 08:51:05.376537 --- ParallelTerminationStrategy: PID 30145 died... 08:51:05.396265 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30145): Terminated: ok {rc=0} 08:51:05.442633 --- ParallelTerminationStrategy: PID 30148 died... 08:51:05.462458 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30148): Terminated: ok {rc=0} 08:51:05.508905 --- ParallelTerminationStrategy: PID 30151 died... 08:51:05.529189 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30151): Terminated: ok {rc=0} 08:51:05.618011 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2402 gprs:trx-b200+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 08:51:06.769356 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:51:06.782202 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 08:51:06.859541 tst iperf3m4.py: using LAC 39782 08:51:06.989726 tst iperf3m4.py: using RAC 2 08:51:07.117412 tst iperf3m4.py: using CellId 39782 08:51:07.244128 tst iperf3m4.py: using BVCI 39783 08:51:07.362773 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:51:07.374421 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:51:07.385779 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:51:07.397184 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:51:07.408364 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:51:07.419729 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:51:07.431158 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:51:07.442530 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:51:07.454173 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 08:51:07.577577 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 08:51:07.698941 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 08:51:07.819696 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 08:51:07.940774 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 08:51:08.161066 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:51:08.489149 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30153): Launched 08:51:08.773513 run iperf3-srv_10.42.42.10(pid=30154): Launched 08:51:08.897970 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 08:51:09.118353 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:51:09.446500 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30155): Launched 08:51:09.729778 run iperf3-srv_10.42.42.10(pid=30156): Launched 08:51:09.854414 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 08:51:10.074782 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:51:10.403078 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30157): Launched 08:51:10.687386 run iperf3-srv_10.42.42.10(pid=30158): Launched 08:51:10.811568 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 08:51:11.030931 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:51:11.358462 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30159): Launched 08:51:11.642083 run iperf3-srv_10.42.42.10(pid=30160): Launched 08:51:11.765588 tst iperf3m4.py:8: start network... 08:51:11.984557 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:51:12.491041 run create_hlr_db(pid=30161): Launched 08:51:12.626039 bus /gobi_6: Setting Powered False 08:51:13.690366 run create_hlr_db(pid=30161): Terminated: ok {rc=0} 08:51:14.127653 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30163): Launched 08:51:14.434050 run osmo-hlr_10.42.42.2(pid=30164): Launched 08:51:14.551899 run osmo-stp_10.42.42.5: Starting osmo-stp 08:51:15.082561 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30166): Launched 08:51:15.388246 run osmo-stp_10.42.42.5(pid=30167): Launched 08:51:15.504327 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:51:16.042929 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30169): Launched 08:51:16.175242 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:51:16.445755 run patchelf(pid=30170): Launched 08:51:16.635600 run osmo-stp_10.42.42.5(pid=30167): ERR: Terminated: ERROR {rc=1} [trial-2402↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30167)] 08:51:16.769407 run osmo-stp_10.42.42.5(pid=30167): stdout: | (launched: 2022-12-14_08:51:15.331377) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:51:16.905147 run osmo-stp_10.42.42.5(pid=30167): stderr: | 20221214085115500 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214085115501 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214085115501 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214085115501 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214085115502 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214085115502 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214085115502 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:51:17.040554 run osmo-stp_10.42.42.5(pid=30167): stdout: | (launched: 2022-12-14_08:51:15.331377) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:51:17.170840 run osmo-stp_10.42.42.5(pid=30167): stderr: | 20221214085115500 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214085115501 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214085115501 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214085115501 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214085115502 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214085115502 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214085115502 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:51:17.322170 run patchelf(pid=30170): Terminating (SIGINT) 08:51:17.493493 run patchelf(pid=30170): Terminated: ok {rc=0} 08:51:17.617138 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30167): Process ended prematurely: osmo-stp_10.42.42.5(pid=30167) [trial-2402↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30167)] [trial-2402↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8] 08:51:17.626962 tst iperf3m4.py:8: Test FAILED (10.9 sec) 08:51:17.654726 run osmo-hlr_10.42.42.2(pid=30164): ERR: Terminated: ERROR {rc=237} [trial-2402↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30164)] 08:51:17.703777 run osmo-hlr_10.42.42.2(pid=30164): stdout: | (launched: 2022-12-14_08:51:14.377481) 08:51:17.753899 run osmo-hlr_10.42.42.2(pid=30164): stderr: | 20221214085114552 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214085114552 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214085114552 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214085114552 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214085114552 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214085114552 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214085114564 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/gprs:trx-b200+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214085114572 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214085114572 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214085114572 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:51:17.804409 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30153): Terminating (SIGTERM) 08:51:17.844831 run iperf3-srv_10.42.42.10(pid=30154): Terminating (SIGTERM) 08:51:17.885103 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30155): Terminating (SIGTERM) 08:51:17.925424 run iperf3-srv_10.42.42.10(pid=30156): Terminating (SIGTERM) 08:51:17.965402 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30157): Terminating (SIGTERM) 08:51:18.005846 run iperf3-srv_10.42.42.10(pid=30158): Terminating (SIGTERM) 08:51:18.045994 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30159): Terminating (SIGTERM) 08:51:18.086177 run iperf3-srv_10.42.42.10(pid=30160): Terminating (SIGTERM) 08:51:18.126408 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30163): Terminating (SIGTERM) 08:51:18.166662 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30166): Terminating (SIGTERM) 08:51:18.206749 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30169): Terminating (SIGTERM) 08:51:18.247358 --- ParallelTerminationStrategy: PID 30153 died... 08:51:18.267077 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30153): Terminated: ok {rc=0} 08:51:18.311593 --- ParallelTerminationStrategy: PID 30154 died... 08:51:18.330512 run iperf3-srv_10.42.42.10(pid=30154): Terminated {rc=256} 08:51:18.374958 --- ParallelTerminationStrategy: PID 30155 died... 08:51:18.394094 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30155): Terminated: ok {rc=0} 08:51:18.438298 --- ParallelTerminationStrategy: PID 30156 died... 08:51:18.457758 run iperf3-srv_10.42.42.10(pid=30156): Terminated {rc=256} 08:51:18.502239 --- ParallelTerminationStrategy: PID 30157 died... 08:51:18.521285 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30157): Terminated: ok {rc=0} 08:51:18.565514 --- ParallelTerminationStrategy: PID 30158 died... 08:51:18.584497 run iperf3-srv_10.42.42.10(pid=30158): Terminated {rc=256} 08:51:18.628672 --- ParallelTerminationStrategy: PID 30159 died... 08:51:18.647791 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30159): Terminated: ok {rc=0} 08:51:18.692369 --- ParallelTerminationStrategy: PID 30160 died... 08:51:18.711666 run iperf3-srv_10.42.42.10(pid=30160): Terminated {rc=256} 08:51:18.755926 --- ParallelTerminationStrategy: PID 30163 died... 08:51:18.775075 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30163): Terminated: ok {rc=0} 08:51:18.819661 --- ParallelTerminationStrategy: PID 30166 died... 08:51:18.838940 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30166): Terminated: ok {rc=0} 08:51:18.883198 --- ParallelTerminationStrategy: PID 30169 died... 08:51:18.902417 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30169): Terminated: ok {rc=0} 08:51:18.989863 bus /gobi_4: Setting Powered False 08:51:20.089658 bus /gobi_4: Setting Powered False 08:51:21.204888 bus /gobi_1: Setting Powered False 08:51:22.304051 bus /gobi_1: Setting Powered False 08:51:23.419631 bus /gobi_0: Setting Powered False 08:51:24.520284 bus /gobi_0: Setting Powered False 08:51:25.636422 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2402 gprs:trx-b200+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 08:51:26.738875 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:51:26.750529 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 08:51:26.820185 tst ping.py: using LAC 39783 08:51:26.938038 tst ping.py: using RAC 3 08:51:27.062956 tst ping.py: using CellId 39783 08:51:27.180421 tst ping.py: using BVCI 39784 08:51:27.289481 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:51:27.300397 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:51:27.311140 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:51:27.321868 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:51:27.332861 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:51:27.344424 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:51:27.355770 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:51:27.366929 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 08:51:27.484336 tst ping.py:19: start network... 08:51:27.700068 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:51:28.194232 run create_hlr_db(pid=30171): Launched 08:51:28.326007 bus /gobi_6: Setting Powered False 08:51:29.389921 run create_hlr_db(pid=30171): Terminated: ok {rc=0} 08:51:29.816843 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30173): Launched 08:51:30.117403 run osmo-hlr_10.42.42.2(pid=30174): Launched 08:51:30.232186 run osmo-stp_10.42.42.5: Starting osmo-stp 08:51:30.770001 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30176): Launched 08:51:31.105339 run osmo-stp_10.42.42.5(pid=30177): Launched 08:51:31.314894 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:51:31.949724 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30179): Launched 08:51:32.078434 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:51:32.353651 run patchelf(pid=30180): Launched 08:51:32.532936 run osmo-stp_10.42.42.5(pid=30177): ERR: Terminated: ERROR {rc=1} [trial-2402↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30177)] 08:51:32.668675 run osmo-stp_10.42.42.5(pid=30177): stdout: | (launched: 2022-12-14_08:51:31.045014) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:51:32.806236 run osmo-stp_10.42.42.5(pid=30177): stderr: | 20221214085131284 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214085131287 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214085131287 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214085131290 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214085131291 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214085131291 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214085131294 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:51:32.943003 run osmo-stp_10.42.42.5(pid=30177): stdout: | (launched: 2022-12-14_08:51:31.045014) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:51:33.073572 run osmo-stp_10.42.42.5(pid=30177): stderr: | 20221214085131284 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214085131287 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214085131287 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214085131290 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214085131291 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214085131291 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214085131294 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:51:33.228908 run patchelf(pid=30180): Terminating (SIGINT) 08:51:33.407059 run patchelf(pid=30180): Terminated: ok {rc=0} 08:51:33.535283 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=30177): Process ended prematurely: osmo-stp_10.42.42.5(pid=30177) [trial-2402↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30177)] [trial-2402↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22] 08:51:33.545090 tst ping.py:22: Test FAILED (6.8 sec) 08:51:33.573146 run osmo-hlr_10.42.42.2(pid=30174): ERR: Terminated: ERROR {rc=237} [trial-2402↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30174)] 08:51:33.623397 run osmo-hlr_10.42.42.2(pid=30174): stdout: | (launched: 2022-12-14_08:51:30.061586) 08:51:33.675175 run osmo-hlr_10.42.42.2(pid=30174): stderr: | 20221214085130236 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214085130236 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214085130236 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214085130236 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214085130236 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214085130236 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214085130248 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/gprs:trx-b200+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214085130257 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214085130257 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214085130257 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:51:33.727237 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30173): Terminating (SIGTERM) 08:51:33.769068 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30176): Terminating (SIGTERM) 08:51:33.811037 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30179): Terminating (SIGTERM) 08:51:33.852903 --- ParallelTerminationStrategy: PID 30173 died... 08:51:33.873149 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30173): Terminated: ok {rc=0} 08:51:33.919570 --- ParallelTerminationStrategy: PID 30176 died... 08:51:33.939243 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30176): Terminated: ok {rc=0} 08:51:33.985284 --- ParallelTerminationStrategy: PID 30179 died... 08:51:34.004937 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30179): Terminated: ok {rc=0} 08:51:34.091982 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2402 gprs:trx-b200+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 08:51:35.180115 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:51:35.192378 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 08:51:35.264464 tst ping_idle_ping.py: using LAC 39784 08:51:35.382761 tst ping_idle_ping.py: using RAC 4 08:51:35.501437 tst ping_idle_ping.py: using CellId 39784 08:51:35.628872 tst ping_idle_ping.py: using BVCI 39785 08:51:35.746055 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:51:35.757676 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:51:35.769118 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:51:35.780534 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:51:35.792280 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:51:35.804255 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:51:35.816073 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:51:35.827750 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 08:51:35.945462 tst ping_idle_ping.py:24: start network... 08:51:36.146404 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:51:36.614744 run create_hlr_db(pid=30181): Launched 08:51:36.730749 bus /gobi_6: Setting Powered False 08:51:37.790570 run create_hlr_db(pid=30181): Terminated: ok {rc=0} 08:51:38.209320 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30183): Launched 08:51:38.509101 run osmo-hlr_10.42.42.2(pid=30184): Launched 08:51:38.623834 run osmo-stp_10.42.42.5: Starting osmo-stp 08:51:39.148871 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30186): Launched 08:51:39.448841 run osmo-stp_10.42.42.5(pid=30187): Launched 08:51:39.563241 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:51:40.079435 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30189): Launched 08:51:40.193816 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:51:40.446912 run patchelf(pid=30190): Launched 08:51:40.613396 run osmo-stp_10.42.42.5(pid=30187): ERR: Terminated: ERROR {rc=1} [trial-2402↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30187)] 08:51:40.740505 run osmo-stp_10.42.42.5(pid=30187): stdout: | (launched: 2022-12-14_08:51:39.393300) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:51:40.869934 run osmo-stp_10.42.42.5(pid=30187): stderr: | 20221214085139564 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214085139564 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214085139564 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214085139565 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214085139565 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214085139565 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214085139565 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:51:40.998376 run osmo-stp_10.42.42.5(pid=30187): stdout: | (launched: 2022-12-14_08:51:39.393300) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:51:41.121523 run osmo-stp_10.42.42.5(pid=30187): stderr: | 20221214085139564 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214085139564 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214085139564 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214085139565 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214085139565 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214085139565 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214085139565 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:51:41.267044 run patchelf(pid=30190): Terminating (SIGINT) 08:51:41.434780 run patchelf(pid=30190): Terminated: ok {rc=0} 08:51:41.555300 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=30187): Process ended prematurely: osmo-stp_10.42.42.5(pid=30187) [trial-2402↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30187)] [trial-2402↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 08:51:41.564348 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 08:51:41.591044 run osmo-hlr_10.42.42.2(pid=30184): ERR: Terminated: ERROR {rc=237} [trial-2402↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30184)] 08:51:41.638827 run osmo-hlr_10.42.42.2(pid=30184): stdout: | (launched: 2022-12-14_08:51:38.453208) 08:51:41.688124 run osmo-hlr_10.42.42.2(pid=30184): stderr: | 20221214085138627 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214085138627 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214085138627 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214085138627 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214085138627 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214085138627 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214085138638 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/gprs:trx-b200+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214085138646 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214085138646 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214085138646 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:51:41.737925 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30183): Terminating (SIGTERM) 08:51:41.777508 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30186): Terminating (SIGTERM) 08:51:41.817093 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30189): Terminating (SIGTERM) 08:51:41.856878 --- ParallelTerminationStrategy: PID 30183 died... 08:51:41.876275 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30183): Terminated: ok {rc=0} 08:51:41.920786 --- ParallelTerminationStrategy: PID 30186 died... 08:51:41.939705 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30186): Terminated: ok {rc=0} 08:51:41.983615 --- ParallelTerminationStrategy: PID 30189 died... 08:51:42.002526 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30189): Terminated: ok {rc=0} 08:51:42.086080 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2402 gprs:trx-b200+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 08:51:43.395924 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:51:43.403465 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 08:51:43.438242 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 9 x ip_address (candidates: 9) 08:51:43.478346 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 4 x modem (candidates: 12) 08:51:43.567277 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 08:51:43.601382 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 9 x ip_address (candidates: 9) 08:51:43.640664 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 4 x modem (candidates: 12) 08:51:44.241625 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2402 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend cs_paging_gprs_active.py ---------------------------------------------- 08:51:44.293629 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:51:44.305549 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 08:51:44.359218 tst cs_paging_gprs_active.py: using LAC 39785 08:51:44.486778 tst cs_paging_gprs_active.py: using RAC 5 08:51:44.616023 tst cs_paging_gprs_active.py: using CellId 39785 08:51:44.743128 tst cs_paging_gprs_active.py: using BVCI 39786 08:51:44.862293 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:51:44.874427 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:51:44.886052 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:51:44.897926 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:51:44.909489 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:51:44.921076 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:51:44.932675 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:51:44.944150 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:51:44.955998 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 08:51:45.073549 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 08:51:45.194599 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 08:51:45.401649 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:51:45.711104 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30194): Launched 08:51:45.989783 run iperf3-srv_10.42.42.10(pid=30195): Launched 08:51:46.155109 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 08:51:46.459663 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:51:46.807163 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30196): Launched 08:51:47.087510 run iperf3-srv_10.42.42.10(pid=30197): Launched 08:51:47.217962 tst cs_paging_gprs_active.py:38: start network... 08:51:47.427592 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:51:47.903363 run create_hlr_db(pid=30198): Launched 08:51:48.021233 bus /gobi_6: Setting Powered False 08:51:49.081886 run create_hlr_db(pid=30198): Terminated: ok {rc=0} 08:51:49.506654 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30200): Launched 08:51:49.812173 run osmo-hlr_10.42.42.2(pid=30201): Launched 08:51:49.928376 run osmo-stp_10.42.42.5: Starting osmo-stp 08:51:50.467096 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30203): Launched 08:51:50.771944 run osmo-stp_10.42.42.5(pid=30204): Launched 08:51:50.887932 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:51:51.415847 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30206): Launched 08:51:51.533112 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:51:51.791290 run patchelf(pid=30207): Launched 08:51:51.961342 run osmo-stp_10.42.42.5(pid=30204): ERR: Terminated: ERROR {rc=1} [trial-2402↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30204)] 08:51:52.090767 run osmo-stp_10.42.42.5(pid=30204): stdout: | (launched: 2022-12-14_08:51:50.715524) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:51:52.221529 run osmo-stp_10.42.42.5(pid=30204): stderr: | 20221214085150889 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214085150889 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214085150889 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214085150890 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214085150890 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214085150890 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214085150891 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:51:52.352031 run osmo-stp_10.42.42.5(pid=30204): stdout: | (launched: 2022-12-14_08:51:50.715524) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:51:52.477718 run osmo-stp_10.42.42.5(pid=30204): stderr: | 20221214085150889 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214085150889 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214085150889 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214085150890 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214085150890 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214085150890 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214085150891 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:51:52.626259 run patchelf(pid=30207): Terminating (SIGINT) 08:51:52.796591 run patchelf(pid=30207): Terminated: ok {rc=0} 08:51:52.919649 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=30204): Process ended prematurely: osmo-stp_10.42.42.5(pid=30204) [trial-2402↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30204)] [trial-2402↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38] 08:51:52.929225 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 08:51:52.956531 run osmo-hlr_10.42.42.2(pid=30201): ERR: Terminated: ERROR {rc=237} [trial-2402↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30201)] 08:51:53.005181 run osmo-hlr_10.42.42.2(pid=30201): stdout: | (launched: 2022-12-14_08:51:49.755757) 08:51:53.055073 run osmo-hlr_10.42.42.2(pid=30201): stderr: | 20221214085149932 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214085149932 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214085149932 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214085149932 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214085149932 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214085149932 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214085149947 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214085149956 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214085149956 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214085149956 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:51:53.105308 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30194): Terminating (SIGTERM) 08:51:53.145480 run iperf3-srv_10.42.42.10(pid=30195): Terminating (SIGTERM) 08:51:53.185504 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30196): Terminating (SIGTERM) 08:51:53.225675 run iperf3-srv_10.42.42.10(pid=30197): Terminating (SIGTERM) 08:51:53.265722 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30200): Terminating (SIGTERM) 08:51:53.305837 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30203): Terminating (SIGTERM) 08:51:53.345933 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30206): Terminating (SIGTERM) 08:51:53.385897 --- ParallelTerminationStrategy: PID 30194 died... 08:51:53.405079 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30194): Terminated: ok {rc=0} 08:51:53.448798 --- ParallelTerminationStrategy: PID 30195 died... 08:51:53.467695 run iperf3-srv_10.42.42.10(pid=30195): Terminated {rc=256} 08:51:53.511750 --- ParallelTerminationStrategy: PID 30196 died... 08:51:53.530810 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30196): Terminated: ok {rc=0} 08:51:53.574763 --- ParallelTerminationStrategy: PID 30197 died... 08:51:53.593598 run iperf3-srv_10.42.42.10(pid=30197): Terminated {rc=256} 08:51:53.637412 --- ParallelTerminationStrategy: PID 30200 died... 08:51:53.656407 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30200): Terminated: ok {rc=0} 08:51:53.700355 --- ParallelTerminationStrategy: PID 30203 died... 08:51:53.719382 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30203): Terminated: ok {rc=0} 08:51:53.763333 --- ParallelTerminationStrategy: PID 30206 died... 08:51:53.782373 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30206): Terminated: ok {rc=0} 08:51:53.869147 bus /gobi_0: Setting Powered False 08:51:54.968891 bus /gobi_0: Setting Powered False 08:51:56.084286 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2402 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3.py ---------------------------------------------- 08:51:57.230081 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:51:57.242083 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 08:51:57.297074 tst iperf3.py: using LAC 39786 08:51:57.418203 tst iperf3.py: using RAC 6 08:51:57.539722 tst iperf3.py: using CellId 39786 08:51:57.661369 tst iperf3.py: using BVCI 39787 08:51:57.772587 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:51:57.784440 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:51:57.795750 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:51:57.807224 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:51:57.818672 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:51:57.830147 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:51:57.841761 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:51:57.853107 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:51:57.864627 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 08:51:57.985212 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 08:51:58.206313 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:51:58.533432 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30208): Launched 08:51:58.818364 run iperf3-srv_10.42.42.10(pid=30209): Launched 08:51:58.943241 tst iperf3.py:8: start network... 08:51:59.164282 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:51:59.672203 run create_hlr_db(pid=30210): Launched 08:51:59.804800 bus /gobi_6: Setting Powered False 08:52:00.890304 run create_hlr_db(pid=30210): Terminated: ok {rc=0} 08:52:01.368339 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30212): Launched 08:52:01.709556 run osmo-hlr_10.42.42.2(pid=30213): Launched 08:52:01.944491 run osmo-stp_10.42.42.5: Starting osmo-stp 08:52:02.580469 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30215): Launched 08:52:02.887224 run osmo-stp_10.42.42.5(pid=30216): Launched 08:52:03.006248 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:52:03.533080 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30218): Launched 08:52:03.650027 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:52:03.908338 run patchelf(pid=30219): Launched 08:52:04.077966 run osmo-stp_10.42.42.5(pid=30216): ERR: Terminated: ERROR {rc=1} [trial-2402↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30216)] 08:52:04.207083 run osmo-stp_10.42.42.5(pid=30216): stdout: | (launched: 2022-12-14_08:52:02.830021) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:52:04.337613 run osmo-stp_10.42.42.5(pid=30216): stderr: | 20221214085202999 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214085202999 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214085202999 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214085203000 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214085203000 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214085203000 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214085203000 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:52:04.468340 run osmo-stp_10.42.42.5(pid=30216): stdout: | (launched: 2022-12-14_08:52:02.830021) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:52:04.593304 run osmo-stp_10.42.42.5(pid=30216): stderr: | 20221214085202999 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214085202999 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214085202999 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214085203000 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214085203000 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214085203000 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214085203000 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:52:04.741300 run patchelf(pid=30219): Terminating (SIGINT) 08:52:04.911921 run patchelf(pid=30219): Terminated: ok {rc=0} 08:52:05.035004 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30216): Process ended prematurely: osmo-stp_10.42.42.5(pid=30216) [trial-2402↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30216)] [trial-2402↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8] 08:52:05.044683 tst iperf3.py:8: Test FAILED (7.9 sec) 08:52:05.072014 run osmo-hlr_10.42.42.2(pid=30213): ERR: Terminated: ERROR {rc=237} [trial-2402↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30213)] 08:52:05.120144 run osmo-hlr_10.42.42.2(pid=30213): stdout: | (launched: 2022-12-14_08:52:01.650082) 08:52:05.169892 run osmo-hlr_10.42.42.2(pid=30213): stderr: | 20221214085201950 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214085201950 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214085201950 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214085201950 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214085201950 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214085201950 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214085201974 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214085201982 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214085201982 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214085201982 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:52:05.219837 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30208): Terminating (SIGTERM) 08:52:05.259737 run iperf3-srv_10.42.42.10(pid=30209): Terminating (SIGTERM) 08:52:05.299570 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30212): Terminating (SIGTERM) 08:52:05.339290 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30215): Terminating (SIGTERM) 08:52:05.379197 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30218): Terminating (SIGTERM) 08:52:05.419208 --- ParallelTerminationStrategy: PID 30208 died... 08:52:05.438493 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30208): Terminated: ok {rc=0} 08:52:05.482699 --- ParallelTerminationStrategy: PID 30209 died... 08:52:05.501555 run iperf3-srv_10.42.42.10(pid=30209): Terminated {rc=256} 08:52:05.545488 --- ParallelTerminationStrategy: PID 30212 died... 08:52:05.564350 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30212): Terminated: ok {rc=0} 08:52:05.608465 --- ParallelTerminationStrategy: PID 30215 died... 08:52:05.627359 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30215): Terminated: ok {rc=0} 08:52:05.671177 --- ParallelTerminationStrategy: PID 30218 died... 08:52:05.690176 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30218): Terminated: ok {rc=0} 08:52:05.775889 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2402 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3m4.py ---------------------------------------------- 08:52:06.923142 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:52:06.935357 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 08:52:06.988634 tst iperf3m4.py: using LAC 39787 08:52:07.108679 tst iperf3m4.py: using RAC 7 08:52:07.229263 tst iperf3m4.py: using CellId 39787 08:52:07.350157 tst iperf3m4.py: using BVCI 39788 08:52:07.463137 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:52:07.474662 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:52:07.486021 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:52:07.497187 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:52:07.508540 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:52:07.520033 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:52:07.531528 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:52:07.542825 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:52:07.554383 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 08:52:07.671826 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 08:52:07.792684 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 08:52:07.914781 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 08:52:08.034722 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 08:52:08.240155 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:52:08.548545 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30220): Launched 08:52:08.815307 run iperf3-srv_10.42.42.10(pid=30221): Launched 08:52:08.930435 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 08:52:09.134613 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:52:09.441251 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30222): Launched 08:52:09.706398 run iperf3-srv_10.42.42.10(pid=30223): Launched 08:52:09.823028 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 08:52:10.026870 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:52:10.333817 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30224): Launched 08:52:10.599768 run iperf3-srv_10.42.42.10(pid=30225): Launched 08:52:10.714585 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 08:52:10.918471 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:52:11.225612 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30226): Launched 08:52:11.491359 run iperf3-srv_10.42.42.10(pid=30227): Launched 08:52:11.605901 tst iperf3m4.py:8: start network... 08:52:11.809734 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:52:12.282007 run create_hlr_db(pid=30228): Launched 08:52:12.397965 bus /gobi_6: Setting Powered False 08:52:13.458328 run create_hlr_db(pid=30228): Terminated: ok {rc=0} 08:52:13.881955 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30230): Launched 08:52:14.187119 run osmo-hlr_10.42.42.2(pid=30231): Launched 08:52:14.303865 run osmo-stp_10.42.42.5: Starting osmo-stp 08:52:14.846808 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30233): Launched 08:52:15.151568 run osmo-stp_10.42.42.5(pid=30234): Launched 08:52:15.268236 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:52:15.793362 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30236): Launched 08:52:15.911898 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:52:16.181764 run patchelf(pid=30237): Launched 08:52:16.372538 run osmo-stp_10.42.42.5(pid=30234): ERR: Terminated: ERROR {rc=1} [trial-2402↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30234)] 08:52:16.515054 run osmo-stp_10.42.42.5(pid=30234): stdout: | (launched: 2022-12-14_08:52:15.094882) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:52:16.659145 run osmo-stp_10.42.42.5(pid=30234): stderr: | 20221214085215263 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214085215263 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214085215263 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214085215264 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214085215264 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214085215264 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214085215265 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:52:16.803680 run osmo-stp_10.42.42.5(pid=30234): stdout: | (launched: 2022-12-14_08:52:15.094882) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:52:16.942647 run osmo-stp_10.42.42.5(pid=30234): stderr: | 20221214085215263 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214085215263 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214085215263 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214085215264 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214085215264 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214085215264 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214085215265 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:52:17.104934 run patchelf(pid=30237): Terminating (SIGINT) 08:52:17.289178 run patchelf(pid=30237): Terminated: ok {rc=0} 08:52:17.420595 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30234): Process ended prematurely: osmo-stp_10.42.42.5(pid=30234) [trial-2402↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30234)] [trial-2402↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8] 08:52:17.431411 tst iperf3m4.py:8: Test FAILED (10.5 sec) 08:52:17.460806 run osmo-hlr_10.42.42.2(pid=30231): ERR: Terminated: ERROR {rc=237} [trial-2402↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30231)] 08:52:17.511659 run osmo-hlr_10.42.42.2(pid=30231): stdout: | (launched: 2022-12-14_08:52:14.130581) 08:52:17.563951 run osmo-hlr_10.42.42.2(pid=30231): stderr: | 20221214085214302 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214085214302 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214085214302 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214085214302 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214085214302 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214085214302 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214085214316 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214085214326 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214085214326 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214085214326 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:52:17.616714 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30220): Terminating (SIGTERM) 08:52:17.658913 run iperf3-srv_10.42.42.10(pid=30221): Terminating (SIGTERM) 08:52:17.700643 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30222): Terminating (SIGTERM) 08:52:17.742321 run iperf3-srv_10.42.42.10(pid=30223): Terminating (SIGTERM) 08:52:17.783949 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30224): Terminating (SIGTERM) 08:52:17.826101 run iperf3-srv_10.42.42.10(pid=30225): Terminating (SIGTERM) 08:52:17.868060 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30226): Terminating (SIGTERM) 08:52:17.910305 run iperf3-srv_10.42.42.10(pid=30227): Terminating (SIGTERM) 08:52:17.951985 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30230): Terminating (SIGTERM) 08:52:17.994109 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30233): Terminating (SIGTERM) 08:52:18.035918 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30236): Terminating (SIGTERM) 08:52:18.078009 --- ParallelTerminationStrategy: PID 30220 died... 08:52:18.097749 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30220): Terminated: ok {rc=0} 08:52:18.144161 --- ParallelTerminationStrategy: PID 30221 died... 08:52:18.163668 run iperf3-srv_10.42.42.10(pid=30221): Terminated {rc=256} 08:52:18.210068 --- ParallelTerminationStrategy: PID 30222 died... 08:52:18.229761 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30222): Terminated: ok {rc=0} 08:52:18.275954 --- ParallelTerminationStrategy: PID 30223 died... 08:52:18.295749 run iperf3-srv_10.42.42.10(pid=30223): Terminated {rc=256} 08:52:18.341917 --- ParallelTerminationStrategy: PID 30224 died... 08:52:18.361761 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30224): Terminated: ok {rc=0} 08:52:18.407878 --- ParallelTerminationStrategy: PID 30225 died... 08:52:18.427624 run iperf3-srv_10.42.42.10(pid=30225): Terminated {rc=256} 08:52:18.473706 --- ParallelTerminationStrategy: PID 30226 died... 08:52:18.493450 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30226): Terminated: ok {rc=0} 08:52:18.539560 --- ParallelTerminationStrategy: PID 30227 died... 08:52:18.559097 run iperf3-srv_10.42.42.10(pid=30227): Terminated {rc=256} 08:52:18.605554 --- ParallelTerminationStrategy: PID 30230 died... 08:52:18.625295 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30230): Terminated: ok {rc=0} 08:52:18.671611 --- ParallelTerminationStrategy: PID 30233 died... 08:52:18.691295 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30233): Terminated: ok {rc=0} 08:52:18.737524 --- ParallelTerminationStrategy: PID 30236 died... 08:52:18.757247 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30236): Terminated: ok {rc=0} 08:52:18.845476 bus /gobi_4: Setting Powered False 08:52:19.943478 bus /gobi_4: Setting Powered False 08:52:21.057384 bus /gobi_1: Setting Powered False 08:52:22.155461 bus /gobi_1: Setting Powered False 08:52:23.269811 bus /gobi_0: Setting Powered False 08:52:24.367381 bus /gobi_0: Setting Powered False 08:52:25.482955 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2402 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping.py ---------------------------------------------- 08:52:26.584824 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:52:26.597424 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 08:52:26.651760 tst ping.py: using LAC 39788 08:52:26.776901 tst ping.py: using RAC 8 08:52:26.896685 tst ping.py: using CellId 39788 08:52:27.015659 tst ping.py: using BVCI 39789 08:52:27.126995 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:52:27.138592 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:52:27.150032 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:52:27.161414 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:52:27.173484 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:52:27.185623 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:52:27.197934 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:52:27.210542 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 08:52:27.328154 tst ping.py:19: start network... 08:52:27.528213 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:52:27.991965 run create_hlr_db(pid=30238): Launched 08:52:28.106563 bus /gobi_6: Setting Powered False 08:52:29.166339 run create_hlr_db(pid=30238): Terminated: ok {rc=0} 08:52:29.604536 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30240): Launched 08:52:29.925222 run osmo-hlr_10.42.42.2(pid=30241): Launched 08:52:30.046479 run osmo-stp_10.42.42.5: Starting osmo-stp 08:52:30.598097 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30243): Launched 08:52:30.945712 run osmo-stp_10.42.42.5(pid=30244): Launched 08:52:31.135877 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:52:31.795069 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30246): Launched 08:52:31.930031 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:52:32.205264 run patchelf(pid=30247): Launched 08:52:32.391549 run osmo-stp_10.42.42.5(pid=30244): ERR: Terminated: ERROR {rc=1} [trial-2402↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30244)] 08:52:32.527174 run osmo-stp_10.42.42.5(pid=30244): stdout: | (launched: 2022-12-14_08:52:30.861732) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:52:32.664751 run osmo-stp_10.42.42.5(pid=30244): stderr: | 20221214085231212 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214085231212 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214085231212 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214085231213 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214085231213 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214085231213 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214085231213 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:52:32.801796 run osmo-stp_10.42.42.5(pid=30244): stdout: | (launched: 2022-12-14_08:52:30.861732) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:52:32.933805 run osmo-stp_10.42.42.5(pid=30244): stderr: | 20221214085231212 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214085231212 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214085231212 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214085231213 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214085231213 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214085231213 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214085231213 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:52:33.089331 run patchelf(pid=30247): Terminating (SIGINT) 08:52:33.268823 run patchelf(pid=30247): Terminated: ok {rc=0} 08:52:33.398348 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=30244): Process ended prematurely: osmo-stp_10.42.42.5(pid=30244) [trial-2402↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30244)] [trial-2402↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22] 08:52:33.408136 tst ping.py:22: Test FAILED (6.8 sec) 08:52:33.436550 run osmo-hlr_10.42.42.2(pid=30241): ERR: Terminated: ERROR {rc=237} [trial-2402↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30241)] 08:52:33.486822 run osmo-hlr_10.42.42.2(pid=30241): stdout: | (launched: 2022-12-14_08:52:29.866165) 08:52:33.539548 run osmo-hlr_10.42.42.2(pid=30241): stderr: | 20221214085230063 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214085230063 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214085230063 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214085230063 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214085230063 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214085230063 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214085230079 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214085230087 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214085230087 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214085230087 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:52:33.592187 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30240): Terminating (SIGTERM) 08:52:33.634078 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30243): Terminating (SIGTERM) 08:52:33.676186 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30246): Terminating (SIGTERM) 08:52:33.718275 --- ParallelTerminationStrategy: PID 30240 died... 08:52:33.738463 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30240): Terminated: ok {rc=0} 08:52:33.784696 --- ParallelTerminationStrategy: PID 30243 died... 08:52:33.804423 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30243): Terminated: ok {rc=0} 08:52:33.851135 --- ParallelTerminationStrategy: PID 30246 died... 08:52:33.870879 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30246): Terminated: ok {rc=0} 08:52:33.959363 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2402 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping_idle_ping.py ---------------------------------------------- 08:52:35.046951 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:52:35.059774 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 08:52:35.115494 tst ping_idle_ping.py: using LAC 39789 08:52:35.242413 tst ping_idle_ping.py: using RAC 9 08:52:35.370218 tst ping_idle_ping.py: using CellId 39789 08:52:35.498308 tst ping_idle_ping.py: using BVCI 39790 08:52:35.615982 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:52:35.627933 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:52:35.639688 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:52:35.651343 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:52:35.662983 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:52:35.674711 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:52:35.686843 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:52:35.698589 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 08:52:35.814958 tst ping_idle_ping.py:24: start network... 08:52:36.017683 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:52:36.486921 run create_hlr_db(pid=30248): Launched 08:52:36.604828 bus /gobi_6: Setting Powered False 08:52:37.663829 run create_hlr_db(pid=30248): Terminated: ok {rc=0} 08:52:38.104820 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30250): Launched 08:52:38.426341 run osmo-hlr_10.42.42.2(pid=30251): Launched 08:52:38.550521 run osmo-stp_10.42.42.5: Starting osmo-stp 08:52:39.103405 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30253): Launched 08:52:39.426165 run osmo-stp_10.42.42.5(pid=30254): Launched 08:52:39.549691 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:52:40.104174 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30256): Launched 08:52:40.226588 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:52:40.497776 run patchelf(pid=30257): Launched 08:52:40.675575 run osmo-stp_10.42.42.5(pid=30254): ERR: Terminated: ERROR {rc=1} [trial-2402↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30254)] 08:52:40.811100 run osmo-stp_10.42.42.5(pid=30254): stdout: | (launched: 2022-12-14_08:52:39.366744) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:52:40.948345 run osmo-stp_10.42.42.5(pid=30254): stderr: | 20221214085239559 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214085239560 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214085239560 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214085239560 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214085239561 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214085239561 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214085239561 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:52:41.085451 run osmo-stp_10.42.42.5(pid=30254): stdout: | (launched: 2022-12-14_08:52:39.366744) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:52:41.216692 run osmo-stp_10.42.42.5(pid=30254): stderr: | 20221214085239559 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214085239560 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214085239560 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214085239560 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214085239561 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214085239561 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214085239561 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:52:41.372057 run patchelf(pid=30257): Terminating (SIGINT) 08:52:41.550815 run patchelf(pid=30257): Terminated: ok {rc=0} 08:52:41.679146 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=30254): Process ended prematurely: osmo-stp_10.42.42.5(pid=30254) [trial-2402↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30254)] [trial-2402↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27] 08:52:41.688840 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 08:52:41.716886 run osmo-hlr_10.42.42.2(pid=30251): ERR: Terminated: ERROR {rc=237} [trial-2402↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30251)] 08:52:41.766937 run osmo-hlr_10.42.42.2(pid=30251): stdout: | (launched: 2022-12-14_08:52:38.367186) 08:52:41.818893 run osmo-hlr_10.42.42.2(pid=30251): stderr: | 20221214085238565 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214085238565 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214085238565 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214085238565 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214085238565 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214085238565 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214085238581 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214085238589 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214085238590 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214085238590 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:52:41.871313 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30250): Terminating (SIGTERM) 08:52:41.913340 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30253): Terminating (SIGTERM) 08:52:41.955239 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30256): Terminating (SIGTERM) 08:52:41.997177 --- ParallelTerminationStrategy: PID 30250 died... 08:52:42.017230 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30250): Terminated: ok {rc=0} 08:52:42.063529 --- ParallelTerminationStrategy: PID 30253 died... 08:52:42.083279 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30253): Terminated: ok {rc=0} 08:52:42.129310 --- ParallelTerminationStrategy: PID 30256 died... 08:52:42.148704 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30256): Terminated: ok {rc=0} 08:52:42.235485 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2402 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 08:52:43.552446 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:52:43.559947 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 08:52:43.593596 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 08:52:43.630015 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 08:52:43.686999 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 08:52:43.721957 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 08:52:43.758286 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 08:52:44.310012 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2402 dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 08:52:44.315018 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 08:52:44.326683 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 08:52:44.399054 tst switch_tch_pdch.py: using LAC 39790 08:52:44.521575 tst switch_tch_pdch.py: using RAC 10 08:52:44.639557 tst switch_tch_pdch.py: using CellId 39790 08:52:44.755918 tst switch_tch_pdch.py: using BVCI 39791 08:52:44.865232 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 08:52:44.876522 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 08:52:44.887626 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 08:52:44.898651 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 08:52:44.910525 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 08:52:44.922374 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 08:52:44.934378 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 08:52:44.946336 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 08:52:45.068563 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 08:52:45.189043 tst switch_tch_pdch.py:51: start network... 08:52:45.405223 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:52:45.916910 run create_hlr_db(pid=30263): Launched 08:52:46.083450 bus /gobi_6: Setting Powered False 08:52:47.142948 run create_hlr_db(pid=30263): Terminated: ok {rc=0} 08:52:47.576603 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30265): Launched 08:52:47.878707 run osmo-hlr_10.42.42.2(pid=30266): Launched 08:52:47.994675 run osmo-stp_10.42.42.5: Starting osmo-stp 08:52:48.523810 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30268): Launched 08:52:48.825551 run osmo-stp_10.42.42.5(pid=30269): Launched 08:52:48.940514 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:52:49.459015 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30271): Launched 08:52:49.573284 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:52:49.826016 run patchelf(pid=30272): Launched 08:52:49.994100 run osmo-stp_10.42.42.5(pid=30269): ERR: Terminated: ERROR {rc=1} [trial-2402↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30269)] 08:52:50.121167 run osmo-stp_10.42.42.5(pid=30269): stdout: | (launched: 2022-12-14_08:52:48.769685) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:52:50.249750 run osmo-stp_10.42.42.5(pid=30269): stderr: | 20221214085248941 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214085248941 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214085248941 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214085248942 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214085248942 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214085248942 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214085248942 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:52:50.378250 run osmo-stp_10.42.42.5(pid=30269): stdout: | (launched: 2022-12-14_08:52:48.769685) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:52:50.500895 run osmo-stp_10.42.42.5(pid=30269): stderr: | 20221214085248941 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214085248941 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214085248941 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214085248942 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214085248942 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214085248942 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214085248942 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:52:50.646931 run patchelf(pid=30272): Terminating (SIGINT) 08:52:50.815125 run patchelf(pid=30272): Terminated: ok {rc=0} 08:52:50.935935 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=30269): Process ended prematurely: osmo-stp_10.42.42.5(pid=30269) [trial-2402↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30269)] [trial-2402↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 08:52:50.944843 tst switch_tch_pdch.py:54: Test FAILED (6.6 sec) 08:52:50.971456 run osmo-hlr_10.42.42.2(pid=30266): ERR: Terminated: ERROR {rc=237} [trial-2402↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30266)] 08:52:51.020051 run osmo-hlr_10.42.42.2(pid=30266): stdout: | (launched: 2022-12-14_08:52:47.822734) 08:52:51.069414 run osmo-hlr_10.42.42.2(pid=30266): stderr: | 20221214085247996 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214085247996 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214085247996 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214085247996 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214085247996 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214085247996 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214085248008 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214085248017 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214085248017 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214085248017 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:52:51.119006 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30265): Terminating (SIGTERM) 08:52:51.158995 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30268): Terminating (SIGTERM) 08:52:51.198820 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30271): Terminating (SIGTERM) 08:52:51.238914 --- ParallelTerminationStrategy: PID 30265 died... 08:52:51.258244 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30265): Terminated: ok {rc=0} 08:52:51.302358 --- ParallelTerminationStrategy: PID 30268 died... 08:52:51.321193 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30268): Terminated: ok {rc=0} 08:52:51.365012 --- ParallelTerminationStrategy: PID 30271 died... 08:52:51.383779 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30271): Terminated: ok {rc=0} 08:52:51.469657 bus /gobi_0: Setting Powered False 08:52:52.571432 bus /gobi_0: Setting Powered False 08:52:53.688099 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2402 dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 dynts:trx-b200+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 08:52:54.938976 tst dynts:trx-b200+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:52:54.944808 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 08:52:54.977543 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 08:52:55.012746 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 08:52:55.065212 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 08:52:55.098120 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 08:52:55.132595 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 08:52:55.686719 tst dynts:trx-b200+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2402 dynts:trx-b200+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 08:52:55.692125 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 08:52:55.703274 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 08:52:55.776306 tst switch_tch_pdch.py: using LAC 39791 08:52:55.892780 tst switch_tch_pdch.py: using RAC 11 08:52:56.008164 tst switch_tch_pdch.py: using CellId 39791 08:52:56.123123 tst switch_tch_pdch.py: using BVCI 39792 08:52:56.233757 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 08:52:56.244767 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 08:52:56.255690 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 08:52:56.266527 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 08:52:56.277770 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 08:52:56.288886 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 08:52:56.300272 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 08:52:56.311529 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 08:52:56.430503 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 08:52:56.547076 tst switch_tch_pdch.py:51: start network... 08:52:56.747273 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:52:57.185178 run create_hlr_db(pid=30277): Launched 08:52:57.299708 bus /gobi_6: Setting Powered False 08:52:58.359295 run create_hlr_db(pid=30277): Terminated: ok {rc=0} 08:52:58.769670 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30279): Launched 08:52:59.091584 run osmo-hlr_10.42.42.2(pid=30280): Launched 08:52:59.214790 run osmo-stp_10.42.42.5: Starting osmo-stp 08:52:59.739100 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30282): Launched 08:53:00.060728 run osmo-stp_10.42.42.5(pid=30283): Launched 08:53:00.183987 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:53:00.707893 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30285): Launched 08:53:00.831383 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:53:01.131802 run patchelf(pid=30286): Launched 08:53:01.335224 run osmo-stp_10.42.42.5(pid=30283): ERR: Terminated: ERROR {rc=1} [trial-2402↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30283)] 08:53:01.472524 run osmo-stp_10.42.42.5(pid=30283): stdout: | (launched: 2022-12-14_08:53:00.001834) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:53:01.612217 run osmo-stp_10.42.42.5(pid=30283): stderr: | 20221214085300194 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214085300194 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214085300195 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214085300195 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214085300196 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214085300196 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214085300196 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:53:01.751041 run osmo-stp_10.42.42.5(pid=30283): stdout: | (launched: 2022-12-14_08:53:00.001834) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:53:01.884820 run osmo-stp_10.42.42.5(pid=30283): stderr: | 20221214085300194 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214085300194 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214085300195 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214085300195 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214085300196 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214085300196 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214085300196 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:53:02.042727 run patchelf(pid=30286): Terminating (SIGINT) 08:53:02.223319 run patchelf(pid=30286): Terminated: ok {rc=0} 08:53:02.346652 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=30283): Process ended prematurely: osmo-stp_10.42.42.5(pid=30283) [trial-2402↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30283)] [trial-2402↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 08:53:02.355941 tst switch_tch_pdch.py:54: Test FAILED (6.7 sec) 08:53:02.383332 run osmo-hlr_10.42.42.2(pid=30280): ERR: Terminated: ERROR {rc=237} [trial-2402↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30280)] 08:53:02.432334 run osmo-hlr_10.42.42.2(pid=30280): stdout: | (launched: 2022-12-14_08:52:59.032288) 08:53:02.483621 run osmo-hlr_10.42.42.2(pid=30280): stderr: | 20221214085259230 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214085259230 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214085259230 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214085259230 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214085259230 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214085259230 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214085259242 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/dynts:trx-b200+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214085259250 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214085259250 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214085259250 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:53:02.534625 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30279): Terminating (SIGTERM) 08:53:02.575576 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30282): Terminating (SIGTERM) 08:53:02.616590 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30285): Terminating (SIGTERM) 08:53:02.658843 --- ParallelTerminationStrategy: PID 30279 died... 08:53:02.678777 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30279): Terminated: ok {rc=0} 08:53:02.724087 --- ParallelTerminationStrategy: PID 30282 died... 08:53:02.743935 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30282): Terminated: ok {rc=0} 08:53:02.788861 --- ParallelTerminationStrategy: PID 30285 died... 08:53:02.808864 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30285): Terminated: ok {rc=0} 08:53:02.895091 bus /gobi_0: Setting Powered False 08:53:03.992835 bus /gobi_0: Setting Powered False 08:53:05.110115 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2402 dynts:trx-b200+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 nitb_sms:trx-sysmocell5000 --------------------------------------------------------------------- 08:53:06.366467 tst nitb_sms:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:53:06.370545 tst nitb_sms:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 08:53:06.403654 tst nitb_sms:trx-sysmocell5000: Verifying 1 x ip_address (candidates: 9) 08:53:06.411234 tst nitb_sms:trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 08:53:06.461714 tst nitb_sms:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 08:53:06.496384 tst nitb_sms:trx-sysmocell5000: Reserving 1 x ip_address (candidates: 9) 08:53:06.503550 tst nitb_sms:trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 08:53:07.045976 tst nitb_sms:trx-sysmocell5000: RESERVED RESOURCES for nitb_sms: bts sysmoCell 5000 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2402 nitb_sms:trx-sysmocell5000 mo_mt_sms.py ---------------------------------------------- 08:53:07.052127 tst nitb_sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 1) 08:53:07.064027 tst nitb_sms:trx-sysmocell5000: Using 1 x bts (candidates: 1) 08:53:07.111878 tst mo_mt_sms.py: using LAC 39792 08:53:07.227686 tst mo_mt_sms.py: using RAC 12 08:53:07.343960 tst mo_mt_sms.py: using CellId 39792 08:53:07.460150 tst mo_mt_sms.py: using BVCI 39793 08:53:07.569495 tst nitb_sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 08:53:07.687476 tst nitb_sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 08:53:07.805098 tst mo_mt_sms.py:9: start nitb and bts... 08:53:08.020720 run osmo-nitb_10.42.42.2: Starting osmo-nitb 08:53:08.671759 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=30290): Launched 08:53:08.971967 run osmo-nitb_10.42.42.2(pid=30291): Launched 08:53:09.137879 run osmo-nitb_10.42.42.2(pid=30291): ERR: Terminated: ERROR {rc=2} [trial-2402↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=30291)] 08:53:09.272218 run osmo-nitb_10.42.42.2(pid=30291): stdout: | (launched: 2022-12-14_08:53:08.916484) 08:53:09.407460 run osmo-nitb_10.42.42.2(pid=30291): stderr: | (launched: 2022-12-14_08:53:08.960892) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 08:53:09.543059 run osmo-nitb_10.42.42.2(pid=30291): stdout: | (launched: 2022-12-14_08:53:08.916484) 08:53:09.673401 run osmo-nitb_10.42.42.2(pid=30291): stderr: | (launched: 2022-12-14_08:53:08.960892) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fe4ae4b0268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=30291): Process ended prematurely: osmo-nitb_10.42.42.2(pid=30291) [trial-2402↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=30291)] 08:53:10.084841 tst osmo-nitb_10.42.42.2(pid=30291): stdout: | (launched: 2022-12-14_08:53:08.916484) 08:53:10.205231 tst osmo-nitb_10.42.42.2(pid=30291): stderr: | (launched: 2022-12-14_08:53:08.960892) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 08:53:10.347495 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=30291): Process ended prematurely: osmo-nitb_10.42.42.2(pid=30291) [trial-2402↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=30291)] [trial-2402↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11] 08:53:10.356079 tst mo_mt_sms.py:11: Test FAILED (3.3 sec) 08:53:10.362716 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=30290): Terminating (SIGTERM) 08:53:10.572449 --- ParallelTerminationStrategy: PID 30290 died... 08:53:10.592796 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=30290): Terminated: ok {rc=0} 08:53:10.677992 bus /sierra_3: Setting Powered False 08:53:11.777472 bus /sierra_3: Setting Powered False 08:53:12.895076 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2402 nitb_sms:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 sms:trx-sysmocell5000 --------------------------------------------------------------------- 08:53:14.092891 tst sms:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:53:14.096856 tst sms:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 08:53:14.130228 tst sms:trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 08:53:14.157333 tst sms:trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 08:53:14.208134 tst sms:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 08:53:14.241706 tst sms:trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 08:53:14.268331 tst sms:trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 08:53:14.815264 tst sms:trx-sysmocell5000: RESERVED RESOURCES for sms: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2402 sms:trx-sysmocell5000 mo_mt_sms.py ---------------------------------------------- 08:53:14.820388 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 08:53:14.831402 tst sms:trx-sysmocell5000: Using 1 x bts (candidates: 1) 08:53:14.880219 tst mo_mt_sms.py: using LAC 39793 08:53:15.002710 tst mo_mt_sms.py: using RAC 13 08:53:15.121661 tst mo_mt_sms.py: using CellId 39793 08:53:15.246782 tst mo_mt_sms.py: using BVCI 39794 08:53:15.365164 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 08:53:15.376390 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 08:53:15.387503 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 08:53:15.398710 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 08:53:15.409900 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 08:53:15.420703 tst sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 08:53:15.540143 tst sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 08:53:15.655787 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:53:16.172621 run create_hlr_db(pid=30295): Launched 08:53:16.370953 bus /sierra_2: Setting Powered False 08:53:17.429242 run create_hlr_db(pid=30295): Terminated: ok {rc=0} 08:53:17.872926 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30297): Launched 08:53:18.192057 run osmo-hlr_10.42.42.2(pid=30298): Launched 08:53:18.314297 run osmo-stp_10.42.42.5: Starting osmo-stp 08:53:18.863331 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30300): Launched 08:53:19.184166 run osmo-stp_10.42.42.5(pid=30301): Launched 08:53:19.306432 run osmo-msc_10.42.42.6: Starting osmo-msc 08:53:19.885036 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30303): Launched 08:53:20.207383 run osmo-msc_10.42.42.6(pid=30304): Launched 08:53:20.385438 run osmo-stp_10.42.42.5(pid=30301): ERR: Terminated: ERROR {rc=1} [trial-2402↪sms:trx-sysmocell5000↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30301)] 08:53:20.519636 run osmo-stp_10.42.42.5(pid=30301): stdout: | (launched: 2022-12-14_08:53:19.125133) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:53:20.654799 run osmo-stp_10.42.42.5(pid=30301): stderr: | 20221214085319319 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214085319319 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214085319319 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214085319320 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214085319320 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214085319320 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214085319320 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:53:20.789480 run osmo-stp_10.42.42.5(pid=30301): stdout: | (launched: 2022-12-14_08:53:19.125133) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:53:20.916521 run osmo-stp_10.42.42.5(pid=30301): stderr: | 20221214085319319 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214085319319 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214085319319 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214085319320 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214085319320 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214085319320 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214085319320 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:53:21.068178 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=30301): Process ended prematurely: osmo-stp_10.42.42.5(pid=30301) [trial-2402↪sms:trx-sysmocell5000↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30301)] [trial-2402↪sms:trx-sysmocell5000↪mo_mt_sms.py:16] 08:53:21.077121 tst mo_mt_sms.py:16: Test FAILED (6.2 sec) 08:53:21.104289 run osmo-hlr_10.42.42.2(pid=30298): ERR: Terminated: ERROR {rc=237} [trial-2402↪sms:trx-sysmocell5000↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30298)] 08:53:21.154581 run osmo-hlr_10.42.42.2(pid=30298): stdout: | (launched: 2022-12-14_08:53:18.133374) 08:53:21.206761 run osmo-hlr_10.42.42.2(pid=30298): stderr: | 20221214085318331 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214085318331 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214085318331 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214085318331 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214085318331 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214085318331 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214085318344 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/sms:trx-sysmocell5000/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214085318354 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214085318354 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214085318354 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:53:21.279462 run osmo-msc_10.42.42.6(pid=30304): ERR: Terminated: ERROR {rc=2} [trial-2402↪sms:trx-sysmocell5000↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30304)] 08:53:21.329689 run osmo-msc_10.42.42.6(pid=30304): stdout: | (launched: 2022-12-14_08:53:20.148188) 08:53:21.381660 run osmo-msc_10.42.42.6(pid=30304): stderr: | 20221214085320470 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214085320470 DLGLOBAL DEBUG validating counter group 0x7f32c7cc4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214085320470 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214085320470 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214085320471 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214085320472 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214085320473 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214085320474 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214085320474 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214085320474 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:53:21.434152 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30297): Terminating (SIGTERM) 08:53:21.476146 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30300): Terminating (SIGTERM) 08:53:21.518102 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30303): Terminating (SIGTERM) 08:53:21.560074 --- ParallelTerminationStrategy: PID 30297 died... 08:53:21.580198 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30297): Terminated: ok {rc=0} 08:53:21.626389 --- ParallelTerminationStrategy: PID 30300 died... 08:53:21.646183 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30300): Terminated: ok {rc=0} 08:53:21.692467 --- ParallelTerminationStrategy: PID 30303 died... 08:53:21.712036 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30303): Terminated: ok {rc=0} 08:53:21.799626 bus /sierra_3: Setting Powered False 08:53:22.898554 bus /sierra_3: Setting Powered False 08:53:24.015595 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2402 sms:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 nitb_ussd:trx-sysmocell5000 --------------------------------------------------------------------- 08:53:25.249853 tst nitb_ussd:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:53:25.254613 tst nitb_ussd:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 08:53:25.288269 tst nitb_ussd:trx-sysmocell5000: Verifying 1 x ip_address (candidates: 9) 08:53:25.295861 tst nitb_ussd:trx-sysmocell5000: Verifying 1 x modem (candidates: 12) 08:53:25.329054 tst nitb_ussd:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 08:53:25.362926 tst nitb_ussd:trx-sysmocell5000: Reserving 1 x ip_address (candidates: 9) 08:53:25.369678 tst nitb_ussd:trx-sysmocell5000: Reserving 1 x modem (candidates: 12) 08:53:25.890995 tst nitb_ussd:trx-sysmocell5000: RESERVED RESOURCES for nitb_ussd: bts sysmoCell 5000 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2402 nitb_ussd:trx-sysmocell5000 assert_extension.py ---------------------------------------------- 08:53:25.896096 tst nitb_ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 1) 08:53:25.907197 tst nitb_ussd:trx-sysmocell5000: Using 1 x bts (candidates: 1) 08:53:25.956578 tst assert_extension.py: using LAC 39794 08:53:26.073298 tst assert_extension.py: using RAC 14 08:53:26.189652 tst assert_extension.py: using CellId 39794 08:53:26.317643 tst assert_extension.py: using BVCI 39795 08:53:26.433962 tst nitb_ussd:trx-sysmocell5000: Using 1 x modem (candidates: 1) 08:53:26.549929 tst assert_extension.py:10: start nitb and bts... 08:53:26.749640 run osmo-nitb_10.42.42.2: Starting osmo-nitb 08:53:27.362518 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=30309): Launched 08:53:27.665128 run osmo-nitb_10.42.42.2(pid=30310): Launched 08:53:27.831891 run osmo-nitb_10.42.42.2(pid=30310): ERR: Terminated: ERROR {rc=2} [trial-2402↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=30310)] 08:53:27.967159 run osmo-nitb_10.42.42.2(pid=30310): stdout: | (launched: 2022-12-14_08:53:27.609371) 08:53:28.103300 run osmo-nitb_10.42.42.2(pid=30310): stderr: | (launched: 2022-12-14_08:53:27.653790) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 08:53:28.239155 run osmo-nitb_10.42.42.2(pid=30310): stdout: | (launched: 2022-12-14_08:53:27.609371) 08:53:28.370394 run osmo-nitb_10.42.42.2(pid=30310): stderr: | (launched: 2022-12-14_08:53:27.653790) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fe4ae4b0268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=30310): Process ended prematurely: osmo-nitb_10.42.42.2(pid=30310) [trial-2402↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=30310)] 08:53:28.779545 tst osmo-nitb_10.42.42.2(pid=30310): stdout: | (launched: 2022-12-14_08:53:27.609371) 08:53:28.901199 tst osmo-nitb_10.42.42.2(pid=30310): stderr: | (launched: 2022-12-14_08:53:27.653790) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 08:53:29.043354 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=30310): Process ended prematurely: osmo-nitb_10.42.42.2(pid=30310) [trial-2402↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=30310)] [trial-2402↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12] 08:53:29.051894 tst assert_extension.py:12: Test FAILED (3.1 sec) 08:53:29.058573 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=30309): Terminating (SIGTERM) 08:53:29.268316 --- ParallelTerminationStrategy: PID 30309 died... 08:53:29.289238 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=30309): Terminated: ok {rc=0} 08:53:29.376718 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2402 nitb_ussd:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 ussd:trx-sysmocell5000 --------------------------------------------------------------------- 08:53:30.552864 tst ussd:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:53:30.556842 tst ussd:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 08:53:30.590014 tst ussd:trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 08:53:30.618006 tst ussd:trx-sysmocell5000: Verifying 1 x modem (candidates: 12) 08:53:30.653041 tst ussd:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 08:53:30.686846 tst ussd:trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 08:53:30.713582 tst ussd:trx-sysmocell5000: Reserving 1 x modem (candidates: 12) 08:53:31.265788 tst ussd:trx-sysmocell5000: RESERVED RESOURCES for ussd: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2402 ussd:trx-sysmocell5000 assert_extension.py ---------------------------------------------- 08:53:31.274259 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 08:53:31.287980 tst ussd:trx-sysmocell5000: Using 1 x bts (candidates: 1) 08:53:31.352334 tst assert_extension.py: using LAC 39795 08:53:31.503808 tst assert_extension.py: using RAC 15 08:53:31.627239 tst assert_extension.py: using CellId 39795 08:53:31.786296 tst assert_extension.py: using BVCI 39796 08:53:31.907041 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 08:53:31.919430 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 08:53:31.931843 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 08:53:31.943954 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 08:53:31.957655 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 08:53:31.970637 tst ussd:trx-sysmocell5000: Using 1 x modem (candidates: 1) 08:53:32.095466 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:53:32.594130 run create_hlr_db(pid=30314): Launched 08:53:32.710887 bus /sierra_2: Setting Powered False 08:53:33.770590 run create_hlr_db(pid=30314): Terminated: ok {rc=0} 08:53:34.209125 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30316): Launched 08:53:34.529009 run osmo-hlr_10.42.42.2(pid=30317): Launched 08:53:34.650684 run osmo-stp_10.42.42.5: Starting osmo-stp 08:53:35.297836 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30319): Launched 08:53:35.614333 run osmo-stp_10.42.42.5(pid=30320): Launched 08:53:35.734190 run osmo-msc_10.42.42.6: Starting osmo-msc 08:53:36.304405 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30322): Launched 08:53:36.619018 run osmo-msc_10.42.42.6(pid=30323): Launched 08:53:36.795745 run osmo-stp_10.42.42.5(pid=30320): ERR: Terminated: ERROR {rc=1} [trial-2402↪ussd:trx-sysmocell5000↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30320)] 08:53:36.929212 run osmo-stp_10.42.42.5(pid=30320): stdout: | (launched: 2022-12-14_08:53:35.555573) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:53:37.062633 run osmo-stp_10.42.42.5(pid=30320): stderr: | 20221214085335748 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214085335748 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214085335748 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214085335748 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214085335749 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214085335749 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214085335749 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:53:37.195112 run osmo-stp_10.42.42.5(pid=30320): stdout: | (launched: 2022-12-14_08:53:35.555573) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:53:37.320315 run osmo-stp_10.42.42.5(pid=30320): stderr: | 20221214085335748 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214085335748 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214085335748 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214085335748 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214085335749 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214085335749 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214085335749 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:53:37.469715 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=30320): Process ended prematurely: osmo-stp_10.42.42.5(pid=30320) [trial-2402↪ussd:trx-sysmocell5000↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30320)] [trial-2402↪ussd:trx-sysmocell5000↪assert_extension.py:17] 08:53:37.478672 tst assert_extension.py:17: Test FAILED (6.2 sec) 08:53:37.506090 run osmo-hlr_10.42.42.2(pid=30317): ERR: Terminated: ERROR {rc=237} [trial-2402↪ussd:trx-sysmocell5000↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30317)] 08:53:37.556545 run osmo-hlr_10.42.42.2(pid=30317): stdout: | (launched: 2022-12-14_08:53:34.469723) 08:53:37.608415 run osmo-hlr_10.42.42.2(pid=30317): stderr: | 20221214085334668 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214085334668 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214085334668 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214085334668 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214085334668 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214085334668 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214085334681 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/ussd:trx-sysmocell5000/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214085334689 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214085334690 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214085334690 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:53:37.681044 run osmo-msc_10.42.42.6(pid=30323): ERR: Terminated: ERROR {rc=2} [trial-2402↪ussd:trx-sysmocell5000↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30323)] 08:53:37.731374 run osmo-msc_10.42.42.6(pid=30323): stdout: | (launched: 2022-12-14_08:53:36.561274) 08:53:37.783264 run osmo-msc_10.42.42.6(pid=30323): stderr: | 20221214085336882 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214085336883 DLGLOBAL DEBUG validating counter group 0x7f23ad16bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214085336883 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214085336883 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214085336883 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214085336883 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214085336885 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214085336885 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214085336885 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214085336885 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:53:37.835972 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30316): Terminating (SIGTERM) 08:53:37.878144 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30319): Terminating (SIGTERM) 08:53:37.920249 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30322): Terminating (SIGTERM) 08:53:37.962556 --- ParallelTerminationStrategy: PID 30316 died... 08:53:37.982900 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30316): Terminated: ok {rc=0} 08:53:38.029330 --- ParallelTerminationStrategy: PID 30319 died... 08:53:38.048859 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30319): Terminated: ok {rc=0} 08:53:38.095176 --- ParallelTerminationStrategy: PID 30322 died... 08:53:38.114768 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30322): Terminated: ok {rc=0} 08:53:38.202964 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2402 ussd:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 08:53:39.416544 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:53:39.424041 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 08:53:39.458587 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 08:53:39.487424 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 08:53:39.539997 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 08:53:39.574080 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 08:53:39.601020 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 08:53:40.154911 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2402 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 08:53:40.206863 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:53:40.218757 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 08:53:40.290364 tst mo_mt_call.py: using LAC 39796 08:53:40.418343 tst mo_mt_call.py: using RAC 16 08:53:40.544736 tst mo_mt_call.py: using CellId 39796 08:53:40.670310 tst mo_mt_call.py: using BVCI 39797 08:53:40.786996 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:53:40.798676 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:53:40.810169 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:53:40.821737 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:53:40.833306 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:53:40.844754 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 08:53:40.960322 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 08:53:41.075730 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:53:41.545303 run create_hlr_db(pid=30330): Launched 08:53:41.661384 bus /sierra_2: Setting Powered False 08:53:42.721539 run create_hlr_db(pid=30330): Terminated: ok {rc=0} 08:53:43.160859 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30332): Launched 08:53:43.482610 run osmo-hlr_10.42.42.2(pid=30333): Launched 08:53:43.605715 run osmo-stp_10.42.42.5: Starting osmo-stp 08:53:44.162822 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30335): Launched 08:53:44.485582 run osmo-stp_10.42.42.5(pid=30336): Launched 08:53:44.609765 run osmo-msc_10.42.42.6: Starting osmo-msc 08:53:45.192777 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30338): Launched 08:53:45.515853 run osmo-msc_10.42.42.6(pid=30339): Launched 08:53:45.696745 run osmo-stp_10.42.42.5(pid=30336): ERR: Terminated: ERROR {rc=1} [trial-2402↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30336)] 08:53:45.831947 run osmo-stp_10.42.42.5(pid=30336): stdout: | (launched: 2022-12-14_08:53:44.426552) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:53:46.066758 run osmo-stp_10.42.42.5(pid=30336): stderr: | 20221214085344619 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214085344619 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214085344619 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214085344620 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214085344620 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214085344620 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214085344620 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:53:46.231350 run osmo-stp_10.42.42.5(pid=30336): stdout: | (launched: 2022-12-14_08:53:44.426552) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:53:46.358091 run osmo-stp_10.42.42.5(pid=30336): stderr: | 20221214085344619 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214085344619 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214085344619 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214085344620 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214085344620 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214085344620 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214085344620 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:53:46.507715 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30336): Process ended prematurely: osmo-stp_10.42.42.5(pid=30336) [trial-2402↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30336)] [trial-2402↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 08:53:46.517850 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 08:53:46.545949 run osmo-hlr_10.42.42.2(pid=30333): ERR: Terminated: ERROR {rc=237} [trial-2402↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30333)] 08:53:46.600178 run osmo-hlr_10.42.42.2(pid=30333): stdout: | (launched: 2022-12-14_08:53:43.423665) 08:53:46.653570 run osmo-hlr_10.42.42.2(pid=30333): stderr: | 20221214085343620 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214085343620 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214085343620 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214085343620 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214085343620 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214085343620 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214085343633 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214085343641 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214085343641 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214085343641 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:53:46.728021 run osmo-msc_10.42.42.6(pid=30339): ERR: Terminated: ERROR {rc=2} [trial-2402↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30339)] 08:53:46.777873 run osmo-msc_10.42.42.6(pid=30339): stdout: | (launched: 2022-12-14_08:53:45.456543) 08:53:46.831801 run osmo-msc_10.42.42.6(pid=30339): stderr: | 20221214085345778 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214085345778 DLGLOBAL DEBUG validating counter group 0x7fa73a7b4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214085345779 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214085345779 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214085345779 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214085345779 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214085345781 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214085345781 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214085345781 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214085345781 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:53:46.887368 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30332): Terminating (SIGTERM) 08:53:46.929800 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30335): Terminating (SIGTERM) 08:53:46.975939 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30338): Terminating (SIGTERM) 08:53:47.021338 --- ParallelTerminationStrategy: PID 30332 died... 08:53:47.042918 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30332): Terminated: ok {rc=0} 08:53:47.092364 --- ParallelTerminationStrategy: PID 30335 died... 08:53:47.113489 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30335): Terminated: ok {rc=0} 08:53:47.160449 --- ParallelTerminationStrategy: PID 30338 died... 08:53:47.181970 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30338): Terminated: ok {rc=0} 08:53:47.274412 bus /sierra_3: Setting Powered False 08:53:48.372522 bus /sierra_3: Setting Powered False 08:53:49.488156 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2402 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 08:53:50.634204 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:53:50.646550 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 08:53:50.718470 tst mo_mt_call_osmux.py: using LAC 39797 08:53:50.844330 tst mo_mt_call_osmux.py: using RAC 17 08:53:50.968902 tst mo_mt_call_osmux.py: using CellId 39797 08:53:51.093100 tst mo_mt_call_osmux.py: using BVCI 39798 08:53:51.207408 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:53:51.219051 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:53:51.230510 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:53:51.241961 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:53:51.253536 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:53:51.264909 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 08:53:51.381368 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 08:53:51.499652 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:53:51.989998 run create_hlr_db(pid=30341): Launched 08:53:52.117798 bus /sierra_2: Setting Powered False 08:53:53.180416 run create_hlr_db(pid=30341): Terminated: ok {rc=0} 08:53:53.601874 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30343): Launched 08:53:53.896069 run osmo-hlr_10.42.42.2(pid=30344): Launched 08:53:54.008460 run osmo-stp_10.42.42.5: Starting osmo-stp 08:53:54.529619 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30346): Launched 08:53:54.824028 run osmo-stp_10.42.42.5(pid=30347): Launched 08:53:54.936798 run osmo-msc_10.42.42.6: Starting osmo-msc 08:53:55.469528 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30349): Launched 08:53:55.785381 run osmo-msc_10.42.42.6(pid=30350): Launched 08:53:55.962893 run osmo-stp_10.42.42.5(pid=30347): ERR: Terminated: ERROR {rc=1} [trial-2402↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30347)] 08:53:56.095827 run osmo-stp_10.42.42.5(pid=30347): stdout: | (launched: 2022-12-14_08:53:54.769684) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:53:56.229133 run osmo-stp_10.42.42.5(pid=30347): stderr: | 20221214085354936 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214085354936 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214085354937 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214085354937 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214085354938 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214085354938 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214085354938 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:53:56.361625 run osmo-stp_10.42.42.5(pid=30347): stdout: | (launched: 2022-12-14_08:53:54.769684) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:53:56.486859 run osmo-stp_10.42.42.5(pid=30347): stderr: | 20221214085354936 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214085354936 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214085354937 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214085354937 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214085354938 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214085354938 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214085354938 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:53:56.636842 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30347): Process ended prematurely: osmo-stp_10.42.42.5(pid=30347) [trial-2402↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30347)] [trial-2402↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 08:53:56.646626 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 08:53:56.674033 run osmo-hlr_10.42.42.2(pid=30344): ERR: Terminated: ERROR {rc=237} [trial-2402↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30344)] 08:53:56.723782 run osmo-hlr_10.42.42.2(pid=30344): stdout: | (launched: 2022-12-14_08:53:53.841873) 08:53:56.775106 run osmo-hlr_10.42.42.2(pid=30344): stderr: | 20221214085354014 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214085354014 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214085354014 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214085354014 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214085354014 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214085354015 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214085354029 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214085354038 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214085354038 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214085354039 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:53:56.846471 run osmo-msc_10.42.42.6(pid=30350): ERR: Terminated: ERROR {rc=2} [trial-2402↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30350)] 08:53:56.895942 run osmo-msc_10.42.42.6(pid=30350): stdout: | (launched: 2022-12-14_08:53:55.727627) 08:53:56.946864 run osmo-msc_10.42.42.6(pid=30350): stderr: | 20221214085356047 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214085356047 DLGLOBAL DEBUG validating counter group 0x7f89d5df3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214085356047 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214085356047 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214085356048 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214085356048 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214085356049 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214085356050 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214085356050 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214085356050 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:53:56.998149 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30343): Terminating (SIGTERM) 08:53:57.039229 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30346): Terminating (SIGTERM) 08:53:57.080366 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30349): Terminating (SIGTERM) 08:53:57.122160 --- ParallelTerminationStrategy: PID 30343 died... 08:53:57.141785 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30343): Terminated: ok {rc=0} 08:53:57.187477 --- ParallelTerminationStrategy: PID 30346 died... 08:53:57.206830 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30346): Terminated: ok {rc=0} 08:53:57.252100 --- ParallelTerminationStrategy: PID 30349 died... 08:53:57.271488 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30349): Terminated: ok {rc=0} 08:53:57.358123 bus /sierra_3: Setting Powered False 08:53:58.454435 bus /sierra_3: Setting Powered False 08:53:59.567336 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2402 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 08:54:00.810228 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:54:00.818546 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 08:54:00.861504 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 08:54:00.896081 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 08:54:00.969493 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 08:54:01.021634 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 08:54:01.058293 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 08:54:01.585106 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2402 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 08:54:01.658178 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:54:01.672652 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 08:54:01.776603 tst mo_mt_call.py: using LAC 39798 08:54:01.936421 tst mo_mt_call.py: using RAC 18 08:54:02.080594 tst mo_mt_call.py: using CellId 39798 08:54:02.270526 tst mo_mt_call.py: using BVCI 39799 08:54:02.447187 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:54:02.461531 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:54:02.476171 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:54:02.488870 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:54:02.504464 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:54:02.516699 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 08:54:02.663076 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 08:54:02.816875 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:54:03.378686 run create_hlr_db(pid=30455): Launched 08:54:03.575206 bus /sierra_2: Setting Powered False 08:54:04.639641 run create_hlr_db(pid=30455): Terminated: ok {rc=0} 08:54:05.120387 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30628): Launched 08:54:05.457744 run osmo-hlr_10.42.42.2(pid=30629): Launched 08:54:05.706745 run osmo-stp_10.42.42.5: Starting osmo-stp 08:54:06.369775 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30632): Launched 08:54:06.682713 run osmo-stp_10.42.42.5(pid=30634): Launched 08:54:06.929644 run osmo-msc_10.42.42.6: Starting osmo-msc 08:54:07.599955 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30636): Launched 08:54:07.942575 run osmo-msc_10.42.42.6(pid=30637): Launched 08:54:08.309219 run osmo-stp_10.42.42.5(pid=30634): ERR: Terminated: ERROR {rc=1} [trial-2402↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30634)] 08:54:08.583852 run osmo-stp_10.42.42.5(pid=30634): stdout: | (launched: 2022-12-14_08:54:06.627554) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:54:08.764149 run osmo-stp_10.42.42.5(pid=30634): stderr: | 20221214085406915 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214085406915 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214085406915 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214085406915 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214085406916 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214085406916 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214085406916 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:54:08.902310 run osmo-stp_10.42.42.5(pid=30634): stdout: | (launched: 2022-12-14_08:54:06.627554) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:54:09.034326 run osmo-stp_10.42.42.5(pid=30634): stderr: | 20221214085406915 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214085406915 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214085406915 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214085406915 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214085406916 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214085406916 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214085406916 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:54:09.191841 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30634): Process ended prematurely: osmo-stp_10.42.42.5(pid=30634) [trial-2402↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30634)] [trial-2402↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 08:54:09.202657 tst mo_mt_call.py:8: Test FAILED (7.6 sec) 08:54:09.232414 run osmo-hlr_10.42.42.2(pid=30629): ERR: Terminated: ERROR {rc=237} [trial-2402↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30629)] 08:54:09.285088 run osmo-hlr_10.42.42.2(pid=30629): stdout: | (launched: 2022-12-14_08:54:05.398537) 08:54:09.338283 run osmo-hlr_10.42.42.2(pid=30629): stderr: | 20221214085405697 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214085405697 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214085405697 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214085405697 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214085405697 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214085405697 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214085405717 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214085405725 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214085405725 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214085405725 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:54:09.413598 run osmo-msc_10.42.42.6(pid=30637): ERR: Terminated: ERROR {rc=2} [trial-2402↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30637)] 08:54:09.466399 run osmo-msc_10.42.42.6(pid=30637): stdout: | (launched: 2022-12-14_08:54:07.879939) 08:54:09.520688 run osmo-msc_10.42.42.6(pid=30637): stderr: | 20221214085408382 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214085408382 DLGLOBAL DEBUG validating counter group 0x7fedaa8b3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214085408382 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214085408382 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214085408383 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214085408383 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214085408384 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214085408389 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214085408389 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214085408389 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:54:09.574798 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30628): Terminating (SIGTERM) 08:54:09.618123 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30632): Terminating (SIGTERM) 08:54:09.663129 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30636): Terminating (SIGTERM) 08:54:09.709488 --- ParallelTerminationStrategy: PID 30628 died... 08:54:09.730715 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30628): Terminated: ok {rc=0} 08:54:09.779655 --- ParallelTerminationStrategy: PID 30632 died... 08:54:09.800146 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30632): Terminated: ok {rc=0} 08:54:09.846942 --- ParallelTerminationStrategy: PID 30636 died... 08:54:09.867357 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30636): Terminated: ok {rc=0} 08:54:09.958621 bus /sierra_3: Setting Powered False 08:54:11.062773 bus /sierra_3: Setting Powered False 08:54:12.182182 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2402 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 08:54:13.338751 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:54:13.352381 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 08:54:13.440338 tst mo_mt_call_osmux.py: using LAC 39799 08:54:13.573416 tst mo_mt_call_osmux.py: using RAC 19 08:54:13.703303 tst mo_mt_call_osmux.py: using CellId 39799 08:54:13.830474 tst mo_mt_call_osmux.py: using BVCI 39800 08:54:13.952186 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:54:13.965085 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:54:13.977765 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:54:13.990338 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:54:14.003837 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:54:14.016708 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 08:54:14.142542 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 08:54:14.268637 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:54:14.781916 run create_hlr_db(pid=30639): Launched 08:54:14.949895 bus /sierra_2: Setting Powered False 08:54:16.044450 run create_hlr_db(pid=30639): Terminated: ok {rc=0} 08:54:16.641734 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30641): Launched 08:54:17.008183 run osmo-hlr_10.42.42.2(pid=30642): Launched 08:54:17.149299 run osmo-stp_10.42.42.5: Starting osmo-stp 08:54:17.903132 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30644): Launched 08:54:18.228204 run osmo-stp_10.42.42.5(pid=30645): Launched 08:54:18.470962 run osmo-msc_10.42.42.6: Starting osmo-msc 08:54:19.176856 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30647): Launched 08:54:19.524318 run osmo-msc_10.42.42.6(pid=30648): Launched 08:54:19.883054 run osmo-stp_10.42.42.5(pid=30645): ERR: Terminated: ERROR {rc=1} [trial-2402↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30645)] 08:54:20.183719 run osmo-stp_10.42.42.5(pid=30645): stdout: | (launched: 2022-12-14_08:54:18.166963) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:54:20.350908 run osmo-stp_10.42.42.5(pid=30645): stderr: | 20221214085418495 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214085418495 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214085418496 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214085418496 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214085418505 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214085418505 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214085418505 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:54:20.489913 run osmo-stp_10.42.42.5(pid=30645): stdout: | (launched: 2022-12-14_08:54:18.166963) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:54:20.621818 run osmo-stp_10.42.42.5(pid=30645): stderr: | 20221214085418495 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214085418495 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214085418496 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214085418496 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214085418505 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214085418505 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214085418505 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:54:20.780367 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30645): Process ended prematurely: osmo-stp_10.42.42.5(pid=30645) [trial-2402↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30645)] [trial-2402↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 08:54:20.791499 tst mo_mt_call_osmux.py:8: Test FAILED (7.5 sec) 08:54:20.820596 run osmo-hlr_10.42.42.2(pid=30642): ERR: Terminated: ERROR {rc=237} [trial-2402↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30642)] 08:54:20.873161 run osmo-hlr_10.42.42.2(pid=30642): stdout: | (launched: 2022-12-14_08:54:16.951142) 08:54:20.928478 run osmo-hlr_10.42.42.2(pid=30642): stderr: | 20221214085417312 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214085417312 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214085417312 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214085417312 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214085417312 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214085417312 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214085417330 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214085417338 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214085417339 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214085417339 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:54:21.003848 run osmo-msc_10.42.42.6(pid=30648): ERR: Terminated: ERROR {rc=2} [trial-2402↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30648)] 08:54:21.055541 run osmo-msc_10.42.42.6(pid=30648): stdout: | (launched: 2022-12-14_08:54:19.461669) 08:54:21.109567 run osmo-msc_10.42.42.6(pid=30648): stderr: | 20221214085419960 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214085419960 DLGLOBAL DEBUG validating counter group 0x7f6fd3f39c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214085419960 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214085419960 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214085419960 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214085419965 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214085419967 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214085419967 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214085419967 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214085419967 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:54:21.164537 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30641): Terminating (SIGTERM) 08:54:21.208658 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30644): Terminating (SIGTERM) 08:54:21.255008 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30647): Terminating (SIGTERM) 08:54:21.301286 --- ParallelTerminationStrategy: PID 30641 died... 08:54:21.322281 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30641): Terminated: ok {rc=0} 08:54:21.370204 --- ParallelTerminationStrategy: PID 30644 died... 08:54:21.390832 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30644): Terminated: ok {rc=0} 08:54:21.438856 --- ParallelTerminationStrategy: PID 30647 died... 08:54:21.459685 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30647): Terminated: ok {rc=0} 08:54:21.552511 bus /sierra_3: Setting Powered False 08:54:22.656490 bus /sierra_3: Setting Powered False 08:54:23.781358 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2402 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 08:54:25.044693 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:54:25.052710 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 08:54:25.089619 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 08:54:25.118389 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 08:54:25.171403 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 08:54:25.207937 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 08:54:25.238116 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 08:54:25.789625 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2402 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 08:54:25.845506 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:54:25.858646 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 08:54:25.933714 tst mo_mt_call.py: using LAC 39800 08:54:26.064667 tst mo_mt_call.py: using RAC 20 08:54:26.189421 tst mo_mt_call.py: using CellId 39800 08:54:26.306791 tst mo_mt_call.py: using BVCI 39801 08:54:26.415657 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:54:26.426903 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:54:26.437992 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:54:26.448868 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:54:26.460233 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:54:26.471244 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 08:54:26.592403 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 08:54:26.709405 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:54:27.177457 run create_hlr_db(pid=30653): Launched 08:54:27.292173 bus /sierra_2: Setting Powered False 08:54:28.355520 run create_hlr_db(pid=30653): Terminated: ok {rc=0} 08:54:28.802265 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30655): Launched 08:54:29.124202 run osmo-hlr_10.42.42.2(pid=30656): Launched 08:54:29.246821 run osmo-stp_10.42.42.5: Starting osmo-stp 08:54:29.807585 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30658): Launched 08:54:30.125612 run osmo-stp_10.42.42.5(pid=30659): Launched 08:54:30.246785 run osmo-msc_10.42.42.6: Starting osmo-msc 08:54:30.823108 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30661): Launched 08:54:31.160802 run osmo-msc_10.42.42.6(pid=30662): Launched 08:54:31.490531 run osmo-stp_10.42.42.5(pid=30659): ERR: Terminated: ERROR {rc=1} [trial-2402↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30659)] 08:54:31.653173 run osmo-stp_10.42.42.5(pid=30659): stdout: | (launched: 2022-12-14_08:54:30.067416) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:54:31.904567 run osmo-stp_10.42.42.5(pid=30659): stderr: | 20221214085430256 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214085430256 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214085430256 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214085430256 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214085430257 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214085430257 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214085430257 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:54:32.064709 run osmo-stp_10.42.42.5(pid=30659): stdout: | (launched: 2022-12-14_08:54:30.067416) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:54:32.195475 run osmo-stp_10.42.42.5(pid=30659): stderr: | 20221214085430256 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214085430256 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214085430256 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214085430256 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214085430257 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214085430257 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214085430257 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:54:32.351750 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30659): Process ended prematurely: osmo-stp_10.42.42.5(pid=30659) [trial-2402↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30659)] [trial-2402↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 08:54:32.362039 tst mo_mt_call.py:8: Test FAILED (6.6 sec) 08:54:32.391309 run osmo-hlr_10.42.42.2(pid=30656): ERR: Terminated: ERROR {rc=237} [trial-2402↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30656)] 08:54:32.442374 run osmo-hlr_10.42.42.2(pid=30656): stdout: | (launched: 2022-12-14_08:54:29.065291) 08:54:32.494701 run osmo-hlr_10.42.42.2(pid=30656): stderr: | 20221214085429263 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214085429263 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214085429263 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214085429263 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214085429263 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214085429263 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214085429275 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214085429283 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214085429284 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214085429284 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:54:32.567575 run osmo-msc_10.42.42.6(pid=30662): ERR: Terminated: ERROR {rc=2} [trial-2402↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30662)] 08:54:32.618159 run osmo-msc_10.42.42.6(pid=30662): stdout: | (launched: 2022-12-14_08:54:31.105600) 08:54:32.670306 run osmo-msc_10.42.42.6(pid=30662): stderr: | 20221214085431483 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214085431483 DLGLOBAL DEBUG validating counter group 0x7fec199acc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214085431483 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214085431483 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214085431483 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214085431484 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214085431495 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214085431495 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214085431495 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214085431495 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:54:32.722521 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30655): Terminating (SIGTERM) 08:54:32.764216 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30658): Terminating (SIGTERM) 08:54:32.806148 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30661): Terminating (SIGTERM) 08:54:32.848127 --- ParallelTerminationStrategy: PID 30655 died... 08:54:32.868070 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30655): Terminated: ok {rc=0} 08:54:32.914899 --- ParallelTerminationStrategy: PID 30658 died... 08:54:32.934606 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30658): Terminated: ok {rc=0} 08:54:32.980447 --- ParallelTerminationStrategy: PID 30661 died... 08:54:33.000037 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30661): Terminated: ok {rc=0} 08:54:33.087422 bus /sierra_3: Setting Powered False 08:54:34.185126 bus /sierra_3: Setting Powered False 08:54:35.300541 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2402 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 08:54:36.448054 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:54:36.460565 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 08:54:36.533740 tst mo_mt_call_osmux.py: using LAC 39801 08:54:36.663790 tst mo_mt_call_osmux.py: using RAC 21 08:54:36.789399 tst mo_mt_call_osmux.py: using CellId 39801 08:54:36.914674 tst mo_mt_call_osmux.py: using BVCI 39802 08:54:37.031207 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:54:37.043268 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:54:37.055045 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:54:37.066817 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:54:37.078833 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:54:37.090490 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 08:54:37.205726 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 08:54:37.321776 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:54:37.788100 run create_hlr_db(pid=30664): Launched 08:54:37.903045 bus /sierra_2: Setting Powered False 08:54:38.962385 run create_hlr_db(pid=30664): Terminated: ok {rc=0} 08:54:39.397800 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30666): Launched 08:54:39.719591 run osmo-hlr_10.42.42.2(pid=30667): Launched 08:54:39.841284 run osmo-stp_10.42.42.5: Starting osmo-stp 08:54:40.391382 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30669): Launched 08:54:40.709909 run osmo-stp_10.42.42.5(pid=30670): Launched 08:54:40.830820 run osmo-msc_10.42.42.6: Starting osmo-msc 08:54:41.408238 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30672): Launched 08:54:41.727580 run osmo-msc_10.42.42.6(pid=30673): Launched 08:54:41.907138 run osmo-stp_10.42.42.5(pid=30670): ERR: Terminated: ERROR {rc=1} [trial-2402↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30670)] 08:54:42.041490 run osmo-stp_10.42.42.5(pid=30670): stdout: | (launched: 2022-12-14_08:54:40.651628) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:54:42.176388 run osmo-stp_10.42.42.5(pid=30670): stderr: | 20221214085440840 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214085440840 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214085440840 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214085440841 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214085440841 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214085440841 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214085440841 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:54:42.311137 run osmo-stp_10.42.42.5(pid=30670): stdout: | (launched: 2022-12-14_08:54:40.651628) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:54:42.438380 run osmo-stp_10.42.42.5(pid=30670): stderr: | 20221214085440840 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214085440840 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214085440840 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214085440841 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214085440841 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214085440841 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214085440841 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:54:42.590624 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30670): Process ended prematurely: osmo-stp_10.42.42.5(pid=30670) [trial-2402↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30670)] [trial-2402↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 08:54:42.600485 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 08:54:42.628260 run osmo-hlr_10.42.42.2(pid=30667): ERR: Terminated: ERROR {rc=237} [trial-2402↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30667)] 08:54:42.678569 run osmo-hlr_10.42.42.2(pid=30667): stdout: | (launched: 2022-12-14_08:54:39.660738) 08:54:42.730463 run osmo-hlr_10.42.42.2(pid=30667): stderr: | 20221214085439854 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214085439855 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214085439855 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214085439855 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214085439855 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214085439855 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214085439871 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214085439881 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214085439881 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214085439881 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:54:42.802826 run osmo-msc_10.42.42.6(pid=30673): ERR: Terminated: ERROR {rc=2} [trial-2402↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30673)] 08:54:42.852842 run osmo-msc_10.42.42.6(pid=30673): stdout: | (launched: 2022-12-14_08:54:41.669181) 08:54:42.904561 run osmo-msc_10.42.42.6(pid=30673): stderr: | 20221214085441990 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214085441991 DLGLOBAL DEBUG validating counter group 0x7fa571b1ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214085441991 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214085441991 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214085441991 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214085441991 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214085441993 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214085441993 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214085441993 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214085441993 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:54:42.956622 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30666): Terminating (SIGTERM) 08:54:42.997921 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30669): Terminating (SIGTERM) 08:54:43.039365 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30672): Terminating (SIGTERM) 08:54:43.081079 --- ParallelTerminationStrategy: PID 30666 died... 08:54:43.100899 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30666): Terminated: ok {rc=0} 08:54:43.147168 --- ParallelTerminationStrategy: PID 30669 died... 08:54:43.166736 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30669): Terminated: ok {rc=0} 08:54:43.212611 --- ParallelTerminationStrategy: PID 30672 died... 08:54:43.232409 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30672): Terminated: ok {rc=0} 08:54:43.319814 bus /sierra_3: Setting Powered False 08:54:44.417301 bus /sierra_3: Setting Powered False 08:54:45.533247 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2402 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 08:54:46.789945 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:54:46.798585 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 08:54:46.838328 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 08:54:46.867998 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 08:54:46.924413 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 08:54:46.968092 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 08:54:47.001772 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 08:54:47.538476 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2402 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 08:54:47.587152 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 08:54:47.598540 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 08:54:47.670798 tst mo_mt_call.py: using LAC 39802 08:54:47.797818 tst mo_mt_call.py: using RAC 22 08:54:47.925402 tst mo_mt_call.py: using CellId 39802 08:54:48.052598 tst mo_mt_call.py: using BVCI 39803 08:54:48.168809 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 08:54:48.180602 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 08:54:48.192325 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 08:54:48.203792 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 08:54:48.215546 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 08:54:48.227206 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 08:54:48.342946 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 08:54:48.461694 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:54:48.957735 run create_hlr_db(pid=30678): Launched 08:54:49.086840 bus /sierra_2: Setting Powered False 08:54:50.150146 run create_hlr_db(pid=30678): Terminated: ok {rc=0} 08:54:50.591953 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30680): Launched 08:54:50.910527 run osmo-hlr_10.42.42.2(pid=30681): Launched 08:54:51.031466 run osmo-stp_10.42.42.5: Starting osmo-stp 08:54:51.577828 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30683): Launched 08:54:51.897225 run osmo-stp_10.42.42.5(pid=30684): Launched 08:54:52.018870 run osmo-msc_10.42.42.6: Starting osmo-msc 08:54:52.598736 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30686): Launched 08:54:52.917956 run osmo-msc_10.42.42.6(pid=30687): Launched 08:54:53.094956 run osmo-stp_10.42.42.5(pid=30684): ERR: Terminated: ERROR {rc=1} [trial-2402↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30684)] 08:54:53.228680 run osmo-stp_10.42.42.5(pid=30684): stdout: | (launched: 2022-12-14_08:54:51.838677) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:54:53.363420 run osmo-stp_10.42.42.5(pid=30684): stderr: | 20221214085452028 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214085452029 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214085452029 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214085452029 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214085452030 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214085452030 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214085452030 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:54:53.497574 run osmo-stp_10.42.42.5(pid=30684): stdout: | (launched: 2022-12-14_08:54:51.838677) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:54:53.624240 run osmo-stp_10.42.42.5(pid=30684): stderr: | 20221214085452028 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214085452029 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214085452029 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214085452029 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214085452030 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214085452030 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214085452030 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:54:53.776131 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30684): Process ended prematurely: osmo-stp_10.42.42.5(pid=30684) [trial-2402↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30684)] [trial-2402↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 08:54:53.786062 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 08:54:53.813869 run osmo-hlr_10.42.42.2(pid=30681): ERR: Terminated: ERROR {rc=237} [trial-2402↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30681)] 08:54:53.864144 run osmo-hlr_10.42.42.2(pid=30681): stdout: | (launched: 2022-12-14_08:54:50.851679) 08:54:53.916322 run osmo-hlr_10.42.42.2(pid=30681): stderr: | 20221214085451047 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214085451047 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214085451047 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214085451047 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214085451047 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214085451047 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214085451063 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214085451073 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214085451073 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214085451073 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:54:53.988910 run osmo-msc_10.42.42.6(pid=30687): ERR: Terminated: ERROR {rc=2} [trial-2402↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30687)] 08:54:54.038624 run osmo-msc_10.42.42.6(pid=30687): stdout: | (launched: 2022-12-14_08:54:52.858843) 08:54:54.090538 run osmo-msc_10.42.42.6(pid=30687): stderr: | 20221214085453178 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214085453178 DLGLOBAL DEBUG validating counter group 0x7fef29322c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214085453178 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214085453178 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214085453179 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214085453179 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214085453180 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214085453181 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214085453181 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214085453181 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:54:54.142036 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30680): Terminating (SIGTERM) 08:54:54.183539 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30683): Terminating (SIGTERM) 08:54:54.225263 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30686): Terminating (SIGTERM) 08:54:54.267257 --- ParallelTerminationStrategy: PID 30680 died... 08:54:54.287006 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30680): Terminated: ok {rc=0} 08:54:54.333130 --- ParallelTerminationStrategy: PID 30683 died... 08:54:54.352765 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30683): Terminated: ok {rc=0} 08:54:54.399018 --- ParallelTerminationStrategy: PID 30686 died... 08:54:54.418795 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30686): Terminated: ok {rc=0} 08:54:54.506359 bus /sierra_3: Setting Powered False 08:54:55.604894 bus /sierra_3: Setting Powered False 08:54:56.721868 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2402 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 08:54:57.871172 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 08:54:57.883852 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 08:54:57.957428 tst mo_mt_call_osmux.py: using LAC 39803 08:54:58.085870 tst mo_mt_call_osmux.py: using RAC 23 08:54:58.211836 tst mo_mt_call_osmux.py: using CellId 39803 08:54:58.336186 tst mo_mt_call_osmux.py: using BVCI 39804 08:54:58.448003 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 08:54:58.459501 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 08:54:58.470681 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 08:54:58.482016 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 08:54:58.493769 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 08:54:58.505612 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 08:54:58.621256 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 08:54:58.743207 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:54:59.241116 run create_hlr_db(pid=30689): Launched 08:54:59.371474 bus /sierra_2: Setting Powered False 08:55:00.434604 run create_hlr_db(pid=30689): Terminated: ok {rc=0} 08:55:00.879237 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30691): Launched 08:55:01.206126 run osmo-hlr_10.42.42.2(pid=30692): Launched 08:55:01.446214 run osmo-stp_10.42.42.5: Starting osmo-stp 08:55:02.175680 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30697): Launched 08:55:02.579521 run osmo-stp_10.42.42.5(pid=30698): Launched 08:55:02.706484 run osmo-msc_10.42.42.6: Starting osmo-msc 08:55:03.248428 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30700): Launched 08:55:03.547440 run osmo-msc_10.42.42.6(pid=30701): Launched 08:55:03.715637 run osmo-stp_10.42.42.5(pid=30698): ERR: Terminated: ERROR {rc=1} [trial-2402↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30698)] 08:55:03.842443 run osmo-stp_10.42.42.5(pid=30698): stdout: | (launched: 2022-12-14_08:55:02.519196) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:55:03.968935 run osmo-stp_10.42.42.5(pid=30698): stderr: | 20221214085502709 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214085502710 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214085502710 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214085502710 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214085502711 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214085502711 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214085502711 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:55:04.093435 run osmo-stp_10.42.42.5(pid=30698): stdout: | (launched: 2022-12-14_08:55:02.519196) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:55:04.212459 run osmo-stp_10.42.42.5(pid=30698): stderr: | 20221214085502709 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214085502710 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214085502710 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214085502710 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214085502711 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214085502711 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214085502711 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:55:04.354417 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30698): Process ended prematurely: osmo-stp_10.42.42.5(pid=30698) [trial-2402↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30698)] [trial-2402↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 08:55:04.363470 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 08:55:04.389685 run osmo-hlr_10.42.42.2(pid=30692): ERR: Terminated: ERROR {rc=237} [trial-2402↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30692)] 08:55:04.437611 run osmo-hlr_10.42.42.2(pid=30692): stdout: | (launched: 2022-12-14_08:55:01.149759) 08:55:04.487222 run osmo-hlr_10.42.42.2(pid=30692): stderr: | 20221214085501346 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214085501346 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214085501346 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214085501346 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214085501346 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214085501346 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214085501362 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214085501388 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214085501388 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214085501389 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:55:04.556650 run osmo-msc_10.42.42.6(pid=30701): ERR: Terminated: ERROR {rc=2} [trial-2402↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30701)] 08:55:04.603893 run osmo-msc_10.42.42.6(pid=30701): stdout: | (launched: 2022-12-14_08:55:03.492179) 08:55:04.653031 run osmo-msc_10.42.42.6(pid=30701): stderr: | 20221214085503761 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214085503761 DLGLOBAL DEBUG validating counter group 0x7f8dec610c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214085503761 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214085503762 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214085503762 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214085503762 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214085503764 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214085503764 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214085503764 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214085503764 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:55:04.702443 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30691): Terminating (SIGTERM) 08:55:04.741735 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30697): Terminating (SIGTERM) 08:55:04.781128 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30700): Terminating (SIGTERM) 08:55:04.820780 --- ParallelTerminationStrategy: PID 30691 died... 08:55:04.839945 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30691): Terminated: ok {rc=0} 08:55:04.883468 --- ParallelTerminationStrategy: PID 30697 died... 08:55:04.902337 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30697): Terminated: ok {rc=0} 08:55:04.945812 --- ParallelTerminationStrategy: PID 30700 died... 08:55:04.964502 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30700): Terminated: ok {rc=0} 08:55:05.047966 bus /sierra_3: Setting Powered False 08:55:06.144263 bus /sierra_3: Setting Powered False 08:55:07.262493 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2402 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 08:55:08.511510 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:55:08.517971 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 08:55:08.551102 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 08:55:08.578135 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 08:55:08.630800 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 08:55:08.665713 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 08:55:08.693188 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 08:55:09.244709 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2402 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 08:55:09.295499 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:55:09.307188 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 08:55:09.378634 tst mo_mt_call.py: using LAC 39804 08:55:09.505095 tst mo_mt_call.py: using RAC 24 08:55:09.630155 tst mo_mt_call.py: using CellId 39804 08:55:09.757414 tst mo_mt_call.py: using BVCI 39805 08:55:09.875632 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:55:09.887365 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:55:09.898955 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:55:09.910988 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:55:09.922767 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:55:09.934381 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 08:55:10.051261 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 08:55:10.173269 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:55:10.670465 run create_hlr_db(pid=30709): Launched 08:55:10.799888 bus /sierra_2: Setting Powered False 08:55:11.863844 run create_hlr_db(pid=30709): Terminated: ok {rc=0} 08:55:12.290193 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30711): Launched 08:55:12.589556 run osmo-hlr_10.42.42.2(pid=30713): Launched 08:55:12.703200 run osmo-stp_10.42.42.5: Starting osmo-stp 08:55:13.230195 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30715): Launched 08:55:13.529072 run osmo-stp_10.42.42.5(pid=30716): Launched 08:55:13.642932 run osmo-msc_10.42.42.6: Starting osmo-msc 08:55:14.185073 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30718): Launched 08:55:14.485695 run osmo-msc_10.42.42.6(pid=30719): Launched 08:55:14.654041 run osmo-stp_10.42.42.5(pid=30716): ERR: Terminated: ERROR {rc=1} [trial-2402↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30716)] 08:55:14.781659 run osmo-stp_10.42.42.5(pid=30716): stdout: | (launched: 2022-12-14_08:55:13.473745) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:55:14.908613 run osmo-stp_10.42.42.5(pid=30716): stderr: | 20221214085513641 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214085513641 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214085513641 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214085513641 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214085513642 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214085513642 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214085513642 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:55:15.033644 run osmo-stp_10.42.42.5(pid=30716): stdout: | (launched: 2022-12-14_08:55:13.473745) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:55:15.153113 run osmo-stp_10.42.42.5(pid=30716): stderr: | 20221214085513641 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214085513641 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214085513641 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214085513641 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214085513642 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214085513642 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214085513642 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:55:15.295984 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30716): Process ended prematurely: osmo-stp_10.42.42.5(pid=30716) [trial-2402↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30716)] [trial-2402↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 08:55:15.305917 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 08:55:15.332294 run osmo-hlr_10.42.42.2(pid=30713): ERR: Terminated: ERROR {rc=237} [trial-2402↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30713)] 08:55:15.380588 run osmo-hlr_10.42.42.2(pid=30713): stdout: | (launched: 2022-12-14_08:55:12.534458) 08:55:15.429773 run osmo-hlr_10.42.42.2(pid=30713): stderr: | 20221214085512708 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214085512708 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214085512708 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214085512708 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214085512708 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214085512708 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214085512720 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214085512729 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214085512730 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214085512730 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:55:15.498769 run osmo-msc_10.42.42.6(pid=30719): ERR: Terminated: ERROR {rc=2} [trial-2402↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30719)] 08:55:15.545849 run osmo-msc_10.42.42.6(pid=30719): stdout: | (launched: 2022-12-14_08:55:14.430590) 08:55:15.595107 run osmo-msc_10.42.42.6(pid=30719): stderr: | 20221214085514701 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214085514701 DLGLOBAL DEBUG validating counter group 0x7f3e56d13c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214085514702 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214085514702 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214085514702 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214085514702 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214085514704 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214085514704 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214085514704 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214085514704 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:55:15.645060 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30711): Terminating (SIGTERM) 08:55:15.684700 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30715): Terminating (SIGTERM) 08:55:15.724564 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30718): Terminating (SIGTERM) 08:55:15.765391 --- ParallelTerminationStrategy: PID 30711 died... 08:55:15.784418 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30711): Terminated: ok {rc=0} 08:55:15.829838 --- ParallelTerminationStrategy: PID 30715 died... 08:55:15.884283 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30715): Terminated: ok {rc=0} 08:55:15.957211 --- ParallelTerminationStrategy: PID 30718 died... 08:55:15.982704 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30718): Terminated: ok {rc=0} 08:55:16.080706 bus /sierra_3: Setting Powered False 08:55:17.204702 bus /sierra_3: Setting Powered False 08:55:18.323270 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2402 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 08:55:19.465675 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:55:19.477682 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 08:55:19.547996 tst mo_mt_call_osmux.py: using LAC 39805 08:55:19.667123 tst mo_mt_call_osmux.py: using RAC 25 08:55:19.793508 tst mo_mt_call_osmux.py: using CellId 39805 08:55:19.919754 tst mo_mt_call_osmux.py: using BVCI 39806 08:55:20.037942 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:55:20.049959 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:55:20.061759 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:55:20.073558 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:55:20.085126 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:55:20.096671 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 08:55:20.215845 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 08:55:20.332921 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:55:20.796234 run create_hlr_db(pid=30724): Launched 08:55:20.911632 bus /sierra_2: Setting Powered False 08:55:21.971157 run create_hlr_db(pid=30724): Terminated: ok {rc=0} 08:55:22.406511 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30726): Launched 08:55:22.726458 run osmo-hlr_10.42.42.2(pid=30727): Launched 08:55:22.848312 run osmo-stp_10.42.42.5: Starting osmo-stp 08:55:23.403281 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30729): Launched 08:55:23.723449 run osmo-stp_10.42.42.5(pid=30730): Launched 08:55:23.847064 run osmo-msc_10.42.42.6: Starting osmo-msc 08:55:24.427643 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30732): Launched 08:55:24.748623 run osmo-msc_10.42.42.6(pid=30733): Launched 08:55:24.928679 run osmo-stp_10.42.42.5(pid=30730): ERR: Terminated: ERROR {rc=1} [trial-2402↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30730)] 08:55:25.063750 run osmo-stp_10.42.42.5(pid=30730): stdout: | (launched: 2022-12-14_08:55:23.664515) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:55:25.199081 run osmo-stp_10.42.42.5(pid=30730): stderr: | 20221214085523852 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214085523853 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214085523853 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214085523853 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214085523854 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214085523854 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214085523854 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:55:25.333759 run osmo-stp_10.42.42.5(pid=30730): stdout: | (launched: 2022-12-14_08:55:23.664515) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:55:25.461169 run osmo-stp_10.42.42.5(pid=30730): stderr: | 20221214085523852 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214085523853 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214085523853 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214085523853 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214085523854 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214085523854 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214085523854 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:55:25.613684 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30730): Process ended prematurely: osmo-stp_10.42.42.5(pid=30730) [trial-2402↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30730)] [trial-2402↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 08:55:25.623443 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 08:55:25.651175 run osmo-hlr_10.42.42.2(pid=30727): ERR: Terminated: ERROR {rc=237} [trial-2402↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30727)] 08:55:25.701433 run osmo-hlr_10.42.42.2(pid=30727): stdout: | (launched: 2022-12-14_08:55:22.667463) 08:55:25.753388 run osmo-hlr_10.42.42.2(pid=30727): stderr: | 20221214085522862 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214085522863 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214085522863 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214085522863 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214085522863 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214085522863 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214085522880 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214085522888 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214085522888 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214085522888 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:55:25.825642 run osmo-msc_10.42.42.6(pid=30733): ERR: Terminated: ERROR {rc=2} [trial-2402↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30733)] 08:55:25.875376 run osmo-msc_10.42.42.6(pid=30733): stdout: | (launched: 2022-12-14_08:55:24.690007) 08:55:25.927010 run osmo-msc_10.42.42.6(pid=30733): stderr: | 20221214085525010 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214085525010 DLGLOBAL DEBUG validating counter group 0x7fe60e793c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214085525010 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214085525010 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214085525010 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214085525011 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214085525012 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214085525013 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214085525013 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214085525013 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:55:25.979055 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30726): Terminating (SIGTERM) 08:55:26.030823 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30729): Terminating (SIGTERM) 08:55:26.072232 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30732): Terminating (SIGTERM) 08:55:26.114051 --- ParallelTerminationStrategy: PID 30726 died... 08:55:26.133478 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30726): Terminated: ok {rc=0} 08:55:26.179199 --- ParallelTerminationStrategy: PID 30729 died... 08:55:26.198503 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30729): Terminated: ok {rc=0} 08:55:26.244024 --- ParallelTerminationStrategy: PID 30732 died... 08:55:26.263416 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30732): Terminated: ok {rc=0} 08:55:26.350959 bus /sierra_3: Setting Powered False 08:55:27.447952 bus /sierra_3: Setting Powered False 08:55:28.563810 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2402 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 08:55:29.824298 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:55:29.831328 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 08:55:29.865323 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 08:55:29.892648 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 08:55:29.944575 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 08:55:29.978766 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 08:55:30.006172 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 08:55:30.560617 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2402 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 08:55:30.612641 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:55:30.624667 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 08:55:30.698361 tst mo_mt_call.py: using LAC 39806 08:55:30.824327 tst mo_mt_call.py: using RAC 26 08:55:30.967068 tst mo_mt_call.py: using CellId 39806 08:55:31.103565 tst mo_mt_call.py: using BVCI 39807 08:55:31.255243 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:55:31.267801 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:55:31.280029 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:55:31.292764 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:55:31.306720 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:55:31.320129 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 08:55:31.438919 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 08:55:31.565117 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:55:32.100288 run create_hlr_db(pid=30738): Launched 08:55:32.265882 bus /sierra_2: Setting Powered False 08:55:33.329622 run create_hlr_db(pid=30738): Terminated: ok {rc=0} 08:55:33.757379 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30740): Launched 08:55:34.056635 run osmo-hlr_10.42.42.2(pid=30741): Launched 08:55:34.171158 run osmo-stp_10.42.42.5: Starting osmo-stp 08:55:34.698039 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30743): Launched 08:55:34.997332 run osmo-stp_10.42.42.5(pid=30744): Launched 08:55:35.111245 run osmo-msc_10.42.42.6: Starting osmo-msc 08:55:35.654366 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30746): Launched 08:55:35.954288 run osmo-msc_10.42.42.6(pid=30747): Launched 08:55:36.124564 run osmo-stp_10.42.42.5(pid=30744): ERR: Terminated: ERROR {rc=1} [trial-2402↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30744)] 08:55:36.252484 run osmo-stp_10.42.42.5(pid=30744): stdout: | (launched: 2022-12-14_08:55:34.942409) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:55:36.379535 run osmo-stp_10.42.42.5(pid=30744): stderr: | 20221214085535109 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214085535109 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214085535109 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214085535110 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214085535110 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214085535110 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214085535110 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:55:36.505122 run osmo-stp_10.42.42.5(pid=30744): stdout: | (launched: 2022-12-14_08:55:34.942409) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:55:36.624374 run osmo-stp_10.42.42.5(pid=30744): stderr: | 20221214085535109 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214085535109 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214085535109 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214085535110 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214085535110 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214085535110 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214085535110 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:55:36.767639 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30744): Process ended prematurely: osmo-stp_10.42.42.5(pid=30744) [trial-2402↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30744)] [trial-2402↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 08:55:36.776733 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 08:55:36.802789 run osmo-hlr_10.42.42.2(pid=30741): ERR: Terminated: ERROR {rc=237} [trial-2402↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30741)] 08:55:36.851218 run osmo-hlr_10.42.42.2(pid=30741): stdout: | (launched: 2022-12-14_08:55:34.001869) 08:55:36.900388 run osmo-hlr_10.42.42.2(pid=30741): stderr: | 20221214085534176 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214085534176 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214085534176 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214085534176 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214085534176 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214085534176 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214085534187 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214085534196 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214085534196 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214085534196 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:55:36.969798 run osmo-msc_10.42.42.6(pid=30747): ERR: Terminated: ERROR {rc=2} [trial-2402↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30747)] 08:55:37.017116 run osmo-msc_10.42.42.6(pid=30747): stdout: | (launched: 2022-12-14_08:55:35.898771) 08:55:37.066377 run osmo-msc_10.42.42.6(pid=30747): stderr: | 20221214085536169 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214085536169 DLGLOBAL DEBUG validating counter group 0x7f937de94c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214085536169 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214085536169 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214085536169 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214085536170 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214085536171 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214085536172 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214085536172 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214085536172 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:55:37.115956 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30740): Terminating (SIGTERM) 08:55:37.155359 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30743): Terminating (SIGTERM) 08:55:37.195085 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30746): Terminating (SIGTERM) 08:55:37.234653 --- ParallelTerminationStrategy: PID 30740 died... 08:55:37.253873 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30740): Terminated: ok {rc=0} 08:55:37.297459 --- ParallelTerminationStrategy: PID 30743 died... 08:55:37.316062 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30743): Terminated: ok {rc=0} 08:55:37.359656 --- ParallelTerminationStrategy: PID 30746 died... 08:55:37.378341 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30746): Terminated: ok {rc=0} 08:55:37.463806 bus /sierra_3: Setting Powered False 08:55:38.561556 bus /sierra_3: Setting Powered False 08:55:39.673803 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2402 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 08:55:40.820514 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:55:40.832879 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 08:55:40.905796 tst mo_mt_call_osmux.py: using LAC 39807 08:55:41.032494 tst mo_mt_call_osmux.py: using RAC 27 08:55:41.157893 tst mo_mt_call_osmux.py: using CellId 39807 08:55:41.283934 tst mo_mt_call_osmux.py: using BVCI 39808 08:55:41.400217 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:55:41.412097 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:55:41.423762 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:55:41.435485 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:55:41.447236 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:55:41.458875 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 08:55:41.574695 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 08:55:41.692588 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:55:42.190533 run create_hlr_db(pid=30749): Launched 08:55:42.320830 bus /sierra_2: Setting Powered False 08:55:43.384517 run create_hlr_db(pid=30749): Terminated: ok {rc=0} 08:55:43.811484 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30751): Launched 08:55:44.111393 run osmo-hlr_10.42.42.2(pid=30752): Launched 08:55:44.225698 run osmo-stp_10.42.42.5: Starting osmo-stp 08:55:44.755034 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30754): Launched 08:55:45.053591 run osmo-stp_10.42.42.5(pid=30755): Launched 08:55:45.167330 run osmo-msc_10.42.42.6: Starting osmo-msc 08:55:45.709170 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30757): Launched 08:55:46.041803 run osmo-msc_10.42.42.6(pid=30758): Launched 08:55:46.408041 run osmo-stp_10.42.42.5(pid=30755): ERR: Terminated: ERROR {rc=1} [trial-2402↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30755)] 08:55:46.630175 run osmo-stp_10.42.42.5(pid=30755): stdout: | (launched: 2022-12-14_08:55:44.998515) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:55:46.772432 run osmo-stp_10.42.42.5(pid=30755): stderr: | 20221214085545166 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214085545166 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214085545166 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214085545167 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214085545167 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214085545167 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214085545167 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:55:46.912775 run osmo-stp_10.42.42.5(pid=30755): stdout: | (launched: 2022-12-14_08:55:44.998515) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:55:47.045838 run osmo-stp_10.42.42.5(pid=30755): stderr: | 20221214085545166 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214085545166 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214085545166 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214085545167 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214085545167 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214085545167 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214085545167 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:55:47.208291 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30755): Process ended prematurely: osmo-stp_10.42.42.5(pid=30755) [trial-2402↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30755)] [trial-2402↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 08:55:47.217718 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 08:55:47.244228 run osmo-hlr_10.42.42.2(pid=30752): ERR: Terminated: ERROR {rc=237} [trial-2402↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30752)] 08:55:47.297920 run osmo-hlr_10.42.42.2(pid=30752): stdout: | (launched: 2022-12-14_08:55:44.055960) 08:55:47.351755 run osmo-hlr_10.42.42.2(pid=30752): stderr: | 20221214085544230 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214085544230 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214085544230 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214085544230 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214085544230 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214085544230 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214085544242 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214085544251 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214085544251 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214085544251 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:55:47.424619 run osmo-msc_10.42.42.6(pid=30758): ERR: Terminated: ERROR {rc=2} [trial-2402↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30758)] 08:55:47.475308 run osmo-msc_10.42.42.6(pid=30758): stdout: | (launched: 2022-12-14_08:55:45.977195) 08:55:47.527597 run osmo-msc_10.42.42.6(pid=30758): stderr: | 20221214085546349 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214085546350 DLGLOBAL DEBUG validating counter group 0x7f6a8b53fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214085546350 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214085546350 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214085546350 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214085546350 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214085546352 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214085546352 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214085546352 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214085546352 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:55:47.580379 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30751): Terminating (SIGTERM) 08:55:47.622874 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30754): Terminating (SIGTERM) 08:55:47.665554 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30757): Terminating (SIGTERM) 08:55:47.707940 --- ParallelTerminationStrategy: PID 30751 died... 08:55:47.728262 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30751): Terminated: ok {rc=0} 08:55:47.775304 --- ParallelTerminationStrategy: PID 30754 died... 08:55:47.795168 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30754): Terminated: ok {rc=0} 08:55:47.841565 --- ParallelTerminationStrategy: PID 30757 died... 08:55:47.861425 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30757): Terminated: ok {rc=0} 08:55:47.950050 bus /sierra_3: Setting Powered False 08:55:49.048688 bus /sierra_3: Setting Powered False 08:55:50.164412 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2402 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 voice:trx-sysmocell5000+mod-bts0-dynts-osmo --------------------------------------------------------------------- 08:55:51.415236 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:55:51.422512 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 08:55:51.456913 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 08:55:51.484445 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 08:55:51.536722 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 08:55:51.571226 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 08:55:51.598587 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 08:55:52.151357 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2402 voice:trx-sysmocell5000+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 08:55:52.203267 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 08:55:52.215089 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 08:55:52.288890 tst mo_mt_call.py: using LAC 39808 08:55:52.416446 tst mo_mt_call.py: using RAC 28 08:55:52.542838 tst mo_mt_call.py: using CellId 39808 08:55:52.674418 tst mo_mt_call.py: using BVCI 39809 08:55:52.793670 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 08:55:52.805632 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 08:55:52.817338 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 08:55:52.829114 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 08:55:52.841167 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 08:55:52.853624 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 08:55:52.972875 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 08:55:53.093043 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:55:53.590412 run create_hlr_db(pid=30764): Launched 08:55:53.722735 bus /sierra_2: Setting Powered False 08:55:54.782963 run create_hlr_db(pid=30764): Terminated: ok {rc=0} 08:55:55.207568 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30766): Launched 08:55:55.507245 run osmo-hlr_10.42.42.2(pid=30767): Launched 08:55:55.621967 run osmo-stp_10.42.42.5: Starting osmo-stp 08:55:56.150256 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30769): Launched 08:55:56.451652 run osmo-stp_10.42.42.5(pid=30770): Launched 08:55:56.566572 run osmo-msc_10.42.42.6: Starting osmo-msc 08:55:57.109536 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30772): Launched 08:55:57.409807 run osmo-msc_10.42.42.6(pid=30773): Launched 08:55:57.579834 run osmo-stp_10.42.42.5(pid=30770): ERR: Terminated: ERROR {rc=1} [trial-2402↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30770)] 08:55:57.707356 run osmo-stp_10.42.42.5(pid=30770): stdout: | (launched: 2022-12-14_08:55:56.396363) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:55:57.834216 run osmo-stp_10.42.42.5(pid=30770): stderr: | 20221214085556562 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214085556562 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214085556563 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214085556563 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214085556564 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214085556564 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214085556564 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:55:57.959439 run osmo-stp_10.42.42.5(pid=30770): stdout: | (launched: 2022-12-14_08:55:56.396363) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:55:58.078768 run osmo-stp_10.42.42.5(pid=30770): stderr: | 20221214085556562 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214085556562 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214085556563 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214085556563 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214085556564 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214085556564 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214085556564 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:55:58.221489 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30770): Process ended prematurely: osmo-stp_10.42.42.5(pid=30770) [trial-2402↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30770)] [trial-2402↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 08:55:58.230942 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 08:55:58.257342 run osmo-hlr_10.42.42.2(pid=30767): ERR: Terminated: ERROR {rc=237} [trial-2402↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30767)] 08:55:58.305349 run osmo-hlr_10.42.42.2(pid=30767): stdout: | (launched: 2022-12-14_08:55:55.451976) 08:55:58.354871 run osmo-hlr_10.42.42.2(pid=30767): stderr: | 20221214085555624 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214085555624 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214085555624 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214085555624 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214085555624 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214085555624 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214085555636 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/voice:trx-sysmocell5000+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214085555645 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214085555645 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214085555645 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:55:58.424873 run osmo-msc_10.42.42.6(pid=30773): ERR: Terminated: ERROR {rc=2} [trial-2402↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30773)] 08:55:58.472525 run osmo-msc_10.42.42.6(pid=30773): stdout: | (launched: 2022-12-14_08:55:57.354756) 08:55:58.522248 run osmo-msc_10.42.42.6(pid=30773): stderr: | 20221214085557625 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214085557625 DLGLOBAL DEBUG validating counter group 0x7f43fb410c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214085557625 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214085557625 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214085557625 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214085557625 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214085557627 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214085557627 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214085557628 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214085557628 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:55:58.572299 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30766): Terminating (SIGTERM) 08:55:58.612051 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30769): Terminating (SIGTERM) 08:55:58.651953 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30772): Terminating (SIGTERM) 08:55:58.691840 --- ParallelTerminationStrategy: PID 30766 died... 08:55:58.711305 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30766): Terminated: ok {rc=0} 08:55:58.755927 --- ParallelTerminationStrategy: PID 30769 died... 08:55:58.774934 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30769): Terminated: ok {rc=0} 08:55:58.819300 --- ParallelTerminationStrategy: PID 30772 died... 08:55:58.838396 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30772): Terminated: ok {rc=0} 08:55:58.922603 bus /sierra_3: Setting Powered False 08:56:00.021224 bus /sierra_3: Setting Powered False 08:56:01.138456 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2402 voice:trx-sysmocell5000+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 08:56:02.283046 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 08:56:02.294777 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 08:56:02.365934 tst mo_mt_call_osmux.py: using LAC 39809 08:56:02.486074 tst mo_mt_call_osmux.py: using RAC 29 08:56:02.604024 tst mo_mt_call_osmux.py: using CellId 39809 08:56:02.723534 tst mo_mt_call_osmux.py: using BVCI 39810 08:56:02.834183 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 08:56:02.845297 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 08:56:02.856215 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 08:56:02.867037 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 08:56:02.878374 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 08:56:02.889518 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 08:56:03.009755 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 08:56:03.134210 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:56:03.631726 run create_hlr_db(pid=30775): Launched 08:56:03.762876 bus /sierra_2: Setting Powered False 08:56:04.826369 run create_hlr_db(pid=30775): Terminated: ok {rc=0} 08:56:05.255606 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30777): Launched 08:56:05.554172 run osmo-hlr_10.42.42.2(pid=30778): Launched 08:56:05.668223 run osmo-stp_10.42.42.5: Starting osmo-stp 08:56:06.196140 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30780): Launched 08:56:06.495897 run osmo-stp_10.42.42.5(pid=30781): Launched 08:56:06.611090 run osmo-msc_10.42.42.6: Starting osmo-msc 08:56:07.153285 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30783): Launched 08:56:07.452892 run osmo-msc_10.42.42.6(pid=30784): Launched 08:56:07.622320 run osmo-stp_10.42.42.5(pid=30781): ERR: Terminated: ERROR {rc=1} [trial-2402↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30781)] 08:56:07.749647 run osmo-stp_10.42.42.5(pid=30781): stdout: | (launched: 2022-12-14_08:56:06.441102) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:56:07.876767 run osmo-stp_10.42.42.5(pid=30781): stderr: | 20221214085606607 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214085606607 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214085606608 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214085606608 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214085606609 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214085606609 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214085606609 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:56:08.002546 run osmo-stp_10.42.42.5(pid=30781): stdout: | (launched: 2022-12-14_08:56:06.441102) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:56:08.121886 run osmo-stp_10.42.42.5(pid=30781): stderr: | 20221214085606607 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214085606607 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214085606608 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214085606608 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214085606609 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214085606609 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214085606609 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:56:08.264461 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30781): Process ended prematurely: osmo-stp_10.42.42.5(pid=30781) [trial-2402↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30781)] [trial-2402↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 08:56:08.273837 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 08:56:08.300226 run osmo-hlr_10.42.42.2(pid=30778): ERR: Terminated: ERROR {rc=237} [trial-2402↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30778)] 08:56:08.348482 run osmo-hlr_10.42.42.2(pid=30778): stdout: | (launched: 2022-12-14_08:56:05.499404) 08:56:08.397973 run osmo-hlr_10.42.42.2(pid=30778): stderr: | 20221214085605672 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214085605672 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214085605672 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214085605672 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214085605672 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214085605672 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214085605685 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/voice:trx-sysmocell5000+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214085605695 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214085605695 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214085605696 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:56:08.467197 run osmo-msc_10.42.42.6(pid=30784): ERR: Terminated: ERROR {rc=2} [trial-2402↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30784)] 08:56:08.514694 run osmo-msc_10.42.42.6(pid=30784): stdout: | (launched: 2022-12-14_08:56:07.397994) 08:56:08.564071 run osmo-msc_10.42.42.6(pid=30784): stderr: | 20221214085607666 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214085607666 DLGLOBAL DEBUG validating counter group 0x7f6c2ab17c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214085607666 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214085607666 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214085607667 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214085607667 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214085607668 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214085607669 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214085607669 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214085607669 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:56:08.613834 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30777): Terminating (SIGTERM) 08:56:08.653547 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30780): Terminating (SIGTERM) 08:56:08.693250 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30783): Terminating (SIGTERM) 08:56:08.733096 --- ParallelTerminationStrategy: PID 30777 died... 08:56:08.752535 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30777): Terminated: ok {rc=0} 08:56:08.796680 --- ParallelTerminationStrategy: PID 30780 died... 08:56:08.815636 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30780): Terminated: ok {rc=0} 08:56:08.859334 --- ParallelTerminationStrategy: PID 30783 died... 08:56:08.878152 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30783): Terminated: ok {rc=0} 08:56:08.963732 bus /sierra_3: Setting Powered False 08:56:10.063278 bus /sierra_3: Setting Powered False 08:56:11.176617 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2402 voice:trx-sysmocell5000+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 emergency:trx-sysmocell5000 --------------------------------------------------------------------- 08:56:12.430110 tst emergency:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:56:12.434921 tst emergency:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 08:56:12.469242 tst emergency:trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 08:56:12.496578 tst emergency:trx-sysmocell5000: Verifying 4 x modem (candidates: 12) 08:56:12.583340 tst emergency:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 08:56:12.617835 tst emergency:trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 08:56:12.645093 tst emergency:trx-sysmocell5000: Reserving 4 x modem (candidates: 12) 08:56:13.230852 tst emergency:trx-sysmocell5000: RESERVED RESOURCES for emergency: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2402 emergency:trx-sysmocell5000 emergency_mo_mt_call.py ---------------------------------------------- 08:56:13.236182 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 08:56:13.247623 tst emergency:trx-sysmocell5000: Using 1 x bts (candidates: 1) 08:56:13.299675 tst emergency_mo_mt_call.py: using LAC 39810 08:56:13.424657 tst emergency_mo_mt_call.py: using RAC 30 08:56:13.541708 tst emergency_mo_mt_call.py: using CellId 39810 08:56:13.656640 tst emergency_mo_mt_call.py: using BVCI 39811 08:56:13.762582 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 08:56:13.773552 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 08:56:13.784397 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 08:56:13.794936 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 08:56:13.805820 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 08:56:13.817239 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 08:56:13.936092 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 08:56:14.050206 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:56:14.505455 run create_hlr_db(pid=30789): Launched 08:56:14.616782 bus /sierra_2: Setting Powered False 08:56:15.676023 run create_hlr_db(pid=30789): Terminated: ok {rc=0} 08:56:16.098290 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30791): Launched 08:56:16.465382 run osmo-hlr_10.42.42.2(pid=30792): Launched 08:56:16.597545 run osmo-stp_10.42.42.5: Starting osmo-stp 08:56:17.294584 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30794): Launched 08:56:17.622788 run osmo-stp_10.42.42.5(pid=30795): Launched 08:56:17.753360 tst emergency_mo_mt_call.py: using MSISDN 8601 08:56:17.913640 run osmo-msc_10.42.42.6: Starting osmo-msc 08:56:18.481704 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30797): Launched 08:56:18.796054 run osmo-msc_10.42.42.6(pid=30798): Launched 08:56:18.970190 run osmo-stp_10.42.42.5(pid=30795): ERR: Terminated: ERROR {rc=1} [trial-2402↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30795)] 08:56:19.103228 run osmo-stp_10.42.42.5(pid=30795): stdout: | (launched: 2022-12-14_08:56:17.564815) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:56:19.236070 run osmo-stp_10.42.42.5(pid=30795): stderr: | 20221214085617753 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214085617753 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214085617753 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214085617753 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214085617754 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214085617754 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214085617754 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:56:19.371889 run osmo-stp_10.42.42.5(pid=30795): stdout: | (launched: 2022-12-14_08:56:17.564815) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:56:19.496630 run osmo-stp_10.42.42.5(pid=30795): stderr: | 20221214085617753 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214085617753 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214085617753 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214085617753 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214085617754 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214085617754 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214085617754 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:56:19.645925 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=30795): Process ended prematurely: osmo-stp_10.42.42.5(pid=30795) [trial-2402↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30795)] [trial-2402↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19] 08:56:19.655150 tst emergency_mo_mt_call.py:19: Test FAILED (6.4 sec) 08:56:19.682422 run osmo-hlr_10.42.42.2(pid=30792): ERR: Terminated: ERROR {rc=237} [trial-2402↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30792)] 08:56:19.733201 run osmo-hlr_10.42.42.2(pid=30792): stdout: | (launched: 2022-12-14_08:56:16.409237) 08:56:19.785268 run osmo-hlr_10.42.42.2(pid=30792): stderr: | 20221214085616799 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214085616799 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214085616800 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214085616800 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214085616800 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214085616800 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214085616826 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/emergency:trx-sysmocell5000/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214085616844 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214085616844 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214085616844 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:56:19.857802 run osmo-msc_10.42.42.6(pid=30798): ERR: Terminated: ERROR {rc=2} [trial-2402↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30798)] 08:56:19.907827 run osmo-msc_10.42.42.6(pid=30798): stdout: | (launched: 2022-12-14_08:56:18.738038) 08:56:19.959834 run osmo-msc_10.42.42.6(pid=30798): stderr: | 20221214085619058 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214085619058 DLGLOBAL DEBUG validating counter group 0x7fa5d7b01c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214085619058 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214085619058 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214085619058 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214085619058 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214085619060 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214085619061 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214085619061 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214085619061 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:56:20.011724 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30791): Terminating (SIGTERM) 08:56:20.053250 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30794): Terminating (SIGTERM) 08:56:20.095035 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30797): Terminating (SIGTERM) 08:56:20.137194 --- ParallelTerminationStrategy: PID 30791 died... 08:56:20.157148 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30791): Terminated: ok {rc=0} 08:56:20.203373 --- ParallelTerminationStrategy: PID 30794 died... 08:56:20.223385 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30794): Terminated: ok {rc=0} 08:56:20.269655 --- ParallelTerminationStrategy: PID 30797 died... 08:56:20.289444 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30797): Terminated: ok {rc=0} 08:56:20.377763 bus /sierra_3: Setting Powered False 08:56:21.476177 bus /sierra_3: Setting Powered False 08:56:22.591350 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2402 emergency:trx-sysmocell5000 emergency_preemptive_call.py ---------------------------------------------- 08:56:23.677837 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 08:56:23.690006 tst emergency:trx-sysmocell5000: Using 1 x bts (candidates: 1) 08:56:23.742578 tst emergency_preemptive_call.py: using LAC 39811 08:56:23.872848 tst emergency_preemptive_call.py: using RAC 31 08:56:23.999504 tst emergency_preemptive_call.py: using CellId 39811 08:56:24.122682 tst emergency_preemptive_call.py: using BVCI 39812 08:56:24.236332 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 08:56:24.247663 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 08:56:24.258811 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 08:56:24.269902 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 08:56:24.281271 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 08:56:24.292501 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 08:56:24.413537 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 08:56:24.528895 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 08:56:24.646060 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 08:56:24.760610 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:56:25.215756 run create_hlr_db(pid=30800): Launched 08:56:25.327628 bus /sierra_2: Setting Powered False 08:56:26.385752 run create_hlr_db(pid=30800): Terminated: ok {rc=0} 08:56:26.814910 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30802): Launched 08:56:27.128322 run osmo-hlr_10.42.42.2(pid=30803): Launched 08:56:27.246870 run osmo-stp_10.42.42.5: Starting osmo-stp 08:56:27.786364 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30805): Launched 08:56:28.101714 run osmo-stp_10.42.42.5(pid=30806): Launched 08:56:28.230804 tst emergency_preemptive_call.py: using MSISDN 8602 08:56:28.392576 run osmo-msc_10.42.42.6: Starting osmo-msc 08:56:28.957528 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30808): Launched 08:56:29.272559 run osmo-msc_10.42.42.6(pid=30809): Launched 08:56:29.446392 run osmo-stp_10.42.42.5(pid=30806): ERR: Terminated: ERROR {rc=1} [trial-2402↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30806)] 08:56:29.578989 run osmo-stp_10.42.42.5(pid=30806): stdout: | (launched: 2022-12-14_08:56:28.044058) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:56:29.712055 run osmo-stp_10.42.42.5(pid=30806): stderr: | 20221214085628233 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214085628234 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214085628234 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214085628234 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214085628235 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214085628235 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214085628235 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:56:29.844630 run osmo-stp_10.42.42.5(pid=30806): stdout: | (launched: 2022-12-14_08:56:28.044058) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:56:29.969908 run osmo-stp_10.42.42.5(pid=30806): stderr: | 20221214085628233 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214085628234 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214085628234 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214085628234 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214085628235 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214085628235 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214085628235 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:56:30.119029 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=30806): Process ended prematurely: osmo-stp_10.42.42.5(pid=30806) [trial-2402↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30806)] [trial-2402↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32] 08:56:30.128387 tst emergency_preemptive_call.py:32: Test FAILED (6.4 sec) 08:56:30.155828 run osmo-hlr_10.42.42.2(pid=30803): ERR: Terminated: ERROR {rc=237} [trial-2402↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30803)] 08:56:30.206520 run osmo-hlr_10.42.42.2(pid=30803): stdout: | (launched: 2022-12-14_08:56:27.070849) 08:56:30.258768 run osmo-hlr_10.42.42.2(pid=30803): stderr: | 20221214085627266 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214085627267 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214085627267 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214085627267 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214085627267 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214085627267 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214085627280 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/emergency:trx-sysmocell5000/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214085627288 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214085627288 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214085627288 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:56:30.331737 run osmo-msc_10.42.42.6(pid=30809): ERR: Terminated: ERROR {rc=2} [trial-2402↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30809)] 08:56:30.381968 run osmo-msc_10.42.42.6(pid=30809): stdout: | (launched: 2022-12-14_08:56:29.214131) 08:56:30.433647 run osmo-msc_10.42.42.6(pid=30809): stderr: | 20221214085629534 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214085629534 DLGLOBAL DEBUG validating counter group 0x7fe393385c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214085629534 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214085629534 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214085629535 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214085629535 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214085629537 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214085629537 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214085629537 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214085629537 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:56:30.485715 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30802): Terminating (SIGTERM) 08:56:30.527164 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30805): Terminating (SIGTERM) 08:56:30.568797 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30808): Terminating (SIGTERM) 08:56:30.610868 --- ParallelTerminationStrategy: PID 30802 died... 08:56:30.631052 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30802): Terminated: ok {rc=0} 08:56:30.677130 --- ParallelTerminationStrategy: PID 30805 died... 08:56:30.696813 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30805): Terminated: ok {rc=0} 08:56:30.742712 --- ParallelTerminationStrategy: PID 30808 died... 08:56:30.762585 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30808): Terminated: ok {rc=0} 08:56:30.851450 bus /sierra_9: Setting Powered False 08:56:31.960902 bus /sierra_9: Setting Powered False 08:56:33.089168 bus /sierra_8: Setting Powered False 08:56:34.187668 bus /sierra_8: Setting Powered False 08:56:35.301820 bus /sierra_3: Setting Powered False 08:56:36.400326 bus /sierra_3: Setting Powered False 08:56:37.515338 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2402 emergency:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 gprs:trx-sysmocell5000 --------------------------------------------------------------------- 08:56:38.804826 tst gprs:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:56:38.809814 tst gprs:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 08:56:38.844175 tst gprs:trx-sysmocell5000: Verifying 9 x ip_address (candidates: 9) 08:56:38.883781 tst gprs:trx-sysmocell5000: Verifying 4 x modem (candidates: 12) 08:56:38.972003 tst gprs:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 08:56:39.006395 tst gprs:trx-sysmocell5000: Reserving 9 x ip_address (candidates: 9) 08:56:39.045259 tst gprs:trx-sysmocell5000: Reserving 4 x modem (candidates: 12) 08:56:39.640095 tst gprs:trx-sysmocell5000: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2402 gprs:trx-sysmocell5000 cs_paging_gprs_active.py ---------------------------------------------- 08:56:39.692497 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 08:56:39.703910 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 08:56:39.753664 tst cs_paging_gprs_active.py: using LAC 39812 08:56:39.871436 tst cs_paging_gprs_active.py: using RAC 32 08:56:39.991734 tst cs_paging_gprs_active.py: using CellId 39812 08:56:40.109865 tst cs_paging_gprs_active.py: using BVCI 39813 08:56:40.221602 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 08:56:40.232511 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 08:56:40.243272 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 08:56:40.254143 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 08:56:40.265177 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 08:56:40.276067 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 08:56:40.287215 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 08:56:40.298010 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 08:56:40.309072 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 08:56:40.428359 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 08:56:40.549873 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 08:56:40.767306 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:56:41.088747 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30814): Launched 08:56:41.369167 run iperf3-srv_10.42.42.10(pid=30815): Launched 08:56:41.489205 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 08:56:41.704889 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:56:42.027029 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30816): Launched 08:56:42.306283 run iperf3-srv_10.42.42.10(pid=30817): Launched 08:56:42.428469 tst cs_paging_gprs_active.py:38: start network... 08:56:42.644405 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:56:43.143978 run create_hlr_db(pid=30818): Launched 08:56:43.276062 bus /sierra_2: Setting Powered False 08:56:44.340369 run create_hlr_db(pid=30818): Terminated: ok {rc=0} 08:56:44.786941 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30820): Launched 08:56:45.110228 run osmo-hlr_10.42.42.2(pid=30821): Launched 08:56:45.234334 run osmo-stp_10.42.42.5: Starting osmo-stp 08:56:45.792508 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30823): Launched 08:56:46.131606 run osmo-stp_10.42.42.5(pid=30824): Launched 08:56:46.385694 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:56:46.991937 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30826): Launched 08:56:47.154448 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:56:47.414707 run patchelf(pid=30827): Launched 08:56:47.591693 run osmo-stp_10.42.42.5(pid=30824): ERR: Terminated: ERROR {rc=1} [trial-2402↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30824)] 08:56:47.727822 run osmo-stp_10.42.42.5(pid=30824): stdout: | (launched: 2022-12-14_08:56:46.072202) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:56:47.865540 run osmo-stp_10.42.42.5(pid=30824): stderr: | 20221214085646351 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214085646351 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214085646352 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214085646352 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214085646353 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214085646353 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214085646353 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:56:48.003436 run osmo-stp_10.42.42.5(pid=30824): stdout: | (launched: 2022-12-14_08:56:46.072202) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:56:48.136103 run osmo-stp_10.42.42.5(pid=30824): stderr: | 20221214085646351 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214085646351 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214085646352 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214085646352 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214085646353 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214085646353 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214085646353 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:56:48.292216 run patchelf(pid=30827): Terminating (SIGINT) 08:56:48.472218 run patchelf(pid=30827): Terminated: ok {rc=0} 08:56:48.601798 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=30824): Process ended prematurely: osmo-stp_10.42.42.5(pid=30824) [trial-2402↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30824)] [trial-2402↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38] 08:56:48.612448 tst cs_paging_gprs_active.py:38: Test FAILED (9.0 sec) 08:56:48.641051 run osmo-hlr_10.42.42.2(pid=30821): ERR: Terminated: ERROR {rc=237} [trial-2402↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30821)] 08:56:48.691000 run osmo-hlr_10.42.42.2(pid=30821): stdout: | (launched: 2022-12-14_08:56:45.051584) 08:56:48.742513 run osmo-hlr_10.42.42.2(pid=30821): stderr: | 20221214085645246 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214085645246 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214085645246 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214085645246 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214085645246 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214085645246 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214085645259 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/gprs:trx-sysmocell5000/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214085645267 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214085645268 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214085645268 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:56:48.794494 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30814): Terminating (SIGTERM) 08:56:48.836251 run iperf3-srv_10.42.42.10(pid=30815): Terminating (SIGTERM) 08:56:48.878172 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30816): Terminating (SIGTERM) 08:56:48.919848 run iperf3-srv_10.42.42.10(pid=30817): Terminating (SIGTERM) 08:56:48.961856 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30820): Terminating (SIGTERM) 08:56:49.003600 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30823): Terminating (SIGTERM) 08:56:49.045309 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30826): Terminating (SIGTERM) 08:56:49.087017 --- ParallelTerminationStrategy: PID 30814 died... 08:56:49.106958 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30814): Terminated: ok {rc=0} 08:56:49.153307 --- ParallelTerminationStrategy: PID 30815 died... 08:56:49.172745 run iperf3-srv_10.42.42.10(pid=30815): Terminated {rc=256} 08:56:49.218615 --- ParallelTerminationStrategy: PID 30816 died... 08:56:49.238365 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30816): Terminated: ok {rc=0} 08:56:49.284529 --- ParallelTerminationStrategy: PID 30817 died... 08:56:49.304485 run iperf3-srv_10.42.42.10(pid=30817): Terminated {rc=256} 08:56:49.350519 --- ParallelTerminationStrategy: PID 30820 died... 08:56:49.370395 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30820): Terminated: ok {rc=0} 08:56:49.416341 --- ParallelTerminationStrategy: PID 30823 died... 08:56:49.435924 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30823): Terminated: ok {rc=0} 08:56:49.481798 --- ParallelTerminationStrategy: PID 30826 died... 08:56:49.501476 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30826): Terminated: ok {rc=0} 08:56:49.589343 bus /gobi_0: Setting Powered False 08:56:50.688833 bus /gobi_0: Setting Powered False 08:56:51.806327 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2402 gprs:trx-sysmocell5000 iperf3.py ---------------------------------------------- 08:56:52.951600 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 08:56:52.963141 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 08:56:53.015669 tst iperf3.py: using LAC 39813 08:56:53.135140 tst iperf3.py: using RAC 33 08:56:53.253810 tst iperf3.py: using CellId 39813 08:56:53.372514 tst iperf3.py: using BVCI 39814 08:56:53.483854 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 08:56:53.494718 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 08:56:53.505273 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 08:56:53.515769 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 08:56:53.526313 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 08:56:53.537923 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 08:56:53.549282 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 08:56:53.563309 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 08:56:53.575217 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 08:56:53.692597 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 08:56:53.893732 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:56:54.194377 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30828): Launched 08:56:54.457261 run iperf3-srv_10.42.42.10(pid=30829): Launched 08:56:54.570159 tst iperf3.py:8: start network... 08:56:54.770678 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:56:55.237800 run create_hlr_db(pid=30830): Launched 08:56:55.352900 bus /gobi_6: Setting Powered False 08:56:56.412672 run create_hlr_db(pid=30830): Terminated: ok {rc=0} 08:56:56.832249 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30832): Launched 08:56:57.133212 run osmo-hlr_10.42.42.2(pid=30833): Launched 08:56:57.247866 run osmo-stp_10.42.42.5: Starting osmo-stp 08:56:57.779790 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30835): Launched 08:56:58.081194 run osmo-stp_10.42.42.5(pid=30836): Launched 08:56:58.196861 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:56:58.718368 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30838): Launched 08:56:58.835272 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:56:59.090050 run patchelf(pid=30839): Launched 08:56:59.257250 run osmo-stp_10.42.42.5(pid=30836): ERR: Terminated: ERROR {rc=1} [trial-2402↪gprs:trx-sysmocell5000↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30836)] 08:56:59.385875 run osmo-stp_10.42.42.5(pid=30836): stdout: | (launched: 2022-12-14_08:56:58.025742) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:56:59.515826 run osmo-stp_10.42.42.5(pid=30836): stderr: | 20221214085658194 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214085658194 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214085658194 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214085658195 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214085658195 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214085658195 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214085658195 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:56:59.646048 run osmo-stp_10.42.42.5(pid=30836): stdout: | (launched: 2022-12-14_08:56:58.025742) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:56:59.770425 run osmo-stp_10.42.42.5(pid=30836): stderr: | 20221214085658194 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214085658194 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214085658194 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214085658195 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214085658195 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214085658195 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214085658195 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:56:59.916833 run patchelf(pid=30839): Terminating (SIGINT) 08:57:00.085903 run patchelf(pid=30839): Terminated: ok {rc=0} 08:57:00.208279 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30836): Process ended prematurely: osmo-stp_10.42.42.5(pid=30836) [trial-2402↪gprs:trx-sysmocell5000↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30836)] [trial-2402↪gprs:trx-sysmocell5000↪iperf3.py:8] 08:57:00.218081 tst iperf3.py:8: Test FAILED (7.3 sec) 08:57:00.245461 run osmo-hlr_10.42.42.2(pid=30833): ERR: Terminated: ERROR {rc=237} [trial-2402↪gprs:trx-sysmocell5000↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30833)] 08:57:00.294446 run osmo-hlr_10.42.42.2(pid=30833): stdout: | (launched: 2022-12-14_08:56:57.077548) 08:57:00.344600 run osmo-hlr_10.42.42.2(pid=30833): stderr: | 20221214085657253 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214085657253 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214085657253 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214085657253 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214085657253 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214085657253 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214085657266 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/gprs:trx-sysmocell5000/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214085657276 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214085657276 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214085657276 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:57:00.395138 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30828): Terminating (SIGTERM) 08:57:00.435714 run iperf3-srv_10.42.42.10(pid=30829): Terminating (SIGTERM) 08:57:00.475859 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30832): Terminating (SIGTERM) 08:57:00.516444 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30835): Terminating (SIGTERM) 08:57:00.557022 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30838): Terminating (SIGTERM) 08:57:00.597731 --- ParallelTerminationStrategy: PID 30828 died... 08:57:00.617670 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30828): Terminated: ok {rc=0} 08:57:00.662853 --- ParallelTerminationStrategy: PID 30829 died... 08:57:00.682255 run iperf3-srv_10.42.42.10(pid=30829): Terminated {rc=256} 08:57:00.726871 --- ParallelTerminationStrategy: PID 30832 died... 08:57:00.746265 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30832): Terminated: ok {rc=0} 08:57:00.791123 --- ParallelTerminationStrategy: PID 30835 died... 08:57:00.810658 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30835): Terminated: ok {rc=0} 08:57:00.864166 --- ParallelTerminationStrategy: PID 30838 died... 08:57:00.888028 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30838): Terminated: ok {rc=0} 08:57:01.002232 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2402 gprs:trx-sysmocell5000 iperf3m4.py ---------------------------------------------- 08:57:02.199008 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 08:57:02.217786 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 08:57:02.286934 tst iperf3m4.py: using LAC 39814 08:57:02.417458 tst iperf3m4.py: using RAC 34 08:57:02.604651 tst iperf3m4.py: using CellId 39814 08:57:02.756721 tst iperf3m4.py: using BVCI 39815 08:57:02.893842 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 08:57:02.905820 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 08:57:02.917897 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 08:57:02.929690 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 08:57:02.942059 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 08:57:02.953887 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 08:57:02.966379 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 08:57:02.978253 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 08:57:02.991198 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 08:57:03.113529 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 08:57:03.238729 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 08:57:03.359074 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 08:57:03.486678 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 08:57:03.717913 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:57:04.025664 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30888): Launched 08:57:04.286556 run iperf3-srv_10.42.42.10(pid=30889): Launched 08:57:04.401274 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 08:57:04.602181 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:57:04.903425 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30890): Launched 08:57:05.164551 run iperf3-srv_10.42.42.10(pid=30891): Launched 08:57:05.278082 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 08:57:05.478490 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:57:05.780181 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30892): Launched 08:57:06.041376 run iperf3-srv_10.42.42.10(pid=30893): Launched 08:57:06.154129 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 08:57:06.354318 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:57:06.655973 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30894): Launched 08:57:06.917234 run iperf3-srv_10.42.42.10(pid=30895): Launched 08:57:07.029639 tst iperf3m4.py:8: start network... 08:57:07.229258 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:57:07.694717 run create_hlr_db(pid=30896): Launched 08:57:07.808249 bus /gobi_6: Setting Powered False 08:57:08.867453 run create_hlr_db(pid=30896): Terminated: ok {rc=0} 08:57:09.285602 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30898): Launched 08:57:09.586904 run osmo-hlr_10.42.42.2(pid=30899): Launched 08:57:09.701848 run osmo-stp_10.42.42.5: Starting osmo-stp 08:57:10.226412 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30901): Launched 08:57:10.527595 run osmo-stp_10.42.42.5(pid=30902): Launched 08:57:10.643341 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:57:11.168516 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30904): Launched 08:57:11.284826 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:57:11.542040 run patchelf(pid=30905): Launched 08:57:11.710476 run osmo-stp_10.42.42.5(pid=30902): ERR: Terminated: ERROR {rc=1} [trial-2402↪gprs:trx-sysmocell5000↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30902)] 08:57:11.839047 run osmo-stp_10.42.42.5(pid=30902): stdout: | (launched: 2022-12-14_08:57:10.471416) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:57:11.968758 run osmo-stp_10.42.42.5(pid=30902): stderr: | 20221214085710639 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214085710639 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214085710639 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214085710640 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214085710640 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214085710640 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214085710640 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:57:12.098946 run osmo-stp_10.42.42.5(pid=30902): stdout: | (launched: 2022-12-14_08:57:10.471416) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:57:12.223598 run osmo-stp_10.42.42.5(pid=30902): stderr: | 20221214085710639 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214085710639 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214085710639 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214085710640 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214085710640 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214085710640 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214085710640 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:57:12.370894 run patchelf(pid=30905): Terminating (SIGINT) 08:57:12.540637 run patchelf(pid=30905): Terminated: ok {rc=0} 08:57:12.663204 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30902): Process ended prematurely: osmo-stp_10.42.42.5(pid=30902) [trial-2402↪gprs:trx-sysmocell5000↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30902)] [trial-2402↪gprs:trx-sysmocell5000↪iperf3m4.py:8] 08:57:12.672800 tst iperf3m4.py:8: Test FAILED (10.5 sec) 08:57:12.700300 run osmo-hlr_10.42.42.2(pid=30899): ERR: Terminated: ERROR {rc=237} [trial-2402↪gprs:trx-sysmocell5000↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30899)] 08:57:12.749052 run osmo-hlr_10.42.42.2(pid=30899): stdout: | (launched: 2022-12-14_08:57:09.531150) 08:57:12.799191 run osmo-hlr_10.42.42.2(pid=30899): stderr: | 20221214085709704 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214085709704 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214085709704 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214085709704 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214085709704 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214085709704 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214085709715 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/gprs:trx-sysmocell5000/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214085709724 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214085709724 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214085709724 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:57:12.849897 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30888): Terminating (SIGTERM) 08:57:12.890470 run iperf3-srv_10.42.42.10(pid=30889): Terminating (SIGTERM) 08:57:12.930758 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30890): Terminating (SIGTERM) 08:57:12.971424 run iperf3-srv_10.42.42.10(pid=30891): Terminating (SIGTERM) 08:57:13.011658 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30892): Terminating (SIGTERM) 08:57:13.051996 run iperf3-srv_10.42.42.10(pid=30893): Terminating (SIGTERM) 08:57:13.092025 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30894): Terminating (SIGTERM) 08:57:13.132334 run iperf3-srv_10.42.42.10(pid=30895): Terminating (SIGTERM) 08:57:13.172460 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30898): Terminating (SIGTERM) 08:57:13.212837 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30901): Terminating (SIGTERM) 08:57:13.253143 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30904): Terminating (SIGTERM) 08:57:13.293713 --- ParallelTerminationStrategy: PID 30888 died... 08:57:13.313487 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30888): Terminated: ok {rc=0} 08:57:13.357626 --- ParallelTerminationStrategy: PID 30889 died... 08:57:13.376480 run iperf3-srv_10.42.42.10(pid=30889): Terminated {rc=256} 08:57:13.420376 --- ParallelTerminationStrategy: PID 30890 died... 08:57:13.439501 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30890): Terminated: ok {rc=0} 08:57:13.483551 --- ParallelTerminationStrategy: PID 30891 died... 08:57:13.502611 run iperf3-srv_10.42.42.10(pid=30891): Terminated {rc=256} 08:57:13.546603 --- ParallelTerminationStrategy: PID 30892 died... 08:57:13.565650 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30892): Terminated: ok {rc=0} 08:57:13.609695 --- ParallelTerminationStrategy: PID 30893 died... 08:57:13.628686 run iperf3-srv_10.42.42.10(pid=30893): Terminated {rc=256} 08:57:13.672718 --- ParallelTerminationStrategy: PID 30894 died... 08:57:13.691887 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30894): Terminated: ok {rc=0} 08:57:13.735782 --- ParallelTerminationStrategy: PID 30895 died... 08:57:13.754865 run iperf3-srv_10.42.42.10(pid=30895): Terminated {rc=256} 08:57:13.798699 --- ParallelTerminationStrategy: PID 30898 died... 08:57:13.817954 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30898): Terminated: ok {rc=0} 08:57:13.862095 --- ParallelTerminationStrategy: PID 30901 died... 08:57:13.881304 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30901): Terminated: ok {rc=0} 08:57:13.925402 --- ParallelTerminationStrategy: PID 30904 died... 08:57:13.944498 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30904): Terminated: ok {rc=0} 08:57:14.030866 bus /gobi_4: Setting Powered False 08:57:15.131294 bus /gobi_4: Setting Powered False 08:57:16.248537 bus /gobi_1: Setting Powered False 08:57:17.360593 bus /gobi_1: Setting Powered False 08:57:18.477295 bus /gobi_0: Setting Powered False 08:57:19.577205 bus /gobi_0: Setting Powered False 08:57:20.695384 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2402 gprs:trx-sysmocell5000 ping.py ---------------------------------------------- 08:57:21.799380 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 08:57:21.811483 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 08:57:21.861997 tst ping.py: using LAC 39815 08:57:21.979638 tst ping.py: using RAC 35 08:57:22.098361 tst ping.py: using CellId 39815 08:57:22.215782 tst ping.py: using BVCI 39816 08:57:22.325406 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 08:57:22.336249 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 08:57:22.347248 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 08:57:22.357845 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 08:57:22.368638 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 08:57:22.380006 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 08:57:22.391433 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 08:57:22.402573 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 08:57:22.522064 tst ping.py:19: start network... 08:57:22.736378 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:57:23.228473 run create_hlr_db(pid=30906): Launched 08:57:23.358470 bus /gobi_6: Setting Powered False 08:57:24.421304 run create_hlr_db(pid=30906): Terminated: ok {rc=0} 08:57:24.846020 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30908): Launched 08:57:25.142733 run osmo-hlr_10.42.42.2(pid=30909): Launched 08:57:25.255317 run osmo-stp_10.42.42.5: Starting osmo-stp 08:57:25.782237 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30911): Launched 08:57:26.079995 run osmo-stp_10.42.42.5(pid=30912): Launched 08:57:26.192841 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:57:26.706324 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30914): Launched 08:57:26.819739 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:57:27.071321 run patchelf(pid=30915): Launched 08:57:27.237593 run osmo-stp_10.42.42.5(pid=30912): ERR: Terminated: ERROR {rc=1} [trial-2402↪gprs:trx-sysmocell5000↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30912)] 08:57:27.364318 run osmo-stp_10.42.42.5(pid=30912): stdout: | (launched: 2022-12-14_08:57:26.025029) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:57:27.492424 run osmo-stp_10.42.42.5(pid=30912): stderr: | 20221214085726194 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214085726195 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214085726195 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214085726195 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214085726196 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214085726196 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214085726196 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:57:27.621041 run osmo-stp_10.42.42.5(pid=30912): stdout: | (launched: 2022-12-14_08:57:26.025029) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:57:27.743704 run osmo-stp_10.42.42.5(pid=30912): stderr: | 20221214085726194 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214085726195 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214085726195 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214085726195 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214085726196 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214085726196 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214085726196 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:57:27.888692 run patchelf(pid=30915): Terminating (SIGINT) 08:57:28.055222 run patchelf(pid=30915): Terminated: ok {rc=0} 08:57:28.175124 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=30912): Process ended prematurely: osmo-stp_10.42.42.5(pid=30912) [trial-2402↪gprs:trx-sysmocell5000↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30912)] [trial-2402↪gprs:trx-sysmocell5000↪ping.py:22] 08:57:28.184179 tst ping.py:22: Test FAILED (6.4 sec) 08:57:28.211228 run osmo-hlr_10.42.42.2(pid=30909): ERR: Terminated: ERROR {rc=237} [trial-2402↪gprs:trx-sysmocell5000↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30909)] 08:57:28.259937 run osmo-hlr_10.42.42.2(pid=30909): stdout: | (launched: 2022-12-14_08:57:25.087767) 08:57:28.310364 run osmo-hlr_10.42.42.2(pid=30909): stderr: | 20221214085725263 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214085725263 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214085725263 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214085725263 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214085725263 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214085725263 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214085725276 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/gprs:trx-sysmocell5000/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214085725286 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214085725286 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214085725286 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:57:28.360867 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30908): Terminating (SIGTERM) 08:57:28.401600 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30911): Terminating (SIGTERM) 08:57:28.442254 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30914): Terminating (SIGTERM) 08:57:28.482949 --- ParallelTerminationStrategy: PID 30908 died... 08:57:28.502694 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30908): Terminated: ok {rc=0} 08:57:28.547418 --- ParallelTerminationStrategy: PID 30911 died... 08:57:28.566663 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30911): Terminated: ok {rc=0} 08:57:28.611270 --- ParallelTerminationStrategy: PID 30914 died... 08:57:28.630363 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30914): Terminated: ok {rc=0} 08:57:28.714721 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2402 gprs:trx-sysmocell5000 ping_idle_ping.py ---------------------------------------------- 08:57:29.802258 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 08:57:29.814487 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 08:57:29.866186 tst ping_idle_ping.py: using LAC 39816 08:57:29.990211 tst ping_idle_ping.py: using RAC 36 08:57:30.108678 tst ping_idle_ping.py: using CellId 39816 08:57:30.223805 tst ping_idle_ping.py: using BVCI 39817 08:57:30.332255 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 08:57:30.343164 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 08:57:30.353850 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 08:57:30.364376 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 08:57:30.374929 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 08:57:30.386831 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 08:57:30.398316 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 08:57:30.409303 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 08:57:30.530286 tst ping_idle_ping.py:24: start network... 08:57:30.745584 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:57:31.270603 run create_hlr_db(pid=30916): Launched 08:57:31.421580 bus /gobi_6: Setting Powered False 08:57:32.485685 run create_hlr_db(pid=30916): Terminated: ok {rc=0} 08:57:32.918123 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30918): Launched 08:57:33.218101 run osmo-hlr_10.42.42.2(pid=30919): Launched 08:57:33.332129 run osmo-stp_10.42.42.5: Starting osmo-stp 08:57:33.859768 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30921): Launched 08:57:34.157698 run osmo-stp_10.42.42.5(pid=30922): Launched 08:57:34.270495 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:57:34.784699 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30924): Launched 08:57:34.898941 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:57:35.150294 run patchelf(pid=30925): Launched 08:57:35.316279 run osmo-stp_10.42.42.5(pid=30922): ERR: Terminated: ERROR {rc=1} [trial-2402↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30922)] 08:57:35.442638 run osmo-stp_10.42.42.5(pid=30922): stdout: | (launched: 2022-12-14_08:57:34.102590) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:57:35.570467 run osmo-stp_10.42.42.5(pid=30922): stderr: | 20221214085734273 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214085734273 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214085734274 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214085734274 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214085734275 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214085734275 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214085734275 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:57:35.699321 run osmo-stp_10.42.42.5(pid=30922): stdout: | (launched: 2022-12-14_08:57:34.102590) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:57:35.821755 run osmo-stp_10.42.42.5(pid=30922): stderr: | 20221214085734273 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214085734273 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214085734274 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214085734274 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214085734275 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214085734275 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214085734275 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:57:35.966566 run patchelf(pid=30925): Terminating (SIGINT) 08:57:36.133674 run patchelf(pid=30925): Terminated: ok {rc=0} 08:57:36.254178 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=30922): Process ended prematurely: osmo-stp_10.42.42.5(pid=30922) [trial-2402↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30922)] [trial-2402↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27] 08:57:36.263113 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 08:57:36.289815 run osmo-hlr_10.42.42.2(pid=30919): ERR: Terminated: ERROR {rc=237} [trial-2402↪gprs:trx-sysmocell5000↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30919)] 08:57:36.338124 run osmo-hlr_10.42.42.2(pid=30919): stdout: | (launched: 2022-12-14_08:57:33.162167) 08:57:36.387790 run osmo-hlr_10.42.42.2(pid=30919): stderr: | 20221214085733337 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214085733337 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214085733337 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214085733337 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214085733337 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214085733337 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214085733349 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/gprs:trx-sysmocell5000/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214085733358 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214085733358 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214085733358 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:57:36.437978 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30918): Terminating (SIGTERM) 08:57:36.478273 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30921): Terminating (SIGTERM) 08:57:36.518278 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30924): Terminating (SIGTERM) 08:57:36.558627 --- ParallelTerminationStrategy: PID 30918 died... 08:57:36.578239 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30918): Terminated: ok {rc=0} 08:57:36.622654 --- ParallelTerminationStrategy: PID 30921 died... 08:57:36.641727 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30921): Terminated: ok {rc=0} 08:57:36.686254 --- ParallelTerminationStrategy: PID 30924 died... 08:57:36.705359 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30924): Terminated: ok {rc=0} 08:57:36.791931 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2402 gprs:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 gprs:trx-sysmocell5000+mod-bts0-egprs --------------------------------------------------------------------- 08:57:38.107365 tst gprs:trx-sysmocell5000+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:57:38.113889 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 08:57:38.146809 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 08:57:38.186697 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 08:57:38.273401 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 08:57:38.306279 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 08:57:38.344201 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 08:57:38.938763 tst gprs:trx-sysmocell5000+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2402 gprs:trx-sysmocell5000+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 08:57:38.987563 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:57:38.998695 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 08:57:39.049703 tst cs_paging_gprs_active.py: using LAC 39817 08:57:39.177724 tst cs_paging_gprs_active.py: using RAC 37 08:57:39.299019 tst cs_paging_gprs_active.py: using CellId 39817 08:57:39.419733 tst cs_paging_gprs_active.py: using BVCI 39818 08:57:39.532057 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:57:39.543065 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:57:39.553910 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:57:39.564597 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:57:39.575532 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:57:39.587870 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:57:39.599636 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:57:39.611088 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:57:39.622806 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 08:57:39.746442 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 08:57:39.864252 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 08:57:40.068923 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:57:40.374174 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30930): Launched 08:57:40.639739 run iperf3-srv_10.42.42.10(pid=30931): Launched 08:57:40.753859 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 08:57:40.957183 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:57:41.263134 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30932): Launched 08:57:41.528285 run iperf3-srv_10.42.42.10(pid=30933): Launched 08:57:41.642197 tst cs_paging_gprs_active.py:38: start network... 08:57:41.845606 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:57:42.318529 run create_hlr_db(pid=30934): Launched 08:57:42.435224 bus /gobi_6: Setting Powered False 08:57:43.495302 run create_hlr_db(pid=30934): Terminated: ok {rc=0} 08:57:43.941172 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30936): Launched 08:57:44.266522 run osmo-hlr_10.42.42.2(pid=30937): Launched 08:57:44.393032 run osmo-stp_10.42.42.5: Starting osmo-stp 08:57:44.958567 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30939): Launched 08:57:45.286435 run osmo-stp_10.42.42.5(pid=30940): Launched 08:57:45.412250 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:57:46.005956 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30942): Launched 08:57:46.146559 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:57:46.431088 run patchelf(pid=30943): Launched 08:57:46.615331 run osmo-stp_10.42.42.5(pid=30940): ERR: Terminated: ERROR {rc=1} [trial-2402↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30940)] 08:57:46.755964 run osmo-stp_10.42.42.5(pid=30940): stdout: | (launched: 2022-12-14_08:57:45.226541) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:57:46.897227 run osmo-stp_10.42.42.5(pid=30940): stderr: | 20221214085745419 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214085745419 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214085745419 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214085745420 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214085745420 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214085745420 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214085745420 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:57:47.039190 run osmo-stp_10.42.42.5(pid=30940): stdout: | (launched: 2022-12-14_08:57:45.226541) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:57:47.175565 run osmo-stp_10.42.42.5(pid=30940): stderr: | 20221214085745419 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214085745419 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214085745419 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214085745420 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214085745420 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214085745420 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214085745420 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:57:47.335240 run patchelf(pid=30943): Terminating (SIGINT) 08:57:47.517176 run patchelf(pid=30943): Terminated: ok {rc=0} 08:57:47.648580 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=30940): Process ended prematurely: osmo-stp_10.42.42.5(pid=30940) [trial-2402↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30940)] [trial-2402↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 08:57:47.659440 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 08:57:47.688320 run osmo-hlr_10.42.42.2(pid=30937): ERR: Terminated: ERROR {rc=237} [trial-2402↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30937)] 08:57:47.738780 run osmo-hlr_10.42.42.2(pid=30937): stdout: | (launched: 2022-12-14_08:57:44.206981) 08:57:47.791210 run osmo-hlr_10.42.42.2(pid=30937): stderr: | 20221214085744404 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214085744404 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214085744404 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214085744404 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214085744404 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214085744404 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214085744416 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/gprs:trx-sysmocell5000+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214085744426 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214085744427 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214085744427 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:57:47.843652 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30930): Terminating (SIGTERM) 08:57:47.885726 run iperf3-srv_10.42.42.10(pid=30931): Terminating (SIGTERM) 08:57:47.927916 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30932): Terminating (SIGTERM) 08:57:47.970799 run iperf3-srv_10.42.42.10(pid=30933): Terminating (SIGTERM) 08:57:48.013603 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30936): Terminating (SIGTERM) 08:57:48.056080 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30939): Terminating (SIGTERM) 08:57:48.098504 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30942): Terminating (SIGTERM) 08:57:48.140771 --- ParallelTerminationStrategy: PID 30930 died... 08:57:48.161202 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30930): Terminated: ok {rc=0} 08:57:48.208010 --- ParallelTerminationStrategy: PID 30931 died... 08:57:48.228022 run iperf3-srv_10.42.42.10(pid=30931): Terminated {rc=256} 08:57:48.274631 --- ParallelTerminationStrategy: PID 30932 died... 08:57:48.294602 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30932): Terminated: ok {rc=0} 08:57:48.341383 --- ParallelTerminationStrategy: PID 30933 died... 08:57:48.361477 run iperf3-srv_10.42.42.10(pid=30933): Terminated {rc=256} 08:57:48.407973 --- ParallelTerminationStrategy: PID 30936 died... 08:57:48.427968 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30936): Terminated: ok {rc=0} 08:57:48.475004 --- ParallelTerminationStrategy: PID 30939 died... 08:57:48.495033 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30939): Terminated: ok {rc=0} 08:57:48.541599 --- ParallelTerminationStrategy: PID 30942 died... 08:57:48.561715 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30942): Terminated: ok {rc=0} 08:57:48.650674 bus /gobi_0: Setting Powered False 08:57:49.750593 bus /gobi_0: Setting Powered False 08:57:50.867229 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2402 gprs:trx-sysmocell5000+mod-bts0-egprs iperf3.py ---------------------------------------------- 08:57:52.016805 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:57:52.029131 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 08:57:52.084283 tst iperf3.py: using LAC 39818 08:57:52.213035 tst iperf3.py: using RAC 38 08:57:52.339696 tst iperf3.py: using CellId 39818 08:57:52.466758 tst iperf3.py: using BVCI 39819 08:57:52.586259 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:57:52.597919 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:57:52.609211 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:57:52.620446 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:57:52.631742 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:57:52.643056 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:57:52.654541 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:57:52.666075 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:57:52.677651 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 08:57:52.795089 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 08:57:52.998222 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:57:53.302749 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30944): Launched 08:57:53.566233 run iperf3-srv_10.42.42.10(pid=30945): Launched 08:57:53.682020 tst iperf3.py:8: start network... 08:57:53.884510 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:57:54.356530 run create_hlr_db(pid=30946): Launched 08:57:54.474172 bus /gobi_6: Setting Powered False 08:57:55.534276 run create_hlr_db(pid=30946): Terminated: ok {rc=0} 08:57:55.978165 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30948): Launched 08:57:56.304386 run osmo-hlr_10.42.42.2(pid=30949): Launched 08:57:56.430361 run osmo-stp_10.42.42.5: Starting osmo-stp 08:57:56.998913 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30951): Launched 08:57:57.323065 run osmo-stp_10.42.42.5(pid=30952): Launched 08:57:57.447455 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:57:58.011756 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30954): Launched 08:57:58.135331 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:57:58.409564 run patchelf(pid=30955): Launched 08:57:58.589428 run osmo-stp_10.42.42.5(pid=30952): ERR: Terminated: ERROR {rc=1} [trial-2402↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30952)] 08:57:58.726569 run osmo-stp_10.42.42.5(pid=30952): stdout: | (launched: 2022-12-14_08:57:57.263366) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:57:58.865357 run osmo-stp_10.42.42.5(pid=30952): stderr: | 20221214085757454 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214085757454 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214085757454 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214085757455 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214085757455 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214085757455 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214085757455 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:57:59.003961 run osmo-stp_10.42.42.5(pid=30952): stdout: | (launched: 2022-12-14_08:57:57.263366) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:57:59.137128 run osmo-stp_10.42.42.5(pid=30952): stderr: | 20221214085757454 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214085757454 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214085757454 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214085757455 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214085757455 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214085757455 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214085757455 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:57:59.294227 run patchelf(pid=30955): Terminating (SIGINT) 08:57:59.474834 run patchelf(pid=30955): Terminated: ok {rc=0} 08:57:59.604928 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30952): Process ended prematurely: osmo-stp_10.42.42.5(pid=30952) [trial-2402↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30952)] [trial-2402↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8] 08:57:59.615210 tst iperf3.py:8: Test FAILED (7.6 sec) 08:57:59.643552 run osmo-hlr_10.42.42.2(pid=30949): ERR: Terminated: ERROR {rc=237} [trial-2402↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30949)] 08:57:59.693632 run osmo-hlr_10.42.42.2(pid=30949): stdout: | (launched: 2022-12-14_08:57:56.245096) 08:57:59.745457 run osmo-hlr_10.42.42.2(pid=30949): stderr: | 20221214085756441 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214085756441 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214085756441 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214085756441 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214085756441 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214085756441 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214085756453 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/gprs:trx-sysmocell5000+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214085756462 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214085756462 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214085756462 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:57:59.797841 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30944): Terminating (SIGTERM) 08:57:59.839674 run iperf3-srv_10.42.42.10(pid=30945): Terminating (SIGTERM) 08:57:59.881737 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30948): Terminating (SIGTERM) 08:57:59.923227 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30951): Terminating (SIGTERM) 08:57:59.964619 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30954): Terminating (SIGTERM) 08:58:00.006567 --- ParallelTerminationStrategy: PID 30944 died... 08:58:00.026249 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30944): Terminated: ok {rc=0} 08:58:00.071962 --- ParallelTerminationStrategy: PID 30945 died... 08:58:00.091305 run iperf3-srv_10.42.42.10(pid=30945): Terminated {rc=256} 08:58:00.136589 --- ParallelTerminationStrategy: PID 30948 died... 08:58:00.155925 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30948): Terminated: ok {rc=0} 08:58:00.201587 --- ParallelTerminationStrategy: PID 30951 died... 08:58:00.221186 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30951): Terminated: ok {rc=0} 08:58:00.266933 --- ParallelTerminationStrategy: PID 30954 died... 08:58:00.286374 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30954): Terminated: ok {rc=0} 08:58:00.374148 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2402 gprs:trx-sysmocell5000+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 08:58:01.522031 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:58:01.534429 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 08:58:01.585878 tst iperf3m4.py: using LAC 39819 08:58:01.710693 tst iperf3m4.py: using RAC 39 08:58:01.869655 tst iperf3m4.py: using CellId 39819 08:58:02.040455 tst iperf3m4.py: using BVCI 39820 08:58:02.153886 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:58:02.165903 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:58:02.177633 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:58:02.189382 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:58:02.201445 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:58:02.213558 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:58:02.225804 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:58:02.237851 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:58:02.250021 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 08:58:02.370355 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 08:58:02.494416 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 08:58:02.612547 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 08:58:02.730219 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 08:58:02.934150 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:58:03.240356 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30956): Launched 08:58:03.504715 run iperf3-srv_10.42.42.10(pid=30957): Launched 08:58:03.619156 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 08:58:03.822391 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:58:04.128537 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30958): Launched 08:58:04.392533 run iperf3-srv_10.42.42.10(pid=30959): Launched 08:58:04.506516 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 08:58:04.709924 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:58:05.015209 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30960): Launched 08:58:05.278377 run iperf3-srv_10.42.42.10(pid=30961): Launched 08:58:05.393541 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 08:58:05.596003 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:58:05.900780 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30962): Launched 08:58:06.165299 run iperf3-srv_10.42.42.10(pid=30963): Launched 08:58:06.279481 tst iperf3m4.py:8: start network... 08:58:06.481955 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:58:06.952292 run create_hlr_db(pid=30964): Launched 08:58:07.067729 bus /gobi_6: Setting Powered False 08:58:08.128221 run create_hlr_db(pid=30964): Terminated: ok {rc=0} 08:58:08.549688 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30966): Launched 08:58:08.852534 run osmo-hlr_10.42.42.2(pid=30967): Launched 08:58:08.968094 run osmo-stp_10.42.42.5: Starting osmo-stp 08:58:09.505652 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30969): Launched 08:58:09.810260 run osmo-stp_10.42.42.5(pid=30970): Launched 08:58:09.926309 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:58:10.450314 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30972): Launched 08:58:10.566318 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:58:10.823681 run patchelf(pid=30973): Launched 08:58:10.993370 run osmo-stp_10.42.42.5(pid=30970): ERR: Terminated: ERROR {rc=1} [trial-2402↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30970)] 08:58:11.121750 run osmo-stp_10.42.42.5(pid=30970): stdout: | (launched: 2022-12-14_08:58:09.753007) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:58:11.252315 run osmo-stp_10.42.42.5(pid=30970): stderr: | 20221214085809921 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214085809921 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214085809921 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214085809922 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214085809922 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214085809922 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214085809922 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:58:11.382410 run osmo-stp_10.42.42.5(pid=30970): stdout: | (launched: 2022-12-14_08:58:09.753007) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:58:11.506949 run osmo-stp_10.42.42.5(pid=30970): stderr: | 20221214085809921 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214085809921 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214085809921 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214085809922 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214085809922 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214085809922 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214085809922 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:58:11.654150 run patchelf(pid=30973): Terminating (SIGINT) 08:58:11.823415 run patchelf(pid=30973): Terminated: ok {rc=0} 08:58:11.945618 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30970): Process ended prematurely: osmo-stp_10.42.42.5(pid=30970) [trial-2402↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30970)] [trial-2402↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8] 08:58:11.955280 tst iperf3m4.py:8: Test FAILED (10.5 sec) 08:58:11.982812 run osmo-hlr_10.42.42.2(pid=30967): ERR: Terminated: ERROR {rc=237} [trial-2402↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30967)] 08:58:12.031247 run osmo-hlr_10.42.42.2(pid=30967): stdout: | (launched: 2022-12-14_08:58:08.796294) 08:58:12.081269 run osmo-hlr_10.42.42.2(pid=30967): stderr: | 20221214085808967 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214085808967 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214085808967 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214085808967 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214085808967 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214085808967 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214085808979 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/gprs:trx-sysmocell5000+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214085808987 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214085808987 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214085808987 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:58:12.131475 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30956): Terminating (SIGTERM) 08:58:12.171677 run iperf3-srv_10.42.42.10(pid=30957): Terminating (SIGTERM) 08:58:12.211183 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30958): Terminating (SIGTERM) 08:58:12.251034 run iperf3-srv_10.42.42.10(pid=30959): Terminating (SIGTERM) 08:58:12.290487 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30960): Terminating (SIGTERM) 08:58:12.330122 run iperf3-srv_10.42.42.10(pid=30961): Terminating (SIGTERM) 08:58:12.369664 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30962): Terminating (SIGTERM) 08:58:12.409570 run iperf3-srv_10.42.42.10(pid=30963): Terminating (SIGTERM) 08:58:12.449297 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30966): Terminating (SIGTERM) 08:58:12.489014 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30969): Terminating (SIGTERM) 08:58:12.528734 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30972): Terminating (SIGTERM) 08:58:12.568820 --- ParallelTerminationStrategy: PID 30956 died... 08:58:12.588278 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30956): Terminated: ok {rc=0} 08:58:12.632319 --- ParallelTerminationStrategy: PID 30957 died... 08:58:12.651082 run iperf3-srv_10.42.42.10(pid=30957): Terminated {rc=256} 08:58:12.695004 --- ParallelTerminationStrategy: PID 30958 died... 08:58:12.713803 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30958): Terminated: ok {rc=0} 08:58:12.757498 --- ParallelTerminationStrategy: PID 30959 died... 08:58:12.776236 run iperf3-srv_10.42.42.10(pid=30959): Terminated {rc=256} 08:58:12.820110 --- ParallelTerminationStrategy: PID 30960 died... 08:58:12.839053 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30960): Terminated: ok {rc=0} 08:58:12.882789 --- ParallelTerminationStrategy: PID 30961 died... 08:58:12.901495 run iperf3-srv_10.42.42.10(pid=30961): Terminated {rc=256} 08:58:12.945233 --- ParallelTerminationStrategy: PID 30962 died... 08:58:12.963926 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30962): Terminated: ok {rc=0} 08:58:13.007952 --- ParallelTerminationStrategy: PID 30963 died... 08:58:13.026971 run iperf3-srv_10.42.42.10(pid=30963): Terminated {rc=256} 08:58:13.070790 --- ParallelTerminationStrategy: PID 30966 died... 08:58:13.089684 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30966): Terminated: ok {rc=0} 08:58:13.133651 --- ParallelTerminationStrategy: PID 30969 died... 08:58:13.152530 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30969): Terminated: ok {rc=0} 08:58:13.197125 --- ParallelTerminationStrategy: PID 30972 died... 08:58:13.216283 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30972): Terminated: ok {rc=0} 08:58:13.303330 bus /gobi_4: Setting Powered False 08:58:14.402860 bus /gobi_4: Setting Powered False 08:58:15.517899 bus /gobi_1: Setting Powered False 08:58:16.619074 bus /gobi_1: Setting Powered False 08:58:17.737821 bus /gobi_0: Setting Powered False 08:58:18.836310 bus /gobi_0: Setting Powered False 08:58:19.953476 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2402 gprs:trx-sysmocell5000+mod-bts0-egprs ping.py ---------------------------------------------- 08:58:21.057641 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:58:21.070124 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 08:58:21.128545 tst ping.py: using LAC 39820 08:58:21.267946 tst ping.py: using RAC 40 08:58:21.393385 tst ping.py: using CellId 39820 08:58:21.516675 tst ping.py: using BVCI 39821 08:58:21.632564 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:58:21.644719 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:58:21.656383 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:58:21.667898 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:58:21.679466 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:58:21.691042 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:58:21.702884 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:58:21.714640 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 08:58:21.832048 tst ping.py:19: start network... 08:58:22.031928 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:58:22.495180 run create_hlr_db(pid=30974): Launched 08:58:22.618331 bus /gobi_6: Setting Powered False 08:58:23.681867 run create_hlr_db(pid=30974): Terminated: ok {rc=0} 08:58:24.109728 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30976): Launched 08:58:24.408560 run osmo-hlr_10.42.42.2(pid=30977): Launched 08:58:24.522807 run osmo-stp_10.42.42.5: Starting osmo-stp 08:58:25.038844 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30979): Launched 08:58:25.337350 run osmo-stp_10.42.42.5(pid=30980): Launched 08:58:25.451076 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:58:25.966758 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30982): Launched 08:58:26.081299 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:58:26.333484 run patchelf(pid=30983): Launched 08:58:26.499551 run osmo-stp_10.42.42.5(pid=30980): ERR: Terminated: ERROR {rc=1} [trial-2402↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30980)] 08:58:26.625818 run osmo-stp_10.42.42.5(pid=30980): stdout: | (launched: 2022-12-14_08:58:25.281673) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:58:26.753661 run osmo-stp_10.42.42.5(pid=30980): stderr: | 20221214085825450 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214085825451 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214085825451 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214085825451 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214085825452 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214085825452 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214085825452 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:58:26.881537 run osmo-stp_10.42.42.5(pid=30980): stdout: | (launched: 2022-12-14_08:58:25.281673) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:58:27.003591 run osmo-stp_10.42.42.5(pid=30980): stderr: | 20221214085825450 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214085825451 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214085825451 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214085825451 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214085825452 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214085825452 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214085825452 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:58:27.148188 run patchelf(pid=30983): Terminating (SIGINT) 08:58:27.315475 run patchelf(pid=30983): Terminated: ok {rc=0} 08:58:27.435637 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=30980): Process ended prematurely: osmo-stp_10.42.42.5(pid=30980) [trial-2402↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30980)] [trial-2402↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22] 08:58:27.444624 tst ping.py:22: Test FAILED (6.4 sec) 08:58:27.471452 run osmo-hlr_10.42.42.2(pid=30977): ERR: Terminated: ERROR {rc=237} [trial-2402↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30977)] 08:58:27.520135 run osmo-hlr_10.42.42.2(pid=30977): stdout: | (launched: 2022-12-14_08:58:24.353168) 08:58:27.569960 run osmo-hlr_10.42.42.2(pid=30977): stderr: | 20221214085824527 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214085824527 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214085824527 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214085824527 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214085824527 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214085824528 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214085824539 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/gprs:trx-sysmocell5000+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214085824549 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214085824549 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214085824549 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:58:27.620256 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30976): Terminating (SIGTERM) 08:58:27.660657 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30979): Terminating (SIGTERM) 08:58:27.700918 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30982): Terminating (SIGTERM) 08:58:27.741317 --- ParallelTerminationStrategy: PID 30976 died... 08:58:27.760880 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30976): Terminated: ok {rc=0} 08:58:27.805512 --- ParallelTerminationStrategy: PID 30979 died... 08:58:27.824430 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30979): Terminated: ok {rc=0} 08:58:27.868909 --- ParallelTerminationStrategy: PID 30982 died... 08:58:27.888414 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30982): Terminated: ok {rc=0} 08:58:27.975137 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2402 gprs:trx-sysmocell5000+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 08:58:29.064124 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:58:29.076033 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 08:58:29.130675 tst ping_idle_ping.py: using LAC 39821 08:58:29.250008 tst ping_idle_ping.py: using RAC 41 08:58:29.369827 tst ping_idle_ping.py: using CellId 39821 08:58:29.492463 tst ping_idle_ping.py: using BVCI 39822 08:58:29.602273 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:58:29.613508 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:58:29.624384 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:58:29.635207 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:58:29.646812 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:58:29.658456 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:58:29.670426 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:58:29.682078 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 08:58:29.798744 tst ping_idle_ping.py:24: start network... 08:58:29.998513 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:58:30.465855 run create_hlr_db(pid=30984): Launched 08:58:30.589196 bus /gobi_6: Setting Powered False 08:58:31.663063 run create_hlr_db(pid=30984): Terminated: ok {rc=0} 08:58:32.127863 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30986): Launched 08:58:32.435037 run osmo-hlr_10.42.42.2(pid=30987): Launched 08:58:32.549073 run osmo-stp_10.42.42.5: Starting osmo-stp 08:58:33.080115 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30989): Launched 08:58:33.379147 run osmo-stp_10.42.42.5(pid=30990): Launched 08:58:33.493059 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:58:34.010046 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30992): Launched 08:58:34.127459 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:58:34.381049 run patchelf(pid=30993): Launched 08:58:34.547773 run osmo-stp_10.42.42.5(pid=30990): ERR: Terminated: ERROR {rc=1} [trial-2402↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30990)] 08:58:34.675245 run osmo-stp_10.42.42.5(pid=30990): stdout: | (launched: 2022-12-14_08:58:33.323511) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:58:34.803718 run osmo-stp_10.42.42.5(pid=30990): stderr: | 20221214085833495 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214085833495 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214085833495 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214085833495 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214085833496 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214085833496 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214085833496 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:58:34.932461 run osmo-stp_10.42.42.5(pid=30990): stdout: | (launched: 2022-12-14_08:58:33.323511) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:58:35.055491 run osmo-stp_10.42.42.5(pid=30990): stderr: | 20221214085833495 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214085833495 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214085833495 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214085833495 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214085833496 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214085833496 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214085833496 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:58:35.201405 run patchelf(pid=30993): Terminating (SIGINT) 08:58:35.369647 run patchelf(pid=30993): Terminated: ok {rc=0} 08:58:35.490766 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=30990): Process ended prematurely: osmo-stp_10.42.42.5(pid=30990) [trial-2402↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30990)] [trial-2402↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27] 08:58:35.499748 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 08:58:35.526710 run osmo-hlr_10.42.42.2(pid=30987): ERR: Terminated: ERROR {rc=237} [trial-2402↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30987)] 08:58:35.575264 run osmo-hlr_10.42.42.2(pid=30987): stdout: | (launched: 2022-12-14_08:58:32.379369) 08:58:35.625449 run osmo-hlr_10.42.42.2(pid=30987): stderr: | 20221214085832554 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214085832555 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214085832555 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214085832555 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214085832555 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214085832555 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214085832567 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/gprs:trx-sysmocell5000+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214085832578 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214085832578 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214085832578 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:58:35.675430 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30986): Terminating (SIGTERM) 08:58:35.715684 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30989): Terminating (SIGTERM) 08:58:35.755842 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30992): Terminating (SIGTERM) 08:58:35.796066 --- ParallelTerminationStrategy: PID 30986 died... 08:58:35.815570 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30986): Terminated: ok {rc=0} 08:58:35.860354 --- ParallelTerminationStrategy: PID 30989 died... 08:58:35.879665 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30989): Terminated: ok {rc=0} 08:58:35.923864 --- ParallelTerminationStrategy: PID 30992 died... 08:58:35.942865 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30992): Terminated: ok {rc=0} 08:58:36.030258 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2402 gprs:trx-sysmocell5000+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa --------------------------------------------------------------------- 08:58:37.338141 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:58:37.344534 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 08:58:37.377700 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 08:58:37.416488 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 08:58:37.502383 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 08:58:37.535433 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 08:58:37.573242 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 08:58:38.172080 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2402 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 08:58:38.221212 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:58:38.232230 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 08:58:38.302269 tst cs_paging_gprs_active.py: using LAC 39822 08:58:38.426694 tst cs_paging_gprs_active.py: using RAC 42 08:58:38.546705 tst cs_paging_gprs_active.py: using CellId 39822 08:58:38.666215 tst cs_paging_gprs_active.py: using BVCI 39823 08:58:38.776170 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:58:38.787211 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:58:38.798210 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:58:38.809095 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:58:38.820258 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:58:38.831427 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:58:38.842776 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:58:38.853898 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:58:38.865280 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 08:58:38.986488 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 08:58:39.104682 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 08:58:39.309829 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:58:39.616399 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30998): Launched 08:58:39.882931 run iperf3-srv_10.42.42.10(pid=30999): Launched 08:58:39.999064 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 08:58:40.203776 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:58:40.509988 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31000): Launched 08:58:40.776411 run iperf3-srv_10.42.42.10(pid=31001): Launched 08:58:40.890499 tst cs_paging_gprs_active.py:38: start network... 08:58:41.094077 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:58:41.566222 run create_hlr_db(pid=31002): Launched 08:58:41.692452 bus /gobi_6: Setting Powered False 08:58:42.756729 run create_hlr_db(pid=31002): Terminated: ok {rc=0} 08:58:43.210002 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31004): Launched 08:58:43.536764 run osmo-hlr_10.42.42.2(pid=31005): Launched 08:58:43.661975 run osmo-stp_10.42.42.5: Starting osmo-stp 08:58:44.226207 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31007): Launched 08:58:44.552673 run osmo-stp_10.42.42.5(pid=31008): Launched 08:58:44.676882 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:58:45.238948 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31010): Launched 08:58:45.363953 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:58:45.639238 run patchelf(pid=31011): Launched 08:58:45.820675 run osmo-stp_10.42.42.5(pid=31008): ERR: Terminated: ERROR {rc=1} [trial-2402↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31008)] 08:58:45.984576 run osmo-stp_10.42.42.5(pid=31008): stdout: | (launched: 2022-12-14_08:58:44.492335) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:58:46.127149 run osmo-stp_10.42.42.5(pid=31008): stderr: | 20221214085844686 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214085844686 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214085844686 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214085844687 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214085844687 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214085844687 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214085844687 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:58:46.269296 run osmo-stp_10.42.42.5(pid=31008): stdout: | (launched: 2022-12-14_08:58:44.492335) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:58:46.405355 run osmo-stp_10.42.42.5(pid=31008): stderr: | 20221214085844686 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214085844686 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214085844686 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214085844687 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214085844687 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214085844687 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214085844687 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:58:46.566112 run patchelf(pid=31011): Terminating (SIGINT) 08:58:46.750355 run patchelf(pid=31011): Terminated: ok {rc=0} 08:58:46.883871 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=31008): Process ended prematurely: osmo-stp_10.42.42.5(pid=31008) [trial-2402↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31008)] [trial-2402↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 08:58:46.895051 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 08:58:46.925082 run osmo-hlr_10.42.42.2(pid=31005): ERR: Terminated: ERROR {rc=237} [trial-2402↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31005)] 08:58:46.976375 run osmo-hlr_10.42.42.2(pid=31005): stdout: | (launched: 2022-12-14_08:58:43.476682) 08:58:47.029706 run osmo-hlr_10.42.42.2(pid=31005): stderr: | 20221214085843676 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214085843676 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214085843676 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214085843676 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214085843676 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214085843676 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214085843689 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214085843699 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214085843699 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214085843699 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:58:47.082970 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30998): Terminating (SIGTERM) 08:58:47.125775 run iperf3-srv_10.42.42.10(pid=30999): Terminating (SIGTERM) 08:58:47.170722 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31000): Terminating (SIGTERM) 08:58:47.213417 run iperf3-srv_10.42.42.10(pid=31001): Terminating (SIGTERM) 08:58:47.254970 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31004): Terminating (SIGTERM) 08:58:47.297047 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31007): Terminating (SIGTERM) 08:58:47.338755 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31010): Terminating (SIGTERM) 08:58:47.380573 --- ParallelTerminationStrategy: PID 30998 died... 08:58:47.400500 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30998): Terminated: ok {rc=0} 08:58:47.446801 --- ParallelTerminationStrategy: PID 30999 died... 08:58:47.466229 run iperf3-srv_10.42.42.10(pid=30999): Terminated {rc=256} 08:58:47.512077 --- ParallelTerminationStrategy: PID 31000 died... 08:58:47.531618 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31000): Terminated: ok {rc=0} 08:58:47.577644 --- ParallelTerminationStrategy: PID 31001 died... 08:58:47.597157 run iperf3-srv_10.42.42.10(pid=31001): Terminated {rc=256} 08:58:47.642971 --- ParallelTerminationStrategy: PID 31004 died... 08:58:47.662663 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31004): Terminated: ok {rc=0} 08:58:47.708634 --- ParallelTerminationStrategy: PID 31007 died... 08:58:47.728278 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31007): Terminated: ok {rc=0} 08:58:47.774264 --- ParallelTerminationStrategy: PID 31010 died... 08:58:47.793811 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31010): Terminated: ok {rc=0} 08:58:47.881786 bus /gobi_0: Setting Powered False 08:58:48.980504 bus /gobi_0: Setting Powered False 08:58:50.097104 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2402 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 08:58:51.247257 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:58:51.259432 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 08:58:51.335800 tst iperf3.py: using LAC 39823 08:58:51.465505 tst iperf3.py: using RAC 43 08:58:51.597305 tst iperf3.py: using CellId 39823 08:58:51.725175 tst iperf3.py: using BVCI 39824 08:58:51.843439 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:58:51.855080 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:58:51.866534 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:58:51.877994 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:58:51.889632 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:58:51.901039 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:58:51.912512 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:58:51.923803 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:58:51.935487 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 08:58:52.051864 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 08:58:52.256912 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:58:52.563438 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31012): Launched 08:58:52.828633 run iperf3-srv_10.42.42.10(pid=31013): Launched 08:58:52.945843 tst iperf3.py:8: start network... 08:58:53.149100 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:58:53.622186 run create_hlr_db(pid=31014): Launched 08:58:53.739011 bus /gobi_6: Setting Powered False 08:58:54.799400 run create_hlr_db(pid=31014): Terminated: ok {rc=0} 08:58:55.245348 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31016): Launched 08:58:55.571047 run osmo-hlr_10.42.42.2(pid=31017): Launched 08:58:55.696505 run osmo-stp_10.42.42.5: Starting osmo-stp 08:58:56.262443 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31019): Launched 08:58:56.589141 run osmo-stp_10.42.42.5(pid=31020): Launched 08:58:56.714299 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:58:57.275748 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31022): Launched 08:58:57.400898 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:58:57.676428 run patchelf(pid=31023): Launched 08:58:57.858455 run osmo-stp_10.42.42.5(pid=31020): ERR: Terminated: ERROR {rc=1} [trial-2402↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31020)] 08:58:57.995979 run osmo-stp_10.42.42.5(pid=31020): stdout: | (launched: 2022-12-14_08:58:56.529325) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:58:58.135619 run osmo-stp_10.42.42.5(pid=31020): stderr: | 20221214085856724 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214085856724 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214085856724 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214085856724 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214085856725 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214085856725 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214085856725 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:58:58.274940 run osmo-stp_10.42.42.5(pid=31020): stdout: | (launched: 2022-12-14_08:58:56.529325) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:58:58.408750 run osmo-stp_10.42.42.5(pid=31020): stderr: | 20221214085856724 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214085856724 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214085856724 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214085856724 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214085856725 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214085856725 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214085856725 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:58:58.566703 run patchelf(pid=31023): Terminating (SIGINT) 08:58:58.748208 run patchelf(pid=31023): Terminated: ok {rc=0} 08:58:58.879564 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31020): Process ended prematurely: osmo-stp_10.42.42.5(pid=31020) [trial-2402↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31020)] [trial-2402↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8] 08:58:58.889958 tst iperf3.py:8: Test FAILED (7.7 sec) 08:58:58.918601 run osmo-hlr_10.42.42.2(pid=31017): ERR: Terminated: ERROR {rc=237} [trial-2402↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31017)] 08:58:58.969186 run osmo-hlr_10.42.42.2(pid=31017): stdout: | (launched: 2022-12-14_08:58:55.511251) 08:58:59.021870 run osmo-hlr_10.42.42.2(pid=31017): stderr: | 20221214085855709 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214085855709 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214085855709 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214085855709 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214085855709 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214085855710 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214085855722 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214085855730 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214085855731 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214085855731 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:58:59.074987 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31012): Terminating (SIGTERM) 08:58:59.117732 run iperf3-srv_10.42.42.10(pid=31013): Terminating (SIGTERM) 08:58:59.160382 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31016): Terminating (SIGTERM) 08:58:59.202661 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31019): Terminating (SIGTERM) 08:58:59.244735 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31022): Terminating (SIGTERM) 08:58:59.287518 --- ParallelTerminationStrategy: PID 31012 died... 08:58:59.307665 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31012): Terminated: ok {rc=0} 08:58:59.354142 --- ParallelTerminationStrategy: PID 31013 died... 08:58:59.373694 run iperf3-srv_10.42.42.10(pid=31013): Terminated {rc=256} 08:58:59.419421 --- ParallelTerminationStrategy: PID 31016 died... 08:58:59.438894 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31016): Terminated: ok {rc=0} 08:58:59.484450 --- ParallelTerminationStrategy: PID 31019 died... 08:58:59.503949 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31019): Terminated: ok {rc=0} 08:58:59.549649 --- ParallelTerminationStrategy: PID 31022 died... 08:58:59.569314 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31022): Terminated: ok {rc=0} 08:58:59.657655 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2402 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 08:59:00.808292 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:59:00.820535 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 08:59:00.893273 tst iperf3m4.py: using LAC 39824 08:59:01.023891 tst iperf3m4.py: using RAC 44 08:59:01.182491 tst iperf3m4.py: using CellId 39824 08:59:01.339494 tst iperf3m4.py: using BVCI 39825 08:59:01.463620 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:59:01.476356 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:59:01.488929 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:59:01.501715 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:59:01.514545 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:59:01.527475 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:59:01.540545 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:59:01.553348 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:59:01.566390 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 08:59:01.691507 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 08:59:01.852738 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 08:59:01.981816 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 08:59:02.122066 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 08:59:02.339530 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:59:02.652589 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31024): Launched 08:59:02.920035 run iperf3-srv_10.42.42.10(pid=31025): Launched 08:59:03.034701 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 08:59:03.238558 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:59:03.545191 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31026): Launched 08:59:03.810386 run iperf3-srv_10.42.42.10(pid=31027): Launched 08:59:03.927490 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 08:59:04.130995 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:59:04.438306 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31028): Launched 08:59:04.705615 run iperf3-srv_10.42.42.10(pid=31029): Launched 08:59:04.820348 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 08:59:05.024377 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:59:05.331383 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31030): Launched 08:59:05.596256 run iperf3-srv_10.42.42.10(pid=31031): Launched 08:59:05.710341 tst iperf3m4.py:8: start network... 08:59:05.913515 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:59:06.386271 run create_hlr_db(pid=31032): Launched 08:59:06.504170 bus /gobi_6: Setting Powered False 08:59:07.563871 run create_hlr_db(pid=31032): Terminated: ok {rc=0} 08:59:08.009470 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31034): Launched 08:59:08.336518 run osmo-hlr_10.42.42.2(pid=31035): Launched 08:59:08.462618 run osmo-stp_10.42.42.5: Starting osmo-stp 08:59:09.023175 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31037): Launched 08:59:09.349708 run osmo-stp_10.42.42.5(pid=31038): Launched 08:59:09.473996 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:59:10.034942 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31040): Launched 08:59:10.159767 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:59:10.435716 run patchelf(pid=31041): Launched 08:59:10.617247 run osmo-stp_10.42.42.5(pid=31038): ERR: Terminated: ERROR {rc=1} [trial-2402↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31038)] 08:59:10.754422 run osmo-stp_10.42.42.5(pid=31038): stdout: | (launched: 2022-12-14_08:59:09.289833) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:59:10.893050 run osmo-stp_10.42.42.5(pid=31038): stderr: | 20221214085909481 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214085909481 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214085909481 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214085909482 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214085909482 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214085909482 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214085909482 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:59:11.031841 run osmo-stp_10.42.42.5(pid=31038): stdout: | (launched: 2022-12-14_08:59:09.289833) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:59:11.164837 run osmo-stp_10.42.42.5(pid=31038): stderr: | 20221214085909481 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214085909481 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214085909481 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214085909482 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214085909482 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214085909482 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214085909482 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:59:11.322127 run patchelf(pid=31041): Terminating (SIGINT) 08:59:11.502434 run patchelf(pid=31041): Terminated: ok {rc=0} 08:59:11.632444 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31038): Process ended prematurely: osmo-stp_10.42.42.5(pid=31038) [trial-2402↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31038)] [trial-2402↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8] 08:59:11.642863 tst iperf3m4.py:8: Test FAILED (10.9 sec) 08:59:11.671688 run osmo-hlr_10.42.42.2(pid=31035): ERR: Terminated: ERROR {rc=237} [trial-2402↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31035)] 08:59:11.721850 run osmo-hlr_10.42.42.2(pid=31035): stdout: | (launched: 2022-12-14_08:59:08.276372) 08:59:11.773797 run osmo-hlr_10.42.42.2(pid=31035): stderr: | 20221214085908473 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214085908473 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214085908473 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214085908473 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214085908473 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214085908473 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214085908485 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214085908494 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214085908494 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214085908494 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:59:11.826259 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31024): Terminating (SIGTERM) 08:59:11.868111 run iperf3-srv_10.42.42.10(pid=31025): Terminating (SIGTERM) 08:59:11.938017 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31026): Terminating (SIGTERM) 08:59:11.978822 run iperf3-srv_10.42.42.10(pid=31027): Terminating (SIGTERM) 08:59:12.019791 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31028): Terminating (SIGTERM) 08:59:12.060379 run iperf3-srv_10.42.42.10(pid=31029): Terminating (SIGTERM) 08:59:12.100912 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31030): Terminating (SIGTERM) 08:59:12.141463 run iperf3-srv_10.42.42.10(pid=31031): Terminating (SIGTERM) 08:59:12.182175 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31034): Terminating (SIGTERM) 08:59:12.223145 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31037): Terminating (SIGTERM) 08:59:12.263498 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31040): Terminating (SIGTERM) 08:59:12.304114 --- ParallelTerminationStrategy: PID 31024 died... 08:59:12.323495 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31024): Terminated: ok {rc=0} 08:59:12.368155 --- ParallelTerminationStrategy: PID 31025 died... 08:59:12.387449 run iperf3-srv_10.42.42.10(pid=31025): Terminated {rc=256} 08:59:12.431723 --- ParallelTerminationStrategy: PID 31026 died... 08:59:12.451268 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31026): Terminated: ok {rc=0} 08:59:12.496166 --- ParallelTerminationStrategy: PID 31027 died... 08:59:12.515634 run iperf3-srv_10.42.42.10(pid=31027): Terminated {rc=256} 08:59:12.560030 --- ParallelTerminationStrategy: PID 31028 died... 08:59:12.579590 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31028): Terminated: ok {rc=0} 08:59:12.624209 --- ParallelTerminationStrategy: PID 31029 died... 08:59:12.643699 run iperf3-srv_10.42.42.10(pid=31029): Terminated {rc=256} 08:59:12.687899 --- ParallelTerminationStrategy: PID 31030 died... 08:59:12.707518 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31030): Terminated: ok {rc=0} 08:59:12.752274 --- ParallelTerminationStrategy: PID 31031 died... 08:59:12.771773 run iperf3-srv_10.42.42.10(pid=31031): Terminated {rc=256} 08:59:12.816316 --- ParallelTerminationStrategy: PID 31034 died... 08:59:12.835913 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31034): Terminated: ok {rc=0} 08:59:12.880737 --- ParallelTerminationStrategy: PID 31037 died... 08:59:12.900238 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31037): Terminated: ok {rc=0} 08:59:12.944897 --- ParallelTerminationStrategy: PID 31040 died... 08:59:12.964853 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31040): Terminated: ok {rc=0} 08:59:13.052006 bus /gobi_4: Setting Powered False 08:59:14.150652 bus /gobi_4: Setting Powered False 08:59:15.265973 bus /gobi_1: Setting Powered False 08:59:16.393222 bus /gobi_1: Setting Powered False 08:59:17.520876 bus /gobi_0: Setting Powered False 08:59:18.617953 bus /gobi_0: Setting Powered False 08:59:19.734851 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2402 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 08:59:20.837988 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:59:20.850568 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 08:59:20.923877 tst ping.py: using LAC 39825 08:59:21.043350 tst ping.py: using RAC 45 08:59:21.161154 tst ping.py: using CellId 39825 08:59:21.278730 tst ping.py: using BVCI 39826 08:59:21.387860 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:59:21.399162 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:59:21.410655 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:59:21.421852 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:59:21.433154 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:59:21.444555 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:59:21.456172 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:59:21.467720 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 08:59:21.585811 tst ping.py:19: start network... 08:59:21.786890 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:59:22.250440 run create_hlr_db(pid=31042): Launched 08:59:22.363718 bus /gobi_6: Setting Powered False 08:59:23.422920 run create_hlr_db(pid=31042): Terminated: ok {rc=0} 08:59:23.841295 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31044): Launched 08:59:24.139768 run osmo-hlr_10.42.42.2(pid=31045): Launched 08:59:24.253165 run osmo-stp_10.42.42.5: Starting osmo-stp 08:59:24.782683 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31047): Launched 08:59:25.080373 run osmo-stp_10.42.42.5(pid=31048): Launched 08:59:25.194068 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:59:25.710280 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31050): Launched 08:59:25.824505 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:59:26.077563 run patchelf(pid=31051): Launched 08:59:26.243671 run osmo-stp_10.42.42.5(pid=31048): ERR: Terminated: ERROR {rc=1} [trial-2402↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31048)] 08:59:26.370281 run osmo-stp_10.42.42.5(pid=31048): stdout: | (launched: 2022-12-14_08:59:25.024768) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:59:26.498557 run osmo-stp_10.42.42.5(pid=31048): stderr: | 20221214085925196 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214085925197 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214085925197 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214085925197 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214085925198 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214085925198 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214085925198 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:59:26.627145 run osmo-stp_10.42.42.5(pid=31048): stdout: | (launched: 2022-12-14_08:59:25.024768) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:59:26.749750 run osmo-stp_10.42.42.5(pid=31048): stderr: | 20221214085925196 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214085925197 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214085925197 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214085925197 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214085925198 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214085925198 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214085925198 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:59:26.894875 run patchelf(pid=31051): Terminating (SIGINT) 08:59:27.062453 run patchelf(pid=31051): Terminated: ok {rc=0} 08:59:27.182954 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=31048): Process ended prematurely: osmo-stp_10.42.42.5(pid=31048) [trial-2402↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31048)] [trial-2402↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22] 08:59:27.191954 tst ping.py:22: Test FAILED (6.3 sec) 08:59:27.218551 run osmo-hlr_10.42.42.2(pid=31045): ERR: Terminated: ERROR {rc=237} [trial-2402↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31045)] 08:59:27.267089 run osmo-hlr_10.42.42.2(pid=31045): stdout: | (launched: 2022-12-14_08:59:24.084503) 08:59:27.317254 run osmo-hlr_10.42.42.2(pid=31045): stderr: | 20221214085924261 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214085924261 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214085924261 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214085924261 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214085924262 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214085924262 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214085924273 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214085924281 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214085924282 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214085924282 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:59:27.367589 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31044): Terminating (SIGTERM) 08:59:27.408102 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31047): Terminating (SIGTERM) 08:59:27.448745 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31050): Terminating (SIGTERM) 08:59:27.489747 --- ParallelTerminationStrategy: PID 31044 died... 08:59:27.509626 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31044): Terminated: ok {rc=0} 08:59:27.554572 --- ParallelTerminationStrategy: PID 31047 died... 08:59:27.574085 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31047): Terminated: ok {rc=0} 08:59:27.618710 --- ParallelTerminationStrategy: PID 31050 died... 08:59:27.638011 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31050): Terminated: ok {rc=0} 08:59:27.722329 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2402 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 08:59:28.810428 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:59:28.823584 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 08:59:28.897455 tst ping_idle_ping.py: using LAC 39826 08:59:29.024615 tst ping_idle_ping.py: using RAC 46 08:59:29.152052 tst ping_idle_ping.py: using CellId 39826 08:59:29.272341 tst ping_idle_ping.py: using BVCI 39827 08:59:29.383122 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:59:29.394583 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:59:29.405860 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:59:29.416849 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:59:29.428301 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:59:29.439754 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:59:29.451197 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:59:29.462564 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 08:59:29.583508 tst ping_idle_ping.py:24: start network... 08:59:29.799722 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:59:30.305689 run create_hlr_db(pid=31052): Launched 08:59:30.438384 bus /gobi_6: Setting Powered False 08:59:31.498246 run create_hlr_db(pid=31052): Terminated: ok {rc=0} 08:59:31.956049 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31054): Launched 08:59:32.293812 run osmo-hlr_10.42.42.2(pid=31055): Launched 08:59:32.418850 run osmo-stp_10.42.42.5: Starting osmo-stp 08:59:32.976495 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31057): Launched 08:59:33.297924 run osmo-stp_10.42.42.5(pid=31058): Launched 08:59:33.421467 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:59:33.974905 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31060): Launched 08:59:34.099346 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:59:34.370764 run patchelf(pid=31061): Launched 08:59:34.550419 run osmo-stp_10.42.42.5(pid=31058): ERR: Terminated: ERROR {rc=1} [trial-2402↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31058)] 08:59:34.686251 run osmo-stp_10.42.42.5(pid=31058): stdout: | (launched: 2022-12-14_08:59:33.238810) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:59:34.823235 run osmo-stp_10.42.42.5(pid=31058): stderr: | 20221214085933432 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214085933432 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214085933433 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214085933433 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214085933433 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214085933434 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214085933434 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:59:34.960447 run osmo-stp_10.42.42.5(pid=31058): stdout: | (launched: 2022-12-14_08:59:33.238810) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:59:35.092793 run osmo-stp_10.42.42.5(pid=31058): stderr: | 20221214085933432 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214085933432 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214085933433 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214085933433 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214085933433 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214085933434 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214085933434 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:59:35.248411 run patchelf(pid=31061): Terminating (SIGINT) 08:59:35.427219 run patchelf(pid=31061): Terminated: ok {rc=0} 08:59:35.555373 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=31058): Process ended prematurely: osmo-stp_10.42.42.5(pid=31058) [trial-2402↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31058)] [trial-2402↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 08:59:35.565134 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 08:59:35.593134 run osmo-hlr_10.42.42.2(pid=31055): ERR: Terminated: ERROR {rc=237} [trial-2402↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31055)] 08:59:35.643178 run osmo-hlr_10.42.42.2(pid=31055): stdout: | (launched: 2022-12-14_08:59:32.234142) 08:59:35.695046 run osmo-hlr_10.42.42.2(pid=31055): stderr: | 20221214085932431 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214085932431 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214085932431 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214085932431 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214085932431 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214085932432 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214085932444 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214085932452 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214085932452 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214085932452 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:59:35.747269 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31054): Terminating (SIGTERM) 08:59:35.789382 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31057): Terminating (SIGTERM) 08:59:35.831302 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31060): Terminating (SIGTERM) 08:59:35.873321 --- ParallelTerminationStrategy: PID 31054 died... 08:59:35.893309 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31054): Terminated: ok {rc=0} 08:59:35.939597 --- ParallelTerminationStrategy: PID 31057 died... 08:59:35.959014 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31057): Terminated: ok {rc=0} 08:59:36.004798 --- ParallelTerminationStrategy: PID 31060 died... 08:59:36.024694 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31060): Terminated: ok {rc=0} 08:59:36.112315 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2402 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo --------------------------------------------------------------------- 08:59:37.426663 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:59:37.433522 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 08:59:37.468046 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 08:59:37.509068 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 08:59:37.596424 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 08:59:37.631165 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 08:59:37.671438 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 08:59:38.265390 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2402 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 08:59:38.315140 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:59:38.326978 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 08:59:38.397561 tst cs_paging_gprs_active.py: using LAC 39827 08:59:38.524056 tst cs_paging_gprs_active.py: using RAC 47 08:59:38.650183 tst cs_paging_gprs_active.py: using CellId 39827 08:59:38.778319 tst cs_paging_gprs_active.py: using BVCI 39828 08:59:38.897992 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:59:38.909596 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:59:38.921025 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:59:38.934249 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:59:38.945608 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:59:38.956865 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:59:38.968285 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:59:38.979623 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:59:38.991172 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 08:59:39.108400 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 08:59:39.226575 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 08:59:39.432064 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:59:39.738824 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31065): Launched 08:59:40.008093 run iperf3-srv_10.42.42.10(pid=31066): Launched 08:59:40.123272 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 08:59:40.328303 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:59:40.635582 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31067): Launched 08:59:40.903294 run iperf3-srv_10.42.42.10(pid=31068): Launched 08:59:41.017672 tst cs_paging_gprs_active.py:38: start network... 08:59:41.221783 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:59:41.694916 run create_hlr_db(pid=31069): Launched 08:59:41.813478 bus /gobi_6: Setting Powered False 08:59:42.874237 run create_hlr_db(pid=31069): Terminated: ok {rc=0} 08:59:43.319025 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31071): Launched 08:59:43.646602 run osmo-hlr_10.42.42.2(pid=31072): Launched 08:59:43.772595 run osmo-stp_10.42.42.5: Starting osmo-stp 08:59:44.336178 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31074): Launched 08:59:44.663190 run osmo-stp_10.42.42.5(pid=31075): Launched 08:59:44.789096 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:59:45.350689 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31077): Launched 08:59:45.474618 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:59:45.750354 run patchelf(pid=31078): Launched 08:59:45.948340 run osmo-stp_10.42.42.5(pid=31075): ERR: Terminated: ERROR {rc=1} [trial-2402↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31075)] 08:59:46.086826 run osmo-stp_10.42.42.5(pid=31075): stdout: | (launched: 2022-12-14_08:59:44.603182) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:59:46.223555 run osmo-stp_10.42.42.5(pid=31075): stderr: | 20221214085944794 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214085944795 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214085944795 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214085944795 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214085944796 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214085944796 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214085944796 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:59:46.393940 run osmo-stp_10.42.42.5(pid=31075): stdout: | (launched: 2022-12-14_08:59:44.603182) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:59:46.531112 run osmo-stp_10.42.42.5(pid=31075): stderr: | 20221214085944794 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214085944795 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214085944795 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214085944795 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214085944796 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214085944796 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214085944796 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:59:46.686171 run patchelf(pid=31078): Terminating (SIGINT) 08:59:46.863030 run patchelf(pid=31078): Terminated: ok {rc=0} 08:59:46.989317 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=31075): Process ended prematurely: osmo-stp_10.42.42.5(pid=31075) [trial-2402↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31075)] [trial-2402↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 08:59:47.001147 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 08:59:47.029742 run osmo-hlr_10.42.42.2(pid=31072): ERR: Terminated: ERROR {rc=237} [trial-2402↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31072)] 08:59:47.082080 run osmo-hlr_10.42.42.2(pid=31072): stdout: | (launched: 2022-12-14_08:59:43.586398) 08:59:47.134121 run osmo-hlr_10.42.42.2(pid=31072): stderr: | 20221214085943784 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214085943784 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214085943784 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214085943784 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214085943784 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214085943784 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214085943796 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214085943805 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214085943805 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214085943805 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:59:47.186606 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31065): Terminating (SIGTERM) 08:59:47.229714 run iperf3-srv_10.42.42.10(pid=31066): Terminating (SIGTERM) 08:59:47.271662 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31067): Terminating (SIGTERM) 08:59:47.314443 run iperf3-srv_10.42.42.10(pid=31068): Terminating (SIGTERM) 08:59:47.354667 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31071): Terminating (SIGTERM) 08:59:47.394979 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31074): Terminating (SIGTERM) 08:59:47.435418 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31077): Terminating (SIGTERM) 08:59:47.475695 --- ParallelTerminationStrategy: PID 31065 died... 08:59:47.495192 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31065): Terminated: ok {rc=0} 08:59:47.539762 --- ParallelTerminationStrategy: PID 31066 died... 08:59:47.559196 run iperf3-srv_10.42.42.10(pid=31066): Terminated {rc=256} 08:59:47.603722 --- ParallelTerminationStrategy: PID 31067 died... 08:59:47.623247 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31067): Terminated: ok {rc=0} 08:59:47.667733 --- ParallelTerminationStrategy: PID 31068 died... 08:59:47.687033 run iperf3-srv_10.42.42.10(pid=31068): Terminated {rc=256} 08:59:47.731230 --- ParallelTerminationStrategy: PID 31071 died... 08:59:47.750612 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31071): Terminated: ok {rc=0} 08:59:47.795303 --- ParallelTerminationStrategy: PID 31074 died... 08:59:47.814830 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31074): Terminated: ok {rc=0} 08:59:47.859360 --- ParallelTerminationStrategy: PID 31077 died... 08:59:47.878736 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31077): Terminated: ok {rc=0} 08:59:47.966460 bus /gobi_0: Setting Powered False 08:59:49.065932 bus /gobi_0: Setting Powered False 08:59:50.181433 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2402 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 08:59:51.328591 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:59:51.340288 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 08:59:51.414192 tst iperf3.py: using LAC 39828 08:59:51.534351 tst iperf3.py: using RAC 48 08:59:51.656363 tst iperf3.py: using CellId 39828 08:59:51.777221 tst iperf3.py: using BVCI 39829 08:59:51.889642 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:59:51.900798 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:59:51.911870 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:59:51.922882 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:59:51.934208 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:59:51.945481 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:59:51.956790 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:59:51.968026 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:59:51.979423 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 08:59:52.099639 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 08:59:52.320540 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:59:52.649224 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31079): Launched 08:59:52.935324 run iperf3-srv_10.42.42.10(pid=31080): Launched 08:59:53.060040 tst iperf3.py:8: start network... 08:59:53.280167 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:59:53.788730 run create_hlr_db(pid=31081): Launched 08:59:53.920539 bus /gobi_6: Setting Powered False 08:59:54.983974 run create_hlr_db(pid=31081): Terminated: ok {rc=0} 08:59:55.418354 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31083): Launched 08:59:55.725645 run osmo-hlr_10.42.42.2(pid=31084): Launched 08:59:55.842197 run osmo-stp_10.42.42.5: Starting osmo-stp 08:59:56.386094 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31086): Launched 08:59:56.691676 run osmo-stp_10.42.42.5(pid=31087): Launched 08:59:56.808377 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:59:57.336309 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31089): Launched 08:59:57.453263 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:59:57.713251 run patchelf(pid=31090): Launched 08:59:57.895768 run osmo-stp_10.42.42.5(pid=31087): ERR: Terminated: ERROR {rc=1} [trial-2402↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31087)] 08:59:58.033978 run osmo-stp_10.42.42.5(pid=31087): stdout: | (launched: 2022-12-14_08:59:56.635194) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:59:58.174270 run osmo-stp_10.42.42.5(pid=31087): stderr: | 20221214085956808 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214085956808 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214085956808 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214085956809 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214085956809 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214085956809 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214085956809 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:59:58.314014 run osmo-stp_10.42.42.5(pid=31087): stdout: | (launched: 2022-12-14_08:59:56.635194) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:59:58.447911 run osmo-stp_10.42.42.5(pid=31087): stderr: | 20221214085956808 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214085956808 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214085956808 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214085956809 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214085956809 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214085956809 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214085956809 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:59:58.606920 run patchelf(pid=31090): Terminating (SIGINT) 08:59:58.789171 run patchelf(pid=31090): Terminated: ok {rc=0} 08:59:58.921290 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31087): Process ended prematurely: osmo-stp_10.42.42.5(pid=31087) [trial-2402↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31087)] [trial-2402↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8] 08:59:58.931812 tst iperf3.py:8: Test FAILED (7.6 sec) 08:59:58.960850 run osmo-hlr_10.42.42.2(pid=31084): ERR: Terminated: ERROR {rc=237} [trial-2402↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31084)] 08:59:59.012137 run osmo-hlr_10.42.42.2(pid=31084): stdout: | (launched: 2022-12-14_08:59:55.669237) 08:59:59.065517 run osmo-hlr_10.42.42.2(pid=31084): stderr: | 20221214085955845 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214085955845 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214085955845 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214085955845 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214085955845 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214085955846 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214085955858 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214085955867 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214085955868 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214085955868 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:59:59.118794 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31079): Terminating (SIGTERM) 08:59:59.161419 run iperf3-srv_10.42.42.10(pid=31080): Terminating (SIGTERM) 08:59:59.203792 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31083): Terminating (SIGTERM) 08:59:59.246477 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31086): Terminating (SIGTERM) 08:59:59.289222 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31089): Terminating (SIGTERM) 08:59:59.331932 --- ParallelTerminationStrategy: PID 31079 died... 08:59:59.352379 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31079): Terminated: ok {rc=0} 08:59:59.399526 --- ParallelTerminationStrategy: PID 31080 died... 08:59:59.419772 run iperf3-srv_10.42.42.10(pid=31080): Terminated {rc=256} 08:59:59.466359 --- ParallelTerminationStrategy: PID 31083 died... 08:59:59.486397 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31083): Terminated: ok {rc=0} 08:59:59.533293 --- ParallelTerminationStrategy: PID 31086 died... 08:59:59.553336 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31086): Terminated: ok {rc=0} 08:59:59.599832 --- ParallelTerminationStrategy: PID 31089 died... 08:59:59.619934 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31089): Terminated: ok {rc=0} 08:59:59.708416 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2402 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 09:00:00.884315 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:00:00.900195 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 09:00:00.986470 tst iperf3m4.py: using LAC 39829 09:00:01.115100 tst iperf3m4.py: using RAC 49 09:00:01.239906 tst iperf3m4.py: using CellId 39829 09:00:01.363404 tst iperf3m4.py: using BVCI 39830 09:00:01.515179 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:00:01.529996 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:00:01.541874 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:00:01.553969 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:00:01.565805 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:00:01.577715 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:00:01.590381 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:00:01.602509 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:00:01.614945 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 09:00:01.736197 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 09:00:01.876692 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 09:00:02.010578 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 09:00:02.154786 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 09:00:02.418799 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:00:02.740857 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31114): Launched 09:00:03.008027 run iperf3-srv_10.42.42.10(pid=31115): Launched 09:00:03.122991 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 09:00:03.326980 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:00:03.633721 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31116): Launched 09:00:03.899192 run iperf3-srv_10.42.42.10(pid=31117): Launched 09:00:04.013496 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 09:00:04.216710 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:00:04.523315 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31118): Launched 09:00:04.790690 run iperf3-srv_10.42.42.10(pid=31119): Launched 09:00:04.908231 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 09:00:05.111287 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:00:05.416775 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31120): Launched 09:00:05.681612 run iperf3-srv_10.42.42.10(pid=31121): Launched 09:00:05.795656 tst iperf3m4.py:8: start network... 09:00:05.998556 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:00:06.473344 run create_hlr_db(pid=31122): Launched 09:00:06.589664 bus /gobi_6: Setting Powered False 09:00:07.650924 run create_hlr_db(pid=31122): Terminated: ok {rc=0} 09:00:08.099847 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31125): Launched 09:00:08.427783 run osmo-hlr_10.42.42.2(pid=31126): Launched 09:00:08.553156 run osmo-stp_10.42.42.5: Starting osmo-stp 09:00:09.116074 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31128): Launched 09:00:09.440729 run osmo-stp_10.42.42.5(pid=31129): Launched 09:00:09.565344 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:00:10.126204 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31131): Launched 09:00:10.251736 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:00:10.526985 run patchelf(pid=31132): Launched 09:00:10.708915 run osmo-stp_10.42.42.5(pid=31129): ERR: Terminated: ERROR {rc=1} [trial-2402↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31129)] 09:00:10.846072 run osmo-stp_10.42.42.5(pid=31129): stdout: | (launched: 2022-12-14_09:00:09.380707) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:00:10.985384 run osmo-stp_10.42.42.5(pid=31129): stderr: | 20221214090009570 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214090009570 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214090009571 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214090009571 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214090009571 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214090009571 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214090009571 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:00:11.124822 run osmo-stp_10.42.42.5(pid=31129): stdout: | (launched: 2022-12-14_09:00:09.380707) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:00:11.257525 run osmo-stp_10.42.42.5(pid=31129): stderr: | 20221214090009570 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214090009570 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214090009571 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214090009571 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214090009571 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214090009571 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214090009571 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:00:11.414941 run patchelf(pid=31132): Terminating (SIGINT) 09:00:11.595998 run patchelf(pid=31132): Terminated: ok {rc=0} 09:00:11.726337 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31129): Process ended prematurely: osmo-stp_10.42.42.5(pid=31129) [trial-2402↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31129)] [trial-2402↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8] 09:00:11.736785 tst iperf3m4.py:8: Test FAILED (10.9 sec) 09:00:11.765929 run osmo-hlr_10.42.42.2(pid=31126): ERR: Terminated: ERROR {rc=237} [trial-2402↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31126)] 09:00:11.816570 run osmo-hlr_10.42.42.2(pid=31126): stdout: | (launched: 2022-12-14_09:00:08.367569) 09:00:11.868940 run osmo-hlr_10.42.42.2(pid=31126): stderr: | 20221214090008561 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214090008561 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214090008561 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214090008561 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214090008561 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214090008561 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214090008572 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214090008581 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214090008581 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214090008581 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:00:11.921704 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31114): Terminating (SIGTERM) 09:00:11.964205 run iperf3-srv_10.42.42.10(pid=31115): Terminating (SIGTERM) 09:00:12.006497 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31116): Terminating (SIGTERM) 09:00:12.048850 run iperf3-srv_10.42.42.10(pid=31117): Terminating (SIGTERM) 09:00:12.091594 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31118): Terminating (SIGTERM) 09:00:12.134454 run iperf3-srv_10.42.42.10(pid=31119): Terminating (SIGTERM) 09:00:12.177284 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31120): Terminating (SIGTERM) 09:00:12.219720 run iperf3-srv_10.42.42.10(pid=31121): Terminating (SIGTERM) 09:00:12.261929 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31125): Terminating (SIGTERM) 09:00:12.304036 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31128): Terminating (SIGTERM) 09:00:12.346128 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31131): Terminating (SIGTERM) 09:00:12.388242 --- ParallelTerminationStrategy: PID 31114 died... 09:00:12.408299 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31114): Terminated: ok {rc=0} 09:00:12.454845 --- ParallelTerminationStrategy: PID 31115 died... 09:00:12.474475 run iperf3-srv_10.42.42.10(pid=31115): Terminated {rc=256} 09:00:12.519972 --- ParallelTerminationStrategy: PID 31116 died... 09:00:12.539537 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31116): Terminated: ok {rc=0} 09:00:12.585732 --- ParallelTerminationStrategy: PID 31117 died... 09:00:12.605352 run iperf3-srv_10.42.42.10(pid=31117): Terminated {rc=256} 09:00:12.651421 --- ParallelTerminationStrategy: PID 31118 died... 09:00:12.671114 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31118): Terminated: ok {rc=0} 09:00:12.717310 --- ParallelTerminationStrategy: PID 31119 died... 09:00:12.736809 run iperf3-srv_10.42.42.10(pid=31119): Terminated {rc=256} 09:00:12.782811 --- ParallelTerminationStrategy: PID 31120 died... 09:00:12.802450 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31120): Terminated: ok {rc=0} 09:00:12.848592 --- ParallelTerminationStrategy: PID 31121 died... 09:00:12.868089 run iperf3-srv_10.42.42.10(pid=31121): Terminated {rc=256} 09:00:12.914673 --- ParallelTerminationStrategy: PID 31125 died... 09:00:12.934540 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31125): Terminated: ok {rc=0} 09:00:12.980864 --- ParallelTerminationStrategy: PID 31128 died... 09:00:13.001009 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31128): Terminated: ok {rc=0} 09:00:13.047227 --- ParallelTerminationStrategy: PID 31131 died... 09:00:13.067174 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31131): Terminated: ok {rc=0} 09:00:13.155216 bus /gobi_4: Setting Powered False 09:00:14.257882 bus /gobi_4: Setting Powered False 09:00:15.371100 bus /gobi_1: Setting Powered False 09:00:16.470340 bus /gobi_1: Setting Powered False 09:00:17.589648 bus /gobi_0: Setting Powered False 09:00:18.688566 bus /gobi_0: Setting Powered False 09:00:19.807735 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2402 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 09:00:20.908652 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:00:20.920676 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 09:00:20.992326 tst ping.py: using LAC 39830 09:00:21.109701 tst ping.py: using RAC 50 09:00:21.228586 tst ping.py: using CellId 39830 09:00:21.349663 tst ping.py: using BVCI 39831 09:00:21.458893 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:00:21.470148 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:00:21.481153 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:00:21.492022 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:00:21.503151 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:00:21.514591 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:00:21.526228 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:00:21.537122 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 09:00:21.657815 tst ping.py:19: start network... 09:00:21.870609 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:00:22.364496 run create_hlr_db(pid=31135): Launched 09:00:22.495128 bus /gobi_6: Setting Powered False 09:00:23.558128 run create_hlr_db(pid=31135): Terminated: ok {rc=0} 09:00:23.984663 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31138): Launched 09:00:24.305491 run osmo-hlr_10.42.42.2(pid=31139): Launched 09:00:24.427458 run osmo-stp_10.42.42.5: Starting osmo-stp 09:00:24.987574 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31141): Launched 09:00:25.308755 run osmo-stp_10.42.42.5(pid=31142): Launched 09:00:25.430363 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:00:25.985193 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31144): Launched 09:00:26.106956 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:00:26.376678 run patchelf(pid=31145): Launched 09:00:26.552927 run osmo-stp_10.42.42.5(pid=31142): ERR: Terminated: ERROR {rc=1} [trial-2402↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31142)] 09:00:26.687684 run osmo-stp_10.42.42.5(pid=31142): stdout: | (launched: 2022-12-14_09:00:25.250080) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:00:26.824202 run osmo-stp_10.42.42.5(pid=31142): stderr: | 20221214090025442 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214090025442 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214090025443 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214090025443 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214090025443 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214090025443 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214090025444 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:00:26.960178 run osmo-stp_10.42.42.5(pid=31142): stdout: | (launched: 2022-12-14_09:00:25.250080) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:00:27.092352 run osmo-stp_10.42.42.5(pid=31142): stderr: | 20221214090025442 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214090025442 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214090025443 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214090025443 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214090025443 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214090025443 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214090025444 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:00:27.247146 run patchelf(pid=31145): Terminating (SIGINT) 09:00:27.425187 run patchelf(pid=31145): Terminated: ok {rc=0} 09:00:27.553727 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=31142): Process ended prematurely: osmo-stp_10.42.42.5(pid=31142) [trial-2402↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31142)] [trial-2402↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22] 09:00:27.563398 tst ping.py:22: Test FAILED (6.6 sec) 09:00:27.591592 run osmo-hlr_10.42.42.2(pid=31139): ERR: Terminated: ERROR {rc=237} [trial-2402↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31139)] 09:00:27.641716 run osmo-hlr_10.42.42.2(pid=31139): stdout: | (launched: 2022-12-14_09:00:24.246112) 09:00:27.693492 run osmo-hlr_10.42.42.2(pid=31139): stderr: | 20221214090024444 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214090024444 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214090024444 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214090024444 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214090024444 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214090024444 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214090024456 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214090024466 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214090024466 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214090024466 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:00:27.746009 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31138): Terminating (SIGTERM) 09:00:27.787839 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31141): Terminating (SIGTERM) 09:00:27.829652 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31144): Terminating (SIGTERM) 09:00:27.871576 --- ParallelTerminationStrategy: PID 31138 died... 09:00:27.891438 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31138): Terminated: ok {rc=0} 09:00:27.937553 --- ParallelTerminationStrategy: PID 31141 died... 09:00:27.957079 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31141): Terminated: ok {rc=0} 09:00:28.003189 --- ParallelTerminationStrategy: PID 31144 died... 09:00:28.022844 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31144): Terminated: ok {rc=0} 09:00:28.110331 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2402 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 09:00:29.197487 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:00:29.209873 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 09:00:29.289119 tst ping_idle_ping.py: using LAC 39831 09:00:29.413891 tst ping_idle_ping.py: using RAC 51 09:00:29.537858 tst ping_idle_ping.py: using CellId 39831 09:00:29.666600 tst ping_idle_ping.py: using BVCI 39832 09:00:29.784202 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:00:29.796103 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:00:29.807742 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:00:29.819269 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:00:29.830639 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:00:29.842362 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:00:29.853919 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:00:29.865363 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 09:00:29.983546 tst ping_idle_ping.py:24: start network... 09:00:30.199688 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:00:30.698441 run create_hlr_db(pid=31146): Launched 09:00:30.829179 bus /gobi_6: Setting Powered False 09:00:31.900543 run create_hlr_db(pid=31146): Terminated: ok {rc=0} 09:00:32.395782 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31148): Launched 09:00:32.716628 run osmo-hlr_10.42.42.2(pid=31149): Launched 09:00:32.838578 run osmo-stp_10.42.42.5: Starting osmo-stp 09:00:33.390441 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31151): Launched 09:00:33.712139 run osmo-stp_10.42.42.5(pid=31152): Launched 09:00:33.835030 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:00:34.388714 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31154): Launched 09:00:34.512722 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:00:34.784775 run patchelf(pid=31155): Launched 09:00:34.964855 run osmo-stp_10.42.42.5(pid=31152): ERR: Terminated: ERROR {rc=1} [trial-2402↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31152)] 09:00:35.101975 run osmo-stp_10.42.42.5(pid=31152): stdout: | (launched: 2022-12-14_09:00:33.653028) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:00:35.239683 run osmo-stp_10.42.42.5(pid=31152): stderr: | 20221214090033846 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214090033846 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214090033846 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214090033847 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214090033847 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214090033847 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214090033847 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:00:35.377555 run osmo-stp_10.42.42.5(pid=31152): stdout: | (launched: 2022-12-14_09:00:33.653028) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:00:35.509263 run osmo-stp_10.42.42.5(pid=31152): stderr: | 20221214090033846 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214090033846 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214090033846 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214090033847 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214090033847 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214090033847 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214090033847 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:00:35.665573 run patchelf(pid=31155): Terminating (SIGINT) 09:00:35.844547 run patchelf(pid=31155): Terminated: ok {rc=0} 09:00:35.973332 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=31152): Process ended prematurely: osmo-stp_10.42.42.5(pid=31152) [trial-2402↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31152)] [trial-2402↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 09:00:35.983028 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 09:00:36.010910 run osmo-hlr_10.42.42.2(pid=31149): ERR: Terminated: ERROR {rc=237} [trial-2402↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31149)] 09:00:36.060887 run osmo-hlr_10.42.42.2(pid=31149): stdout: | (launched: 2022-12-14_09:00:32.657656) 09:00:36.113224 run osmo-hlr_10.42.42.2(pid=31149): stderr: | 20221214090032856 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214090032856 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214090032856 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214090032856 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214090032856 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214090032856 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214090032905 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214090032914 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214090032914 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214090032914 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:00:36.165471 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31148): Terminating (SIGTERM) 09:00:36.207149 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31151): Terminating (SIGTERM) 09:00:36.249158 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31154): Terminating (SIGTERM) 09:00:36.291133 --- ParallelTerminationStrategy: PID 31148 died... 09:00:36.311168 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31148): Terminated: ok {rc=0} 09:00:36.357443 --- ParallelTerminationStrategy: PID 31151 died... 09:00:36.377131 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31151): Terminated: ok {rc=0} 09:00:36.423193 --- ParallelTerminationStrategy: PID 31154 died... 09:00:36.442812 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31154): Terminated: ok {rc=0} 09:00:36.530000 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2402 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 09:00:37.836835 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:00:37.843696 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 09:00:37.877196 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 09:00:37.912808 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 09:00:37.966648 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 09:00:38.001988 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 09:00:38.038465 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 09:00:38.592883 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2402 dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 09:00:38.599180 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 09:00:38.611416 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 09:00:38.685934 tst switch_tch_pdch.py: using LAC 39832 09:00:38.805163 tst switch_tch_pdch.py: using RAC 52 09:00:38.922307 tst switch_tch_pdch.py: using CellId 39832 09:00:39.039173 tst switch_tch_pdch.py: using BVCI 39833 09:00:39.148554 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 09:00:39.160148 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 09:00:39.171478 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 09:00:39.182826 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 09:00:39.194521 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 09:00:39.206168 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 09:00:39.217972 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 09:00:39.229572 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 09:00:39.344881 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 09:00:39.467602 tst switch_tch_pdch.py:51: start network... 09:00:39.667148 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:00:40.129349 run create_hlr_db(pid=31159): Launched 09:00:40.243946 bus /gobi_6: Setting Powered False 09:00:41.303199 run create_hlr_db(pid=31159): Terminated: ok {rc=0} 09:00:41.740778 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31161): Launched 09:00:42.061317 run osmo-hlr_10.42.42.2(pid=31162): Launched 09:00:42.183068 run osmo-stp_10.42.42.5: Starting osmo-stp 09:00:42.738714 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31164): Launched 09:00:43.057856 run osmo-stp_10.42.42.5(pid=31165): Launched 09:00:43.182003 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:00:43.733118 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31167): Launched 09:00:43.856048 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:00:44.126133 run patchelf(pid=31168): Launched 09:00:44.304279 run osmo-stp_10.42.42.5(pid=31165): ERR: Terminated: ERROR {rc=1} [trial-2402↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31165)] 09:00:44.439504 run osmo-stp_10.42.42.5(pid=31165): stdout: | (launched: 2022-12-14_09:00:42.999016) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:00:44.576195 run osmo-stp_10.42.42.5(pid=31165): stderr: | 20221214090043190 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214090043190 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214090043190 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214090043191 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214090043191 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214090043191 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214090043191 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:00:44.712905 run osmo-stp_10.42.42.5(pid=31165): stdout: | (launched: 2022-12-14_09:00:42.999016) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:00:44.843926 run osmo-stp_10.42.42.5(pid=31165): stderr: | 20221214090043190 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214090043190 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214090043190 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214090043191 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214090043191 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214090043191 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214090043191 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:00:44.999342 run patchelf(pid=31168): Terminating (SIGINT) 09:00:45.178580 run patchelf(pid=31168): Terminated: ok {rc=0} 09:00:45.307315 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=31165): Process ended prematurely: osmo-stp_10.42.42.5(pid=31165) [trial-2402↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31165)] [trial-2402↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 09:00:45.317143 tst switch_tch_pdch.py:54: Test FAILED (6.7 sec) 09:00:45.345093 run osmo-hlr_10.42.42.2(pid=31162): ERR: Terminated: ERROR {rc=237} [trial-2402↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31162)] 09:00:45.395062 run osmo-hlr_10.42.42.2(pid=31162): stdout: | (launched: 2022-12-14_09:00:42.002415) 09:00:45.446821 run osmo-hlr_10.42.42.2(pid=31162): stderr: | 20221214090042199 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214090042199 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214090042199 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214090042199 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214090042199 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214090042199 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214090042212 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214090042220 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214090042220 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214090042220 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:00:45.499935 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31161): Terminating (SIGTERM) 09:00:45.541756 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31164): Terminating (SIGTERM) 09:00:45.583549 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31167): Terminating (SIGTERM) 09:00:45.625547 --- ParallelTerminationStrategy: PID 31161 died... 09:00:45.645493 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31161): Terminated: ok {rc=0} 09:00:45.691640 --- ParallelTerminationStrategy: PID 31164 died... 09:00:45.711268 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31164): Terminated: ok {rc=0} 09:00:45.757262 --- ParallelTerminationStrategy: PID 31167 died... 09:00:45.776656 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31167): Terminated: ok {rc=0} 09:00:45.865161 bus /gobi_0: Setting Powered False 09:00:46.990527 bus /gobi_0: Setting Powered False 09:00:48.119561 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2402 dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 09:00:49.378449 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:00:49.384314 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 09:00:49.417617 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 09:00:49.452665 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 09:00:49.504862 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 09:00:49.538614 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 09:00:49.573892 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 09:00:50.129311 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2402 dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 09:00:50.134582 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 09:00:50.145925 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 09:00:50.218149 tst switch_tch_pdch.py: using LAC 39833 09:00:50.345107 tst switch_tch_pdch.py: using RAC 53 09:00:50.471418 tst switch_tch_pdch.py: using CellId 39833 09:00:50.598479 tst switch_tch_pdch.py: using BVCI 39834 09:00:50.717428 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 09:00:50.729050 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 09:00:50.740382 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 09:00:50.751764 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 09:00:50.763094 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 09:00:50.774531 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 09:00:50.786052 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 09:00:50.797429 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 09:00:50.914092 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 09:00:51.034537 tst switch_tch_pdch.py:51: start network... 09:00:51.251154 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:00:51.720445 run create_hlr_db(pid=31172): Launched 09:00:51.851688 bus /gobi_6: Setting Powered False 09:00:52.914961 run create_hlr_db(pid=31172): Terminated: ok {rc=0} 09:00:53.335759 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31176): Launched 09:00:53.658532 run osmo-hlr_10.42.42.2(pid=31177): Launched 09:00:53.780436 run osmo-stp_10.42.42.5: Starting osmo-stp 09:00:54.310695 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31179): Launched 09:00:54.631753 run osmo-stp_10.42.42.5(pid=31180): Launched 09:00:54.754255 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:00:55.279718 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31182): Launched 09:00:55.403367 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:00:55.673512 run patchelf(pid=31183): Launched 09:00:55.851302 run osmo-stp_10.42.42.5(pid=31180): ERR: Terminated: ERROR {rc=1} [trial-2402↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31180)] 09:00:55.986893 run osmo-stp_10.42.42.5(pid=31180): stdout: | (launched: 2022-12-14_09:00:54.572592) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:00:56.124498 run osmo-stp_10.42.42.5(pid=31180): stderr: | 20221214090054764 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214090054764 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214090054764 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214090054765 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214090054765 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214090054765 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214090054766 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:00:56.261635 run osmo-stp_10.42.42.5(pid=31180): stdout: | (launched: 2022-12-14_09:00:54.572592) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:00:56.393100 run osmo-stp_10.42.42.5(pid=31180): stderr: | 20221214090054764 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214090054764 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214090054764 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214090054765 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214090054765 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214090054765 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214090054766 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:00:56.548309 run patchelf(pid=31183): Terminating (SIGINT) 09:00:56.727807 run patchelf(pid=31183): Terminated: ok {rc=0} 09:00:56.856598 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=31180): Process ended prematurely: osmo-stp_10.42.42.5(pid=31180) [trial-2402↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31180)] [trial-2402↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 09:00:56.866289 tst switch_tch_pdch.py:54: Test FAILED (6.7 sec) 09:00:56.894245 run osmo-hlr_10.42.42.2(pid=31177): ERR: Terminated: ERROR {rc=237} [trial-2402↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31177)] 09:00:56.944605 run osmo-hlr_10.42.42.2(pid=31177): stdout: | (launched: 2022-12-14_09:00:53.598839) 09:00:56.996563 run osmo-hlr_10.42.42.2(pid=31177): stderr: | 20221214090053797 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214090053797 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214090053797 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214090053798 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214090053798 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214090053798 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214090053810 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214090053818 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214090053818 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214090053818 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:00:57.048624 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31176): Terminating (SIGTERM) 09:00:57.090813 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31179): Terminating (SIGTERM) 09:00:57.132666 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31182): Terminating (SIGTERM) 09:00:57.174785 --- ParallelTerminationStrategy: PID 31176 died... 09:00:57.195051 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31176): Terminated: ok {rc=0} 09:00:57.241364 --- ParallelTerminationStrategy: PID 31179 died... 09:00:57.261164 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31179): Terminated: ok {rc=0} 09:00:57.307450 --- ParallelTerminationStrategy: PID 31182 died... 09:00:57.327146 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31182): Terminated: ok {rc=0} 09:00:57.415362 bus /gobi_0: Setting Powered False 09:00:58.511053 bus /gobi_0: Setting Powered False 09:00:59.625078 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2402 dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 nitb_sms:trx-umtrx --------------------------------------------------------------------- 09:01:00.911671 tst nitb_sms:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:01:00.916713 tst nitb_sms:trx-umtrx: Verifying 1 x bts (candidates: 11) 09:01:00.951473 tst nitb_sms:trx-umtrx: Verifying 1 x ip_address (candidates: 9) 09:01:00.959376 tst nitb_sms:trx-umtrx: Verifying 2 x modem (candidates: 12) 09:01:01.018354 tst nitb_sms:trx-umtrx: Reserving 1 x bts (candidates: 11) 09:01:01.063416 tst nitb_sms:trx-umtrx: Reserving 1 x ip_address (candidates: 9) 09:01:01.074686 tst nitb_sms:trx-umtrx: Reserving 2 x modem (candidates: 12) 09:01:01.605445 tst nitb_sms:trx-umtrx: RESERVED RESOURCES for nitb_sms: bts UmTRX ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2402 nitb_sms:trx-umtrx mo_mt_sms.py ---------------------------------------------- 09:01:01.614226 tst nitb_sms:trx-umtrx: Using 1 x ip_address (candidates: 1) 09:01:01.626037 tst nitb_sms:trx-umtrx: Using 1 x bts (candidates: 1) 09:01:01.680279 tst mo_mt_sms.py: using LAC 39834 09:01:01.832258 tst mo_mt_sms.py: using RAC 54 09:01:01.959904 tst mo_mt_sms.py: using CellId 39834 09:01:02.120486 tst mo_mt_sms.py: using BVCI 39835 09:01:02.265541 tst nitb_sms:trx-umtrx: Using 1 x modem (candidates: 2) 09:01:02.386885 tst nitb_sms:trx-umtrx: Using 1 x modem (candidates: 2) 09:01:02.502086 tst mo_mt_sms.py:9: start nitb and bts... 09:01:02.702963 run osmo-nitb_10.42.42.2: Starting osmo-nitb 09:01:03.312127 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=31187): Launched 09:01:03.610586 run osmo-nitb_10.42.42.2(pid=31188): Launched 09:01:03.777669 run osmo-nitb_10.42.42.2(pid=31188): ERR: Terminated: ERROR {rc=2} [trial-2402↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=31188)] 09:01:03.911723 run osmo-nitb_10.42.42.2(pid=31188): stdout: | (launched: 2022-12-14_09:01:03.555320) 09:01:04.047111 run osmo-nitb_10.42.42.2(pid=31188): stderr: | (launched: 2022-12-14_09:01:03.599531) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 09:01:04.182642 run osmo-nitb_10.42.42.2(pid=31188): stdout: | (launched: 2022-12-14_09:01:03.555320) 09:01:04.312250 run osmo-nitb_10.42.42.2(pid=31188): stderr: | (launched: 2022-12-14_09:01:03.599531) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fe4ae4b0268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=31188): Process ended prematurely: osmo-nitb_10.42.42.2(pid=31188) [trial-2402↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=31188)] 09:01:04.724624 tst osmo-nitb_10.42.42.2(pid=31188): stdout: | (launched: 2022-12-14_09:01:03.555320) 09:01:04.846000 tst osmo-nitb_10.42.42.2(pid=31188): stderr: | (launched: 2022-12-14_09:01:03.599531) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 09:01:04.987858 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=31188): Process ended prematurely: osmo-nitb_10.42.42.2(pid=31188) [trial-2402↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=31188)] [trial-2402↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11] 09:01:04.996617 tst mo_mt_sms.py:11: Test FAILED (3.4 sec) 09:01:05.003399 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=31187): Terminating (SIGTERM) 09:01:05.212543 --- ParallelTerminationStrategy: PID 31187 died... 09:01:05.233207 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=31187): Terminated: ok {rc=0} 09:01:05.319654 bus /sierra_3: Setting Powered False 09:01:06.420303 bus /sierra_3: Setting Powered False 09:01:07.536414 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2402 nitb_sms:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 sms:trx-umtrx --------------------------------------------------------------------- 09:01:08.732353 tst sms:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:01:08.736465 tst sms:trx-umtrx: Verifying 1 x bts (candidates: 11) 09:01:08.768437 tst sms:trx-umtrx: Verifying 6 x ip_address (candidates: 9) 09:01:08.796058 tst sms:trx-umtrx: Verifying 2 x modem (candidates: 12) 09:01:08.847063 tst sms:trx-umtrx: Reserving 1 x bts (candidates: 11) 09:01:08.878964 tst sms:trx-umtrx: Reserving 6 x ip_address (candidates: 9) 09:01:08.906100 tst sms:trx-umtrx: Reserving 2 x modem (candidates: 12) 09:01:09.453165 tst sms:trx-umtrx: RESERVED RESOURCES for sms: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2402 sms:trx-umtrx mo_mt_sms.py ---------------------------------------------- 09:01:09.458283 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 09:01:09.468879 tst sms:trx-umtrx: Using 1 x bts (candidates: 1) 09:01:09.515693 tst mo_mt_sms.py: using LAC 39835 09:01:09.634700 tst mo_mt_sms.py: using RAC 55 09:01:09.753366 tst mo_mt_sms.py: using CellId 39835 09:01:09.872549 tst mo_mt_sms.py: using BVCI 39836 09:01:09.980564 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 09:01:09.991305 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 09:01:10.001886 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 09:01:10.012096 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 09:01:10.022496 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 09:01:10.033582 tst sms:trx-umtrx: Using 1 x modem (candidates: 2) 09:01:10.157120 tst sms:trx-umtrx: Using 1 x modem (candidates: 2) 09:01:10.273579 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:01:10.736515 run create_hlr_db(pid=31192): Launched 09:01:10.849685 bus /sierra_2: Setting Powered False 09:01:11.909495 run create_hlr_db(pid=31192): Terminated: ok {rc=0} 09:01:12.346689 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31194): Launched 09:01:12.666968 run osmo-hlr_10.42.42.2(pid=31195): Launched 09:01:12.789472 run osmo-stp_10.42.42.5: Starting osmo-stp 09:01:13.344334 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31197): Launched 09:01:13.664858 run osmo-stp_10.42.42.5(pid=31198): Launched 09:01:13.787440 run osmo-msc_10.42.42.6: Starting osmo-msc 09:01:14.367518 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31200): Launched 09:01:14.689120 run osmo-msc_10.42.42.6(pid=31201): Launched 09:01:14.867667 run osmo-stp_10.42.42.5(pid=31198): ERR: Terminated: ERROR {rc=1} [trial-2402↪sms:trx-umtrx↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31198)] 09:01:15.002463 run osmo-stp_10.42.42.5(pid=31198): stdout: | (launched: 2022-12-14_09:01:13.605749) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:01:15.137974 run osmo-stp_10.42.42.5(pid=31198): stderr: | 20221214090113797 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214090113797 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214090113797 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214090113798 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214090113798 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214090113799 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214090113799 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:01:15.272494 run osmo-stp_10.42.42.5(pid=31198): stdout: | (launched: 2022-12-14_09:01:13.605749) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:01:15.399219 run osmo-stp_10.42.42.5(pid=31198): stderr: | 20221214090113797 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214090113797 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214090113797 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214090113798 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214090113798 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214090113799 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214090113799 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:01:15.551208 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=31198): Process ended prematurely: osmo-stp_10.42.42.5(pid=31198) [trial-2402↪sms:trx-umtrx↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31198)] [trial-2402↪sms:trx-umtrx↪mo_mt_sms.py:16] 09:01:15.560182 tst mo_mt_sms.py:16: Test FAILED (6.1 sec) 09:01:15.587441 run osmo-hlr_10.42.42.2(pid=31195): ERR: Terminated: ERROR {rc=237} [trial-2402↪sms:trx-umtrx↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31195)] 09:01:15.637357 run osmo-hlr_10.42.42.2(pid=31195): stdout: | (launched: 2022-12-14_09:01:12.608178) 09:01:15.689290 run osmo-hlr_10.42.42.2(pid=31195): stderr: | 20221214090112806 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214090112806 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214090112806 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214090112806 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214090112806 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214090112806 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214090112818 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/sms:trx-umtrx/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214090112826 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214090112826 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214090112826 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:01:15.761707 run osmo-msc_10.42.42.6(pid=31201): ERR: Terminated: ERROR {rc=2} [trial-2402↪sms:trx-umtrx↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31201)] 09:01:15.811616 run osmo-msc_10.42.42.6(pid=31201): stdout: | (launched: 2022-12-14_09:01:14.629906) 09:01:15.863613 run osmo-msc_10.42.42.6(pid=31201): stderr: | 20221214090114951 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214090114951 DLGLOBAL DEBUG validating counter group 0x7fbbfb7f7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214090114951 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214090114951 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214090114952 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214090114952 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214090114954 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214090114954 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214090114954 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214090114954 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:01:15.922408 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31194): Terminating (SIGTERM) 09:01:15.965217 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31197): Terminating (SIGTERM) 09:01:16.008607 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31200): Terminating (SIGTERM) 09:01:16.051290 --- ParallelTerminationStrategy: PID 31194 died... 09:01:16.071386 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31194): Terminated: ok {rc=0} 09:01:16.118426 --- ParallelTerminationStrategy: PID 31197 died... 09:01:16.138548 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31197): Terminated: ok {rc=0} 09:01:16.185273 --- ParallelTerminationStrategy: PID 31200 died... 09:01:16.207953 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31200): Terminated: ok {rc=0} 09:01:16.300861 bus /sierra_3: Setting Powered False 09:01:17.411411 bus /sierra_3: Setting Powered False 09:01:18.527760 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2402 sms:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 nitb_ussd:trx-umtrx --------------------------------------------------------------------- 09:01:19.760872 tst nitb_ussd:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:01:19.765618 tst nitb_ussd:trx-umtrx: Verifying 1 x bts (candidates: 11) 09:01:19.799161 tst nitb_ussd:trx-umtrx: Verifying 1 x ip_address (candidates: 9) 09:01:19.806700 tst nitb_ussd:trx-umtrx: Verifying 1 x modem (candidates: 12) 09:01:19.842736 tst nitb_ussd:trx-umtrx: Reserving 1 x bts (candidates: 11) 09:01:19.876072 tst nitb_ussd:trx-umtrx: Reserving 1 x ip_address (candidates: 9) 09:01:19.883139 tst nitb_ussd:trx-umtrx: Reserving 1 x modem (candidates: 12) 09:01:20.402768 tst nitb_ussd:trx-umtrx: RESERVED RESOURCES for nitb_ussd: bts UmTRX ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2402 nitb_ussd:trx-umtrx assert_extension.py ---------------------------------------------- 09:01:20.407874 tst nitb_ussd:trx-umtrx: Using 1 x ip_address (candidates: 1) 09:01:20.419106 tst nitb_ussd:trx-umtrx: Using 1 x bts (candidates: 1) 09:01:20.466732 tst assert_extension.py: using LAC 39836 09:01:20.591836 tst assert_extension.py: using RAC 56 09:01:20.717139 tst assert_extension.py: using CellId 39836 09:01:20.841800 tst assert_extension.py: using BVCI 39837 09:01:20.957518 tst nitb_ussd:trx-umtrx: Using 1 x modem (candidates: 1) 09:01:21.073609 tst assert_extension.py:10: start nitb and bts... 09:01:21.273714 run osmo-nitb_10.42.42.2: Starting osmo-nitb 09:01:21.893807 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=31206): Launched 09:01:22.220454 run osmo-nitb_10.42.42.2(pid=31207): Launched 09:01:22.398848 run osmo-nitb_10.42.42.2(pid=31207): ERR: Terminated: ERROR {rc=2} [trial-2402↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=31207)] 09:01:22.542120 run osmo-nitb_10.42.42.2(pid=31207): stdout: | (launched: 2022-12-14_09:01:22.161588) 09:01:22.687078 run osmo-nitb_10.42.42.2(pid=31207): stderr: | (launched: 2022-12-14_09:01:22.209254) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 09:01:22.831202 run osmo-nitb_10.42.42.2(pid=31207): stdout: | (launched: 2022-12-14_09:01:22.161588) 09:01:22.970379 run osmo-nitb_10.42.42.2(pid=31207): stderr: | (launched: 2022-12-14_09:01:22.209254) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fe4ae4b0268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=31207): Process ended prematurely: osmo-nitb_10.42.42.2(pid=31207) [trial-2402↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=31207)] 09:01:23.341868 tst osmo-nitb_10.42.42.2(pid=31207): stdout: | (launched: 2022-12-14_09:01:22.161588) 09:01:23.470855 tst osmo-nitb_10.42.42.2(pid=31207): stderr: | (launched: 2022-12-14_09:01:22.209254) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 09:01:23.623275 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=31207): Process ended prematurely: osmo-nitb_10.42.42.2(pid=31207) [trial-2402↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=31207)] [trial-2402↪nitb_ussd:trx-umtrx↪assert_extension.py:12] 09:01:23.632616 tst assert_extension.py:12: Test FAILED (3.2 sec) 09:01:23.639910 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=31206): Terminating (SIGTERM) 09:01:23.851360 --- ParallelTerminationStrategy: PID 31206 died... 09:01:23.873124 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=31206): Terminated: ok {rc=0} 09:01:23.960744 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2402 nitb_ussd:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 ussd:trx-umtrx --------------------------------------------------------------------- 09:01:25.137379 tst ussd:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:01:25.141765 tst ussd:trx-umtrx: Verifying 1 x bts (candidates: 11) 09:01:25.173833 tst ussd:trx-umtrx: Verifying 6 x ip_address (candidates: 9) 09:01:25.200912 tst ussd:trx-umtrx: Verifying 1 x modem (candidates: 12) 09:01:25.237006 tst ussd:trx-umtrx: Reserving 1 x bts (candidates: 11) 09:01:25.270294 tst ussd:trx-umtrx: Reserving 6 x ip_address (candidates: 9) 09:01:25.296938 tst ussd:trx-umtrx: Reserving 1 x modem (candidates: 12) 09:01:25.823605 tst ussd:trx-umtrx: RESERVED RESOURCES for ussd: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2402 ussd:trx-umtrx assert_extension.py ---------------------------------------------- 09:01:25.828460 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 09:01:25.838983 tst ussd:trx-umtrx: Using 1 x bts (candidates: 1) 09:01:25.889425 tst assert_extension.py: using LAC 39837 09:01:26.007198 tst assert_extension.py: using RAC 57 09:01:26.122498 tst assert_extension.py: using CellId 39837 09:01:26.238199 tst assert_extension.py: using BVCI 39838 09:01:26.346452 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 09:01:26.357276 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 09:01:26.367950 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 09:01:26.378604 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 09:01:26.389006 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 09:01:26.401155 tst ussd:trx-umtrx: Using 1 x modem (candidates: 1) 09:01:26.521298 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:01:27.018777 run create_hlr_db(pid=31211): Launched 09:01:27.149153 bus /sierra_2: Setting Powered False 09:01:28.212649 run create_hlr_db(pid=31211): Terminated: ok {rc=0} 09:01:28.640526 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31213): Launched 09:01:28.940851 run osmo-hlr_10.42.42.2(pid=31214): Launched 09:01:29.055181 run osmo-stp_10.42.42.5: Starting osmo-stp 09:01:29.588383 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31216): Launched 09:01:29.886591 run osmo-stp_10.42.42.5(pid=31217): Launched 09:01:29.999717 run osmo-msc_10.42.42.6: Starting osmo-msc 09:01:30.538315 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31219): Launched 09:01:30.845291 run osmo-msc_10.42.42.6(pid=31220): Launched 09:01:31.131648 run osmo-stp_10.42.42.5(pid=31217): ERR: Terminated: ERROR {rc=1} [trial-2402↪ussd:trx-umtrx↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31217)] 09:01:31.397734 run osmo-stp_10.42.42.5(pid=31217): stdout: | (launched: 2022-12-14_09:01:29.830925) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:01:31.639461 run osmo-stp_10.42.42.5(pid=31217): stderr: | 20221214090129999 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214090129999 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214090130000 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214090130000 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214090130000 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214090130001 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214090130001 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:01:31.777552 run osmo-stp_10.42.42.5(pid=31217): stdout: | (launched: 2022-12-14_09:01:29.830925) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:01:31.909448 run osmo-stp_10.42.42.5(pid=31217): stderr: | 20221214090129999 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214090129999 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214090130000 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214090130000 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214090130000 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214090130001 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214090130001 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:01:32.066412 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=31217): Process ended prematurely: osmo-stp_10.42.42.5(pid=31217) [trial-2402↪ussd:trx-umtrx↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31217)] [trial-2402↪ussd:trx-umtrx↪assert_extension.py:17] 09:01:32.076228 tst assert_extension.py:17: Test FAILED (6.2 sec) 09:01:32.104924 run osmo-hlr_10.42.42.2(pid=31214): ERR: Terminated: ERROR {rc=237} [trial-2402↪ussd:trx-umtrx↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31214)] 09:01:32.157106 run osmo-hlr_10.42.42.2(pid=31214): stdout: | (launched: 2022-12-14_09:01:28.884829) 09:01:32.211949 run osmo-hlr_10.42.42.2(pid=31214): stderr: | 20221214090129059 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214090129059 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214090129059 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214090129059 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214090129059 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214090129059 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214090129071 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/ussd:trx-umtrx/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214090129079 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214090129079 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214090129080 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:01:32.286697 run osmo-msc_10.42.42.6(pid=31220): ERR: Terminated: ERROR {rc=2} [trial-2402↪ussd:trx-umtrx↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31220)] 09:01:32.337565 run osmo-msc_10.42.42.6(pid=31220): stdout: | (launched: 2022-12-14_09:01:30.780326) 09:01:32.390222 run osmo-msc_10.42.42.6(pid=31220): stderr: | 20221214090131330 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214090131330 DLGLOBAL DEBUG validating counter group 0x7f4bf9d33c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214090131331 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214090131331 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214090131331 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214090131331 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214090131333 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214090131333 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214090131333 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214090131334 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:01:32.443384 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31213): Terminating (SIGTERM) 09:01:32.486324 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31216): Terminating (SIGTERM) 09:01:32.529335 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31219): Terminating (SIGTERM) 09:01:32.572210 --- ParallelTerminationStrategy: PID 31213 died... 09:01:32.592571 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31213): Terminated: ok {rc=0} 09:01:32.639636 --- ParallelTerminationStrategy: PID 31216 died... 09:01:32.659368 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31216): Terminated: ok {rc=0} 09:01:32.705809 --- ParallelTerminationStrategy: PID 31219 died... 09:01:32.725453 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31219): Terminated: ok {rc=0} 09:01:32.814111 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2402 ussd:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 09:01:34.025257 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:01:34.032537 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 09:01:34.066119 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 09:01:34.094151 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 09:01:34.147397 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 09:01:34.179716 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 09:01:34.206554 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 09:01:34.759492 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2402 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 09:01:34.812374 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:01:34.824186 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 09:01:34.895253 tst mo_mt_call.py: using LAC 39838 09:01:35.025037 tst mo_mt_call.py: using RAC 58 09:01:35.155230 tst mo_mt_call.py: using CellId 39838 09:01:35.283430 tst mo_mt_call.py: using BVCI 39839 09:01:35.402735 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:01:35.414475 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:01:35.425957 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:01:35.437516 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:01:35.449084 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:01:35.460561 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 09:01:35.578578 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 09:01:35.699467 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:01:36.207244 run create_hlr_db(pid=31225): Launched 09:01:36.341145 bus /sierra_2: Setting Powered False 09:01:37.405649 run create_hlr_db(pid=31225): Terminated: ok {rc=0} 09:01:37.859331 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31227): Launched 09:01:38.187647 run osmo-hlr_10.42.42.2(pid=31228): Launched 09:01:38.311395 run osmo-stp_10.42.42.5: Starting osmo-stp 09:01:38.878733 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31230): Launched 09:01:39.206694 run osmo-stp_10.42.42.5(pid=31231): Launched 09:01:39.331678 run osmo-msc_10.42.42.6: Starting osmo-msc 09:01:39.922953 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31233): Launched 09:01:40.250646 run osmo-msc_10.42.42.6(pid=31234): Launched 09:01:40.433090 run osmo-stp_10.42.42.5(pid=31231): ERR: Terminated: ERROR {rc=1} [trial-2402↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31231)] 09:01:40.569846 run osmo-stp_10.42.42.5(pid=31231): stdout: | (launched: 2022-12-14_09:01:39.146649) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:01:40.706891 run osmo-stp_10.42.42.5(pid=31231): stderr: | 20221214090139338 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214090139338 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214090139339 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214090139339 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214090139339 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214090139339 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214090139340 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:01:40.843526 run osmo-stp_10.42.42.5(pid=31231): stdout: | (launched: 2022-12-14_09:01:39.146649) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:01:40.973392 run osmo-stp_10.42.42.5(pid=31231): stderr: | 20221214090139338 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214090139338 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214090139339 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214090139339 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214090139339 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214090139339 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214090139340 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:01:41.129339 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31231): Process ended prematurely: osmo-stp_10.42.42.5(pid=31231) [trial-2402↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31231)] [trial-2402↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 09:01:41.139273 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 09:01:41.167519 run osmo-hlr_10.42.42.2(pid=31228): ERR: Terminated: ERROR {rc=237} [trial-2402↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31228)] 09:01:41.218336 run osmo-hlr_10.42.42.2(pid=31228): stdout: | (launched: 2022-12-14_09:01:38.127438) 09:01:41.270853 run osmo-hlr_10.42.42.2(pid=31228): stderr: | 20221214090138324 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214090138325 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214090138325 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214090138325 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214090138325 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214090138325 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214090138338 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214090138346 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214090138346 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214090138347 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:01:41.344184 run osmo-msc_10.42.42.6(pid=31234): ERR: Terminated: ERROR {rc=2} [trial-2402↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31234)] 09:01:41.394802 run osmo-msc_10.42.42.6(pid=31234): stdout: | (launched: 2022-12-14_09:01:40.190586) 09:01:41.446931 run osmo-msc_10.42.42.6(pid=31234): stderr: | 20221214090140514 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214090140514 DLGLOBAL DEBUG validating counter group 0x7fab5fd3dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214090140514 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214090140514 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214090140514 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214090140514 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214090140516 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214090140516 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214090140517 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214090140517 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:01:41.499186 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31227): Terminating (SIGTERM) 09:01:41.540881 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31230): Terminating (SIGTERM) 09:01:41.582920 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31233): Terminating (SIGTERM) 09:01:41.625975 --- ParallelTerminationStrategy: PID 31227 died... 09:01:41.646403 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31227): Terminated: ok {rc=0} 09:01:41.693048 --- ParallelTerminationStrategy: PID 31230 died... 09:01:41.713088 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31230): Terminated: ok {rc=0} 09:01:41.759637 --- ParallelTerminationStrategy: PID 31233 died... 09:01:41.779640 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31233): Terminated: ok {rc=0} 09:01:41.868502 bus /sierra_3: Setting Powered False 09:01:42.967912 bus /sierra_3: Setting Powered False 09:01:44.083772 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2402 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 09:01:45.233032 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:01:45.245537 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 09:01:45.316845 tst mo_mt_call_osmux.py: using LAC 39839 09:01:45.448168 tst mo_mt_call_osmux.py: using RAC 59 09:01:45.576615 tst mo_mt_call_osmux.py: using CellId 39839 09:01:45.705469 tst mo_mt_call_osmux.py: using BVCI 39840 09:01:45.826775 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:01:45.845787 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:01:45.861041 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:01:45.873555 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:01:45.886380 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:01:45.898734 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 09:01:46.035456 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 09:01:46.196091 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:01:46.721553 run create_hlr_db(pid=31236): Launched 09:01:46.856121 bus /sierra_2: Setting Powered False 09:01:47.917346 run create_hlr_db(pid=31236): Terminated: ok {rc=0} 09:01:48.342148 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31238): Launched 09:01:48.649154 run osmo-hlr_10.42.42.2(pid=31239): Launched 09:01:48.764910 run osmo-stp_10.42.42.5: Starting osmo-stp 09:01:49.302286 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31241): Launched 09:01:49.606937 run osmo-stp_10.42.42.5(pid=31242): Launched 09:01:49.723450 run osmo-msc_10.42.42.6: Starting osmo-msc 09:01:50.277202 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31244): Launched 09:01:50.582806 run osmo-msc_10.42.42.6(pid=31245): Launched 09:01:50.755307 run osmo-stp_10.42.42.5(pid=31242): ERR: Terminated: ERROR {rc=1} [trial-2402↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31242)] 09:01:50.883864 run osmo-stp_10.42.42.5(pid=31242): stdout: | (launched: 2022-12-14_09:01:49.550197) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:01:51.012641 run osmo-stp_10.42.42.5(pid=31242): stderr: | 20221214090149723 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214090149723 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214090149723 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214090149724 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214090149724 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214090149724 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214090149724 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:01:51.139908 run osmo-stp_10.42.42.5(pid=31242): stdout: | (launched: 2022-12-14_09:01:49.550197) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:01:51.260785 run osmo-stp_10.42.42.5(pid=31242): stderr: | 20221214090149723 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214090149723 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214090149723 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214090149724 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214090149724 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214090149724 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214090149724 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:01:51.406482 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31242): Process ended prematurely: osmo-stp_10.42.42.5(pid=31242) [trial-2402↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31242)] [trial-2402↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 09:01:51.415636 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 09:01:51.442335 run osmo-hlr_10.42.42.2(pid=31239): ERR: Terminated: ERROR {rc=237} [trial-2402↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31239)] 09:01:51.491036 run osmo-hlr_10.42.42.2(pid=31239): stdout: | (launched: 2022-12-14_09:01:48.592725) 09:01:51.541158 run osmo-hlr_10.42.42.2(pid=31239): stderr: | 20221214090148769 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214090148769 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214090148769 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214090148769 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214090148769 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214090148769 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214090148780 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214090148789 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214090148789 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214090148789 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:01:51.611207 run osmo-msc_10.42.42.6(pid=31245): ERR: Terminated: ERROR {rc=2} [trial-2402↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31245)] 09:01:51.659323 run osmo-msc_10.42.42.6(pid=31245): stdout: | (launched: 2022-12-14_09:01:50.526051) 09:01:51.709691 run osmo-msc_10.42.42.6(pid=31245): stderr: | 20221214090150796 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214090150796 DLGLOBAL DEBUG validating counter group 0x7f8b441b5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214090150796 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214090150796 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214090150796 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214090150796 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214090150798 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214090150798 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214090150799 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214090150799 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:01:51.760231 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31238): Terminating (SIGTERM) 09:01:51.800640 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31241): Terminating (SIGTERM) 09:01:51.841219 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31244): Terminating (SIGTERM) 09:01:51.882180 --- ParallelTerminationStrategy: PID 31238 died... 09:01:51.902030 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31238): Terminated: ok {rc=0} 09:01:51.946670 --- ParallelTerminationStrategy: PID 31241 died... 09:01:51.965772 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31241): Terminated: ok {rc=0} 09:01:52.010105 --- ParallelTerminationStrategy: PID 31244 died... 09:01:52.029312 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31244): Terminated: ok {rc=0} 09:01:52.116270 bus /sierra_3: Setting Powered False 09:01:53.215635 bus /sierra_3: Setting Powered False 09:01:54.330355 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2402 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 09:01:55.584770 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:01:55.592052 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 09:01:55.625365 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 09:01:55.652809 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 09:01:55.705919 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 09:01:55.738521 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 09:01:55.765559 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 09:01:56.314748 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2402 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 09:01:56.363443 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:01:56.374608 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 09:01:56.442194 tst mo_mt_call.py: using LAC 39840 09:01:56.561365 tst mo_mt_call.py: using RAC 60 09:01:56.680689 tst mo_mt_call.py: using CellId 39840 09:01:56.801597 tst mo_mt_call.py: using BVCI 39841 09:01:56.921929 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:01:56.933890 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:01:56.945519 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:01:56.957131 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:01:56.969418 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:01:56.981679 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 09:01:57.099882 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 09:01:57.220877 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:01:57.728499 run create_hlr_db(pid=31250): Launched 09:01:57.862193 bus /sierra_2: Setting Powered False 09:01:58.926790 run create_hlr_db(pid=31250): Terminated: ok {rc=0} 09:01:59.363041 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31252): Launched 09:01:59.670260 run osmo-hlr_10.42.42.2(pid=31253): Launched 09:01:59.788643 run osmo-stp_10.42.42.5: Starting osmo-stp 09:02:00.327996 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31255): Launched 09:02:00.634045 run osmo-stp_10.42.42.5(pid=31256): Launched 09:02:00.750944 run osmo-msc_10.42.42.6: Starting osmo-msc 09:02:01.335339 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31258): Launched 09:02:01.698454 run osmo-msc_10.42.42.6(pid=31259): Launched 09:02:02.161836 run osmo-stp_10.42.42.5(pid=31256): ERR: Terminated: ERROR {rc=1} [trial-2402↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31256)] 09:02:02.422502 run osmo-stp_10.42.42.5(pid=31256): stdout: | (launched: 2022-12-14_09:02:00.577211) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:02:02.551668 run osmo-stp_10.42.42.5(pid=31256): stderr: | 20221214090200746 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214090200746 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214090200746 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214090200746 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214090200747 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214090200747 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214090200747 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:02:02.679351 run osmo-stp_10.42.42.5(pid=31256): stdout: | (launched: 2022-12-14_09:02:00.577211) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:02:02.800445 run osmo-stp_10.42.42.5(pid=31256): stderr: | 20221214090200746 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214090200746 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214090200746 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214090200746 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214090200747 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214090200747 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214090200747 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:02:02.946253 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31256): Process ended prematurely: osmo-stp_10.42.42.5(pid=31256) [trial-2402↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31256)] [trial-2402↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 09:02:02.955224 tst mo_mt_call.py:8: Test FAILED (6.6 sec) 09:02:02.981908 run osmo-hlr_10.42.42.2(pid=31253): ERR: Terminated: ERROR {rc=237} [trial-2402↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31253)] 09:02:03.030785 run osmo-hlr_10.42.42.2(pid=31253): stdout: | (launched: 2022-12-14_09:01:59.613353) 09:02:03.081279 run osmo-hlr_10.42.42.2(pid=31253): stderr: | 20221214090159788 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214090159788 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214090159788 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214090159788 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214090159788 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214090159789 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214090159801 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214090159809 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214090159809 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214090159809 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:02:03.151481 run osmo-msc_10.42.42.6(pid=31259): ERR: Terminated: ERROR {rc=2} [trial-2402↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31259)] 09:02:03.199388 run osmo-msc_10.42.42.6(pid=31259): stdout: | (launched: 2022-12-14_09:02:01.640079) 09:02:03.249337 run osmo-msc_10.42.42.6(pid=31259): stderr: | 20221214090202121 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214090202121 DLGLOBAL DEBUG validating counter group 0x7fc909853c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214090202121 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214090202121 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214090202121 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214090202121 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214090202123 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214090202123 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214090202124 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214090202124 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:02:03.299951 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31252): Terminating (SIGTERM) 09:02:03.340292 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31255): Terminating (SIGTERM) 09:02:03.380651 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31258): Terminating (SIGTERM) 09:02:03.421261 --- ParallelTerminationStrategy: PID 31252 died... 09:02:03.440749 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31252): Terminated: ok {rc=0} 09:02:03.485466 --- ParallelTerminationStrategy: PID 31255 died... 09:02:03.504499 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31255): Terminated: ok {rc=0} 09:02:03.549744 --- ParallelTerminationStrategy: PID 31258 died... 09:02:03.569059 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31258): Terminated: ok {rc=0} 09:02:03.656040 bus /sierra_3: Setting Powered False 09:02:04.755343 bus /sierra_3: Setting Powered False 09:02:05.871822 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2402 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 09:02:07.019112 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:02:07.031035 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 09:02:07.100860 tst mo_mt_call_osmux.py: using LAC 39841 09:02:07.221379 tst mo_mt_call_osmux.py: using RAC 61 09:02:07.343196 tst mo_mt_call_osmux.py: using CellId 39841 09:02:07.462432 tst mo_mt_call_osmux.py: using BVCI 39842 09:02:07.574686 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:02:07.585929 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:02:07.596835 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:02:07.607870 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:02:07.619151 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:02:07.630481 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 09:02:07.751688 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 09:02:07.875372 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:02:08.350259 run create_hlr_db(pid=31261): Launched 09:02:08.466388 bus /sierra_2: Setting Powered False 09:02:09.527114 run create_hlr_db(pid=31261): Terminated: ok {rc=0} 09:02:09.973333 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31263): Launched 09:02:10.302006 run osmo-hlr_10.42.42.2(pid=31264): Launched 09:02:10.430716 run osmo-stp_10.42.42.5: Starting osmo-stp 09:02:10.997087 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31266): Launched 09:02:11.303041 run osmo-stp_10.42.42.5(pid=31267): Launched 09:02:11.420482 run osmo-msc_10.42.42.6: Starting osmo-msc 09:02:11.973022 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31269): Launched 09:02:12.277754 run osmo-msc_10.42.42.6(pid=31270): Launched 09:02:12.448346 run osmo-stp_10.42.42.5(pid=31267): ERR: Terminated: ERROR {rc=1} [trial-2402↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31267)] 09:02:12.576817 run osmo-stp_10.42.42.5(pid=31267): stdout: | (launched: 2022-12-14_09:02:11.246803) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:02:12.705491 run osmo-stp_10.42.42.5(pid=31267): stderr: | 20221214090211420 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214090211421 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214090211421 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214090211421 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214090211422 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214090211422 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214090211422 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:02:12.832077 run osmo-stp_10.42.42.5(pid=31267): stdout: | (launched: 2022-12-14_09:02:11.246803) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:02:12.952706 run osmo-stp_10.42.42.5(pid=31267): stderr: | 20221214090211420 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214090211421 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214090211421 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214090211421 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214090211422 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214090211422 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214090211422 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:02:13.097464 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31267): Process ended prematurely: osmo-stp_10.42.42.5(pid=31267) [trial-2402↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31267)] [trial-2402↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 09:02:13.106419 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 09:02:13.132581 run osmo-hlr_10.42.42.2(pid=31264): ERR: Terminated: ERROR {rc=237} [trial-2402↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31264)] 09:02:13.181490 run osmo-hlr_10.42.42.2(pid=31264): stdout: | (launched: 2022-12-14_09:02:10.242106) 09:02:13.231000 run osmo-hlr_10.42.42.2(pid=31264): stderr: | 20221214090210442 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214090210442 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214090210442 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214090210442 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214090210442 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214090210442 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214090210454 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214090210462 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214090210463 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214090210463 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:02:13.300700 run osmo-msc_10.42.42.6(pid=31270): ERR: Terminated: ERROR {rc=2} [trial-2402↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31270)] 09:02:13.348004 run osmo-msc_10.42.42.6(pid=31270): stdout: | (launched: 2022-12-14_09:02:12.221471) 09:02:13.397445 run osmo-msc_10.42.42.6(pid=31270): stderr: | 20221214090212493 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214090212493 DLGLOBAL DEBUG validating counter group 0x7f1fda5fbc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214090212493 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214090212493 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214090212493 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214090212494 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214090212495 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214090212496 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214090212496 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214090212496 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:02:13.447061 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31263): Terminating (SIGTERM) 09:02:13.486903 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31266): Terminating (SIGTERM) 09:02:13.526832 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31269): Terminating (SIGTERM) 09:02:13.566935 --- ParallelTerminationStrategy: PID 31263 died... 09:02:13.586214 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31263): Terminated: ok {rc=0} 09:02:13.630211 --- ParallelTerminationStrategy: PID 31266 died... 09:02:13.648912 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31266): Terminated: ok {rc=0} 09:02:13.692754 --- ParallelTerminationStrategy: PID 31269 died... 09:02:13.711629 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31269): Terminated: ok {rc=0} 09:02:13.795679 bus /sierra_3: Setting Powered False 09:02:14.893278 bus /sierra_3: Setting Powered False 09:02:16.019945 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2402 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 09:02:17.297955 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:02:17.304669 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 09:02:17.337154 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 09:02:17.364759 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 09:02:17.416329 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 09:02:17.448543 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 09:02:17.475238 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 09:02:18.025903 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2402 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 09:02:18.075414 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:02:18.086761 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 09:02:18.156397 tst mo_mt_call.py: using LAC 39842 09:02:18.282062 tst mo_mt_call.py: using RAC 62 09:02:18.416394 tst mo_mt_call.py: using CellId 39842 09:02:18.538773 tst mo_mt_call.py: using BVCI 39843 09:02:18.652608 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:02:18.663911 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:02:18.674983 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:02:18.686116 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:02:18.697777 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:02:18.709313 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 09:02:18.824306 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 09:02:18.945175 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:02:19.420003 run create_hlr_db(pid=31275): Launched 09:02:19.536595 bus /sierra_2: Setting Powered False 09:02:20.597470 run create_hlr_db(pid=31275): Terminated: ok {rc=0} 09:02:21.043041 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31277): Launched 09:02:21.372758 run osmo-hlr_10.42.42.2(pid=31278): Launched 09:02:21.497872 run osmo-stp_10.42.42.5: Starting osmo-stp 09:02:22.067773 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31280): Launched 09:02:22.396746 run osmo-stp_10.42.42.5(pid=31281): Launched 09:02:22.521437 run osmo-msc_10.42.42.6: Starting osmo-msc 09:02:23.114584 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31283): Launched 09:02:23.443182 run osmo-msc_10.42.42.6(pid=31284): Launched 09:02:23.625278 run osmo-stp_10.42.42.5(pid=31281): ERR: Terminated: ERROR {rc=1} [trial-2402↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31281)] 09:02:23.762581 run osmo-stp_10.42.42.5(pid=31281): stdout: | (launched: 2022-12-14_09:02:22.336610) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:02:23.900825 run osmo-stp_10.42.42.5(pid=31281): stderr: | 20221214090222531 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214090222531 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214090222531 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214090222531 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214090222532 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214090222532 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214090222532 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:02:24.038625 run osmo-stp_10.42.42.5(pid=31281): stdout: | (launched: 2022-12-14_09:02:22.336610) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:02:24.169269 run osmo-stp_10.42.42.5(pid=31281): stderr: | 20221214090222531 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214090222531 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214090222531 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214090222531 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214090222532 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214090222532 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214090222532 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:02:24.324463 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31281): Process ended prematurely: osmo-stp_10.42.42.5(pid=31281) [trial-2402↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31281)] [trial-2402↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 09:02:24.334487 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 09:02:24.362748 run osmo-hlr_10.42.42.2(pid=31278): ERR: Terminated: ERROR {rc=237} [trial-2402↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31278)] 09:02:24.413651 run osmo-hlr_10.42.42.2(pid=31278): stdout: | (launched: 2022-12-14_09:02:21.312287) 09:02:24.466161 run osmo-hlr_10.42.42.2(pid=31278): stderr: | 20221214090221511 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214090221511 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214090221511 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214090221511 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214090221511 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214090221511 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214090221524 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214090221532 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214090221532 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214090221532 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:02:24.539297 run osmo-msc_10.42.42.6(pid=31284): ERR: Terminated: ERROR {rc=2} [trial-2402↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31284)] 09:02:24.589886 run osmo-msc_10.42.42.6(pid=31284): stdout: | (launched: 2022-12-14_09:02:23.383224) 09:02:24.642229 run osmo-msc_10.42.42.6(pid=31284): stderr: | 20221214090223706 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214090223706 DLGLOBAL DEBUG validating counter group 0x7fce9027ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214090223706 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214090223706 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214090223707 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214090223707 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214090223708 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214090223709 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214090223709 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214090223709 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:02:24.694602 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31277): Terminating (SIGTERM) 09:02:24.736398 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31280): Terminating (SIGTERM) 09:02:24.778317 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31283): Terminating (SIGTERM) 09:02:24.820347 --- ParallelTerminationStrategy: PID 31277 died... 09:02:24.840872 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31277): Terminated: ok {rc=0} 09:02:24.887380 --- ParallelTerminationStrategy: PID 31280 died... 09:02:24.907235 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31280): Terminated: ok {rc=0} 09:02:24.953630 --- ParallelTerminationStrategy: PID 31283 died... 09:02:24.973352 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31283): Terminated: ok {rc=0} 09:02:25.060779 bus /sierra_3: Setting Powered False 09:02:26.160283 bus /sierra_3: Setting Powered False 09:02:27.276178 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2402 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 09:02:28.428117 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:02:28.440506 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 09:02:28.513561 tst mo_mt_call_osmux.py: using LAC 39843 09:02:28.644120 tst mo_mt_call_osmux.py: using RAC 63 09:02:28.772936 tst mo_mt_call_osmux.py: using CellId 39843 09:02:28.901713 tst mo_mt_call_osmux.py: using BVCI 39844 09:02:29.022593 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:02:29.034454 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:02:29.045975 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:02:29.057513 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:02:29.069779 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:02:29.081881 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 09:02:29.200665 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 09:02:29.319103 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:02:29.796090 run create_hlr_db(pid=31286): Launched 09:02:29.913722 bus /sierra_2: Setting Powered False 09:02:30.986144 run create_hlr_db(pid=31286): Terminated: ok {rc=0} 09:02:31.477788 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31288): Launched 09:02:31.822202 run osmo-hlr_10.42.42.2(pid=31289): Launched 09:02:32.096177 run osmo-stp_10.42.42.5: Starting osmo-stp 09:02:32.667525 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31291): Launched 09:02:32.973126 run osmo-stp_10.42.42.5(pid=31292): Launched 09:02:33.091477 run osmo-msc_10.42.42.6: Starting osmo-msc 09:02:33.645129 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31294): Launched 09:02:33.950448 run osmo-msc_10.42.42.6(pid=31295): Launched 09:02:34.122500 run osmo-stp_10.42.42.5(pid=31292): ERR: Terminated: ERROR {rc=1} [trial-2402↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31292)] 09:02:34.251400 run osmo-stp_10.42.42.5(pid=31292): stdout: | (launched: 2022-12-14_09:02:32.916463) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:02:34.380340 run osmo-stp_10.42.42.5(pid=31292): stderr: | 20221214090233089 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214090233089 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214090233089 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214090233090 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214090233090 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214090233090 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214090233090 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:02:34.507158 run osmo-stp_10.42.42.5(pid=31292): stdout: | (launched: 2022-12-14_09:02:32.916463) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:02:34.628096 run osmo-stp_10.42.42.5(pid=31292): stderr: | 20221214090233089 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214090233089 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214090233089 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214090233090 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214090233090 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214090233090 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214090233090 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:02:34.773092 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31292): Process ended prematurely: osmo-stp_10.42.42.5(pid=31292) [trial-2402↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31292)] [trial-2402↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 09:02:34.782279 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 09:02:34.809120 run osmo-hlr_10.42.42.2(pid=31289): ERR: Terminated: ERROR {rc=237} [trial-2402↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31289)] 09:02:34.857738 run osmo-hlr_10.42.42.2(pid=31289): stdout: | (launched: 2022-12-14_09:02:31.761062) 09:02:34.907605 run osmo-hlr_10.42.42.2(pid=31289): stderr: | 20221214090231968 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214090231968 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214090231968 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214090231968 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214090231968 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214090231968 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214090231983 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214090232005 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214090232006 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214090232006 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:02:34.978057 run osmo-msc_10.42.42.6(pid=31295): ERR: Terminated: ERROR {rc=2} [trial-2402↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31295)] 09:02:35.025780 run osmo-msc_10.42.42.6(pid=31295): stdout: | (launched: 2022-12-14_09:02:33.894043) 09:02:35.075890 run osmo-msc_10.42.42.6(pid=31295): stderr: | 20221214090234165 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214090234166 DLGLOBAL DEBUG validating counter group 0x7f5578350c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214090234166 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214090234166 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214090234166 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214090234166 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214090234168 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214090234168 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214090234168 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214090234168 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:02:35.126322 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31288): Terminating (SIGTERM) 09:02:35.166898 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31291): Terminating (SIGTERM) 09:02:35.207489 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31294): Terminating (SIGTERM) 09:02:35.248020 --- ParallelTerminationStrategy: PID 31288 died... 09:02:35.267698 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31288): Terminated: ok {rc=0} 09:02:35.312298 --- ParallelTerminationStrategy: PID 31291 died... 09:02:35.331625 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31291): Terminated: ok {rc=0} 09:02:35.375947 --- ParallelTerminationStrategy: PID 31294 died... 09:02:35.395164 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31294): Terminated: ok {rc=0} 09:02:35.482220 bus /sierra_3: Setting Powered False 09:02:36.580898 bus /sierra_3: Setting Powered False 09:02:37.696356 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2402 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 09:02:38.943967 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:02:38.950782 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 09:02:38.982802 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 09:02:39.010488 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 09:02:39.062708 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 09:02:39.095866 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 09:02:39.122907 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 09:02:39.671448 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2402 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 09:02:39.721502 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 09:02:39.732723 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 09:02:39.802058 tst mo_mt_call.py: using LAC 39844 09:02:39.922579 tst mo_mt_call.py: using RAC 64 09:02:40.044918 tst mo_mt_call.py: using CellId 39844 09:02:40.175359 tst mo_mt_call.py: using BVCI 39845 09:02:40.295366 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 09:02:40.307148 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 09:02:40.318994 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 09:02:40.330693 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 09:02:40.342618 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 09:02:40.354508 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 09:02:40.473834 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 09:02:40.597851 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:02:41.104839 run create_hlr_db(pid=31300): Launched 09:02:41.234081 bus /sierra_2: Setting Powered False 09:02:42.294682 run create_hlr_db(pid=31300): Terminated: ok {rc=0} 09:02:42.720159 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31302): Launched 09:02:43.025309 run osmo-hlr_10.42.42.2(pid=31303): Launched 09:02:43.141643 run osmo-stp_10.42.42.5: Starting osmo-stp 09:02:43.679136 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31305): Launched 09:02:43.985283 run osmo-stp_10.42.42.5(pid=31306): Launched 09:02:44.101543 run osmo-msc_10.42.42.6: Starting osmo-msc 09:02:44.655559 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31308): Launched 09:02:44.962004 run osmo-msc_10.42.42.6(pid=31309): Launched 09:02:45.133288 run osmo-stp_10.42.42.5(pid=31306): ERR: Terminated: ERROR {rc=1} [trial-2402↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31306)] 09:02:45.262471 run osmo-stp_10.42.42.5(pid=31306): stdout: | (launched: 2022-12-14_09:02:43.928433) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:02:45.391719 run osmo-stp_10.42.42.5(pid=31306): stderr: | 20221214090244099 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214090244099 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214090244099 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214090244100 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214090244100 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214090244100 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214090244100 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:02:45.518602 run osmo-stp_10.42.42.5(pid=31306): stdout: | (launched: 2022-12-14_09:02:43.928433) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:02:45.639925 run osmo-stp_10.42.42.5(pid=31306): stderr: | 20221214090244099 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214090244099 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214090244099 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214090244100 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214090244100 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214090244100 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214090244100 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:02:45.784810 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31306): Process ended prematurely: osmo-stp_10.42.42.5(pid=31306) [trial-2402↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31306)] [trial-2402↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 09:02:45.793805 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 09:02:45.820434 run osmo-hlr_10.42.42.2(pid=31303): ERR: Terminated: ERROR {rc=237} [trial-2402↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31303)] 09:02:45.879014 run osmo-hlr_10.42.42.2(pid=31303): stdout: | (launched: 2022-12-14_09:02:42.968716) 09:02:45.955988 run osmo-hlr_10.42.42.2(pid=31303): stderr: | 20221214090243144 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214090243144 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214090243144 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214090243144 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214090243144 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214090243144 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214090243156 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214090243165 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214090243165 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214090243166 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:02:46.042978 run osmo-msc_10.42.42.6(pid=31309): ERR: Terminated: ERROR {rc=2} [trial-2402↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31309)] 09:02:46.092688 run osmo-msc_10.42.42.6(pid=31309): stdout: | (launched: 2022-12-14_09:02:44.904382) 09:02:46.145370 run osmo-msc_10.42.42.6(pid=31309): stderr: | 20221214090245177 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214090245177 DLGLOBAL DEBUG validating counter group 0x7fa64701bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214090245177 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214090245177 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214090245178 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214090245178 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214090245179 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214090245180 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214090245180 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214090245180 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:02:46.198265 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31302): Terminating (SIGTERM) 09:02:46.241438 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31305): Terminating (SIGTERM) 09:02:46.285272 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31308): Terminating (SIGTERM) 09:02:46.328065 --- ParallelTerminationStrategy: PID 31302 died... 09:02:46.349227 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31302): Terminated: ok {rc=0} 09:02:46.395950 --- ParallelTerminationStrategy: PID 31305 died... 09:02:46.416868 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31305): Terminated: ok {rc=0} 09:02:46.463582 --- ParallelTerminationStrategy: PID 31308 died... 09:02:46.484762 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31308): Terminated: ok {rc=0} 09:02:46.576205 bus /sierra_3: Setting Powered False 09:02:47.680066 bus /sierra_3: Setting Powered False 09:02:48.796521 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2402 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 09:02:49.946328 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 09:02:49.958897 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 09:02:50.031515 tst mo_mt_call_osmux.py: using LAC 39845 09:02:50.162340 tst mo_mt_call_osmux.py: using RAC 65 09:02:50.292090 tst mo_mt_call_osmux.py: using CellId 39845 09:02:50.421091 tst mo_mt_call_osmux.py: using BVCI 39846 09:02:50.540119 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 09:02:50.551818 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 09:02:50.563408 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 09:02:50.574903 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 09:02:50.586725 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 09:02:50.598412 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 09:02:50.717990 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 09:02:50.837907 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:02:51.345116 run create_hlr_db(pid=31311): Launched 09:02:51.479222 bus /sierra_2: Setting Powered False 09:02:52.542872 run create_hlr_db(pid=31311): Terminated: ok {rc=0} 09:02:52.978607 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31313): Launched 09:02:53.284721 run osmo-hlr_10.42.42.2(pid=31314): Launched 09:02:53.402394 run osmo-stp_10.42.42.5: Starting osmo-stp 09:02:53.941725 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31316): Launched 09:02:54.248221 run osmo-stp_10.42.42.5(pid=31317): Launched 09:02:54.364497 run osmo-msc_10.42.42.6: Starting osmo-msc 09:02:54.916623 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31319): Launched 09:02:55.221159 run osmo-msc_10.42.42.6(pid=31320): Launched 09:02:55.391779 run osmo-stp_10.42.42.5(pid=31317): ERR: Terminated: ERROR {rc=1} [trial-2402↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31317)] 09:02:55.520690 run osmo-stp_10.42.42.5(pid=31317): stdout: | (launched: 2022-12-14_09:02:54.190824) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:02:55.649204 run osmo-stp_10.42.42.5(pid=31317): stderr: | 20221214090254362 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214090254362 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214090254362 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214090254363 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214090254363 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214090254363 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214090254363 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:02:55.775766 run osmo-stp_10.42.42.5(pid=31317): stdout: | (launched: 2022-12-14_09:02:54.190824) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:02:55.896043 run osmo-stp_10.42.42.5(pid=31317): stderr: | 20221214090254362 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214090254362 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214090254362 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214090254363 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214090254363 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214090254363 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214090254363 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:02:56.039858 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31317): Process ended prematurely: osmo-stp_10.42.42.5(pid=31317) [trial-2402↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31317)] [trial-2402↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 09:02:56.048794 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 09:02:56.075213 run osmo-hlr_10.42.42.2(pid=31314): ERR: Terminated: ERROR {rc=237} [trial-2402↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31314)] 09:02:56.123850 run osmo-hlr_10.42.42.2(pid=31314): stdout: | (launched: 2022-12-14_09:02:53.228017) 09:02:56.173539 run osmo-hlr_10.42.42.2(pid=31314): stderr: | 20221214090253406 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214090253406 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214090253406 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214090253406 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214090253406 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214090253406 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214090253418 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214090253427 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214090253427 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214090253427 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:02:56.243198 run osmo-msc_10.42.42.6(pid=31320): ERR: Terminated: ERROR {rc=2} [trial-2402↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31320)] 09:02:56.290578 run osmo-msc_10.42.42.6(pid=31320): stdout: | (launched: 2022-12-14_09:02:55.164295) 09:02:56.339634 run osmo-msc_10.42.42.6(pid=31320): stderr: | 20221214090255438 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214090255438 DLGLOBAL DEBUG validating counter group 0x7fda05e11c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214090255438 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214090255438 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214090255438 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214090255439 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214090255440 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214090255441 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214090255441 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214090255441 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:02:56.389195 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31313): Terminating (SIGTERM) 09:02:56.429226 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31316): Terminating (SIGTERM) 09:02:56.469105 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31319): Terminating (SIGTERM) 09:02:56.509033 --- ParallelTerminationStrategy: PID 31313 died... 09:02:56.528327 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31313): Terminated: ok {rc=0} 09:02:56.572746 --- ParallelTerminationStrategy: PID 31316 died... 09:02:56.591698 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31316): Terminated: ok {rc=0} 09:02:56.635522 --- ParallelTerminationStrategy: PID 31319 died... 09:02:56.654520 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31319): Terminated: ok {rc=0} 09:02:56.738447 bus /sierra_3: Setting Powered False 09:02:57.833246 bus /sierra_3: Setting Powered False 09:02:58.945626 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2402 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 09:03:00.191328 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:03:00.198079 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 09:03:00.231064 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 09:03:00.259818 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 09:03:00.311792 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 09:03:00.344015 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 09:03:00.370894 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 09:03:00.941481 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2402 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 09:03:01.003973 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:03:01.016471 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 09:03:01.087905 tst mo_mt_call.py: using LAC 39846 09:03:01.212127 tst mo_mt_call.py: using RAC 66 09:03:01.378908 tst mo_mt_call.py: using CellId 39846 09:03:01.505814 tst mo_mt_call.py: using BVCI 39847 09:03:01.620616 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:03:01.633140 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:03:01.645392 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:03:01.657545 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:03:01.671080 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:03:01.684476 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 09:03:01.805615 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 09:03:01.927774 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:03:02.469390 run create_hlr_db(pid=31326): Launched 09:03:02.603897 bus /sierra_2: Setting Powered False 09:03:03.667525 run create_hlr_db(pid=31326): Terminated: ok {rc=0} 09:03:04.102718 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31328): Launched 09:03:04.408670 run osmo-hlr_10.42.42.2(pid=31329): Launched 09:03:04.524653 run osmo-stp_10.42.42.5: Starting osmo-stp 09:03:05.054935 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31331): Launched 09:03:05.359692 run osmo-stp_10.42.42.5(pid=31332): Launched 09:03:05.475755 run osmo-msc_10.42.42.6: Starting osmo-msc 09:03:06.027237 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31334): Launched 09:03:06.334205 run osmo-msc_10.42.42.6(pid=31335): Launched 09:03:06.505677 run osmo-stp_10.42.42.5(pid=31332): ERR: Terminated: ERROR {rc=1} [trial-2402↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31332)] 09:03:06.635473 run osmo-stp_10.42.42.5(pid=31332): stdout: | (launched: 2022-12-14_09:03:05.303170) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:03:06.764657 run osmo-stp_10.42.42.5(pid=31332): stderr: | 20221214090305475 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214090305475 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214090305475 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214090305476 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214090305476 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214090305476 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214090305476 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:03:06.892117 run osmo-stp_10.42.42.5(pid=31332): stdout: | (launched: 2022-12-14_09:03:05.303170) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:03:07.013704 run osmo-stp_10.42.42.5(pid=31332): stderr: | 20221214090305475 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214090305475 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214090305475 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214090305476 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214090305476 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214090305476 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214090305476 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:03:07.159328 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31332): Process ended prematurely: osmo-stp_10.42.42.5(pid=31332) [trial-2402↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31332)] [trial-2402↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 09:03:07.168728 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 09:03:07.195455 run osmo-hlr_10.42.42.2(pid=31329): ERR: Terminated: ERROR {rc=237} [trial-2402↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31329)] 09:03:07.244141 run osmo-hlr_10.42.42.2(pid=31329): stdout: | (launched: 2022-12-14_09:03:04.351741) 09:03:07.294049 run osmo-hlr_10.42.42.2(pid=31329): stderr: | 20221214090304525 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214090304525 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214090304525 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214090304525 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214090304525 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214090304525 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214090304541 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214090304550 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214090304550 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214090304550 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:03:07.364084 run osmo-msc_10.42.42.6(pid=31335): ERR: Terminated: ERROR {rc=2} [trial-2402↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31335)] 09:03:07.412039 run osmo-msc_10.42.42.6(pid=31335): stdout: | (launched: 2022-12-14_09:03:06.276461) 09:03:07.461902 run osmo-msc_10.42.42.6(pid=31335): stderr: | 20221214090306556 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214090306557 DLGLOBAL DEBUG validating counter group 0x7f28af337c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214090306557 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214090306557 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214090306557 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214090306557 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214090306559 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214090306559 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214090306560 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214090306560 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:03:07.511862 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31328): Terminating (SIGTERM) 09:03:07.552073 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31331): Terminating (SIGTERM) 09:03:07.592319 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31334): Terminating (SIGTERM) 09:03:07.632763 --- ParallelTerminationStrategy: PID 31328 died... 09:03:07.652603 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31328): Terminated: ok {rc=0} 09:03:07.697328 --- ParallelTerminationStrategy: PID 31331 died... 09:03:07.716831 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31331): Terminated: ok {rc=0} 09:03:07.761429 --- ParallelTerminationStrategy: PID 31334 died... 09:03:07.780787 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31334): Terminated: ok {rc=0} 09:03:07.868595 bus /sierra_3: Setting Powered False 09:03:08.968175 bus /sierra_3: Setting Powered False 09:03:10.083824 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2402 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 09:03:11.232018 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:03:11.244047 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 09:03:11.312916 tst mo_mt_call_osmux.py: using LAC 39847 09:03:11.432614 tst mo_mt_call_osmux.py: using RAC 67 09:03:11.553575 tst mo_mt_call_osmux.py: using CellId 39847 09:03:11.685102 tst mo_mt_call_osmux.py: using BVCI 39848 09:03:11.798852 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:03:11.810260 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:03:11.821592 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:03:11.832518 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:03:11.843793 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:03:11.855221 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 09:03:11.974857 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 09:03:12.093305 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:03:12.569388 run create_hlr_db(pid=31337): Launched 09:03:12.686797 bus /sierra_2: Setting Powered False 09:03:13.747674 run create_hlr_db(pid=31337): Terminated: ok {rc=0} 09:03:14.195777 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31339): Launched 09:03:14.526030 run osmo-hlr_10.42.42.2(pid=31340): Launched 09:03:14.652295 run osmo-stp_10.42.42.5: Starting osmo-stp 09:03:15.220484 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31342): Launched 09:03:15.549202 run osmo-stp_10.42.42.5(pid=31343): Launched 09:03:15.674987 run osmo-msc_10.42.42.6: Starting osmo-msc 09:03:16.289913 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31345): Launched 09:03:16.625592 run osmo-msc_10.42.42.6(pid=31346): Launched 09:03:17.075399 run osmo-stp_10.42.42.5(pid=31343): ERR: Terminated: ERROR {rc=1} [trial-2402↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31343)] 09:03:17.331320 run osmo-stp_10.42.42.5(pid=31343): stdout: | (launched: 2022-12-14_09:03:15.488809) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:03:17.469386 run osmo-stp_10.42.42.5(pid=31343): stderr: | 20221214090315682 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214090315683 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214090315683 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214090315683 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214090315684 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214090315684 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214090315684 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:03:17.598078 run osmo-stp_10.42.42.5(pid=31343): stdout: | (launched: 2022-12-14_09:03:15.488809) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:03:17.720230 run osmo-stp_10.42.42.5(pid=31343): stderr: | 20221214090315682 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214090315683 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214090315683 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214090315683 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214090315684 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214090315684 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214090315684 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:03:17.866234 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31343): Process ended prematurely: osmo-stp_10.42.42.5(pid=31343) [trial-2402↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31343)] [trial-2402↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 09:03:17.875211 tst mo_mt_call_osmux.py:8: Test FAILED (6.7 sec) 09:03:17.902021 run osmo-hlr_10.42.42.2(pid=31340): ERR: Terminated: ERROR {rc=237} [trial-2402↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31340)] 09:03:17.951215 run osmo-hlr_10.42.42.2(pid=31340): stdout: | (launched: 2022-12-14_09:03:14.465829) 09:03:18.001882 run osmo-hlr_10.42.42.2(pid=31340): stderr: | 20221214090314665 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214090314666 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214090314666 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214090314666 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214090314666 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214090314666 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214090314679 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214090314687 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214090314687 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214090314687 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:03:18.072691 run osmo-msc_10.42.42.6(pid=31346): ERR: Terminated: ERROR {rc=2} [trial-2402↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31346)] 09:03:18.121037 run osmo-msc_10.42.42.6(pid=31346): stdout: | (launched: 2022-12-14_09:03:16.562784) 09:03:18.171237 run osmo-msc_10.42.42.6(pid=31346): stderr: | 20221214090317052 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214090317052 DLGLOBAL DEBUG validating counter group 0x7f59dc650c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214090317052 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214090317052 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214090317052 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214090317052 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214090317055 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214090317055 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214090317056 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214090317056 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:03:18.221794 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31339): Terminating (SIGTERM) 09:03:18.262268 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31342): Terminating (SIGTERM) 09:03:18.302680 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31345): Terminating (SIGTERM) 09:03:18.343507 --- ParallelTerminationStrategy: PID 31339 died... 09:03:18.362927 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31339): Terminated: ok {rc=0} 09:03:18.407811 --- ParallelTerminationStrategy: PID 31342 died... 09:03:18.427081 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31342): Terminated: ok {rc=0} 09:03:18.471647 --- ParallelTerminationStrategy: PID 31345 died... 09:03:18.490864 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31345): Terminated: ok {rc=0} 09:03:18.578402 bus /sierra_3: Setting Powered False 09:03:19.677291 bus /sierra_3: Setting Powered False 09:03:20.794435 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2402 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 09:03:22.054042 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:03:22.061396 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 09:03:22.094622 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 09:03:22.122857 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 09:03:22.175919 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 09:03:22.210012 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 09:03:22.237726 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 09:03:22.785450 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2402 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 09:03:22.834735 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:03:22.846205 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 09:03:22.915781 tst mo_mt_call.py: using LAC 39848 09:03:23.035475 tst mo_mt_call.py: using RAC 68 09:03:23.156780 tst mo_mt_call.py: using CellId 39848 09:03:23.276827 tst mo_mt_call.py: using BVCI 39849 09:03:23.388040 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:03:23.399258 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:03:23.410435 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:03:23.421380 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:03:23.432673 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:03:23.443912 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 09:03:23.564172 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 09:03:23.684813 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:03:24.192112 run create_hlr_db(pid=31351): Launched 09:03:24.326759 bus /sierra_2: Setting Powered False 09:03:25.390853 run create_hlr_db(pid=31351): Terminated: ok {rc=0} 09:03:25.825675 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31353): Launched 09:03:26.130842 run osmo-hlr_10.42.42.2(pid=31354): Launched 09:03:26.247953 run osmo-stp_10.42.42.5: Starting osmo-stp 09:03:26.777484 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31356): Launched 09:03:27.082149 run osmo-stp_10.42.42.5(pid=31357): Launched 09:03:27.198961 run osmo-msc_10.42.42.6: Starting osmo-msc 09:03:27.752286 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31359): Launched 09:03:28.058059 run osmo-msc_10.42.42.6(pid=31360): Launched 09:03:28.229231 run osmo-stp_10.42.42.5(pid=31357): ERR: Terminated: ERROR {rc=1} [trial-2402↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31357)] 09:03:28.358687 run osmo-stp_10.42.42.5(pid=31357): stdout: | (launched: 2022-12-14_09:03:27.025797) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:03:28.488490 run osmo-stp_10.42.42.5(pid=31357): stderr: | 20221214090327196 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214090327196 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214090327197 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214090327197 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214090327198 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214090327198 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214090327198 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:03:28.616295 run osmo-stp_10.42.42.5(pid=31357): stdout: | (launched: 2022-12-14_09:03:27.025797) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:03:28.738138 run osmo-stp_10.42.42.5(pid=31357): stderr: | 20221214090327196 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214090327196 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214090327197 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214090327197 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214090327198 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214090327198 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214090327198 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:03:28.883831 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31357): Process ended prematurely: osmo-stp_10.42.42.5(pid=31357) [trial-2402↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31357)] [trial-2402↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 09:03:28.892905 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 09:03:28.919701 run osmo-hlr_10.42.42.2(pid=31354): ERR: Terminated: ERROR {rc=237} [trial-2402↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31354)] 09:03:28.968272 run osmo-hlr_10.42.42.2(pid=31354): stdout: | (launched: 2022-12-14_09:03:26.074366) 09:03:29.018185 run osmo-hlr_10.42.42.2(pid=31354): stderr: | 20221214090326250 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214090326250 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214090326250 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214090326250 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214090326250 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214090326250 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214090326262 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214090326271 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214090326271 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214090326271 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:03:29.088461 run osmo-msc_10.42.42.6(pid=31360): ERR: Terminated: ERROR {rc=2} [trial-2402↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31360)] 09:03:29.136129 run osmo-msc_10.42.42.6(pid=31360): stdout: | (launched: 2022-12-14_09:03:28.001298) 09:03:29.186149 run osmo-msc_10.42.42.6(pid=31360): stderr: | 20221214090328274 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214090328274 DLGLOBAL DEBUG validating counter group 0x7ffaa965dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214090328274 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214090328274 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214090328274 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214090328275 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214090328276 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214090328277 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214090328277 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214090328277 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:03:29.236493 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31353): Terminating (SIGTERM) 09:03:29.277128 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31356): Terminating (SIGTERM) 09:03:29.317623 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31359): Terminating (SIGTERM) 09:03:29.358608 --- ParallelTerminationStrategy: PID 31353 died... 09:03:29.378190 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31353): Terminated: ok {rc=0} 09:03:29.422570 --- ParallelTerminationStrategy: PID 31356 died... 09:03:29.441581 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31356): Terminated: ok {rc=0} 09:03:29.485619 --- ParallelTerminationStrategy: PID 31359 died... 09:03:29.504598 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31359): Terminated: ok {rc=0} 09:03:29.591135 bus /sierra_3: Setting Powered False 09:03:30.690993 bus /sierra_3: Setting Powered False 09:03:31.806456 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2402 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 09:03:32.958139 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:03:32.970872 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 09:03:33.044614 tst mo_mt_call_osmux.py: using LAC 39849 09:03:33.177420 tst mo_mt_call_osmux.py: using RAC 69 09:03:33.308650 tst mo_mt_call_osmux.py: using CellId 39849 09:03:33.434965 tst mo_mt_call_osmux.py: using BVCI 39850 09:03:33.554098 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:03:33.566298 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:03:33.578146 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:03:33.590017 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:03:33.602232 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:03:33.614419 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 09:03:33.731617 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 09:03:33.851991 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:03:34.360843 run create_hlr_db(pid=31362): Launched 09:03:34.492547 bus /sierra_2: Setting Powered False 09:03:35.556865 run create_hlr_db(pid=31362): Terminated: ok {rc=0} 09:03:36.009172 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31364): Launched 09:03:36.336601 run osmo-hlr_10.42.42.2(pid=31365): Launched 09:03:36.462181 run osmo-stp_10.42.42.5: Starting osmo-stp 09:03:37.025138 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31367): Launched 09:03:37.353543 run osmo-stp_10.42.42.5(pid=31368): Launched 09:03:37.479171 run osmo-msc_10.42.42.6: Starting osmo-msc 09:03:38.071085 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31370): Launched 09:03:38.400285 run osmo-msc_10.42.42.6(pid=31371): Launched 09:03:38.584181 run osmo-stp_10.42.42.5(pid=31368): ERR: Terminated: ERROR {rc=1} [trial-2402↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31368)] 09:03:38.721953 run osmo-stp_10.42.42.5(pid=31368): stdout: | (launched: 2022-12-14_09:03:37.293366) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:03:38.860097 run osmo-stp_10.42.42.5(pid=31368): stderr: | 20221214090337486 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214090337487 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214090337487 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214090337487 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214090337488 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214090337488 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214090337488 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:03:38.996375 run osmo-stp_10.42.42.5(pid=31368): stdout: | (launched: 2022-12-14_09:03:37.293366) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:03:39.126045 run osmo-stp_10.42.42.5(pid=31368): stderr: | 20221214090337486 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214090337487 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214090337487 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214090337487 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214090337488 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214090337488 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214090337488 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:03:39.281614 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31368): Process ended prematurely: osmo-stp_10.42.42.5(pid=31368) [trial-2402↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31368)] [trial-2402↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 09:03:39.291351 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 09:03:39.319536 run osmo-hlr_10.42.42.2(pid=31365): ERR: Terminated: ERROR {rc=237} [trial-2402↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31365)] 09:03:39.369983 run osmo-hlr_10.42.42.2(pid=31365): stdout: | (launched: 2022-12-14_09:03:36.276490) 09:03:39.422205 run osmo-hlr_10.42.42.2(pid=31365): stderr: | 20221214090336476 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214090336476 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214090336476 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214090336476 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214090336476 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214090336476 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214090336489 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214090336497 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214090336497 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214090336497 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:03:39.494920 run osmo-msc_10.42.42.6(pid=31371): ERR: Terminated: ERROR {rc=2} [trial-2402↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31371)] 09:03:39.545431 run osmo-msc_10.42.42.6(pid=31371): stdout: | (launched: 2022-12-14_09:03:38.339521) 09:03:39.598097 run osmo-msc_10.42.42.6(pid=31371): stderr: | 20221214090338663 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214090338663 DLGLOBAL DEBUG validating counter group 0x7efe003f8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214090338663 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214090338663 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214090338663 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214090338664 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214090338665 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214090338666 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214090338666 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214090338666 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:03:39.650507 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31364): Terminating (SIGTERM) 09:03:39.692585 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31367): Terminating (SIGTERM) 09:03:39.734758 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31370): Terminating (SIGTERM) 09:03:39.777654 --- ParallelTerminationStrategy: PID 31364 died... 09:03:39.797723 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31364): Terminated: ok {rc=0} 09:03:39.844167 --- ParallelTerminationStrategy: PID 31367 died... 09:03:39.863898 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31367): Terminated: ok {rc=0} 09:03:39.910232 --- ParallelTerminationStrategy: PID 31370 died... 09:03:39.929862 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31370): Terminated: ok {rc=0} 09:03:40.017416 bus /sierra_3: Setting Powered False 09:03:41.116686 bus /sierra_3: Setting Powered False 09:03:42.233403 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2402 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 voice:trx-umtrx+mod-bts0-dynts-osmo --------------------------------------------------------------------- 09:03:43.491270 tst voice:trx-umtrx+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:03:43.497710 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 09:03:43.531378 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 09:03:43.559413 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 09:03:43.616915 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 09:03:43.650749 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 09:03:43.677744 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 09:03:44.221722 tst voice:trx-umtrx+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2402 voice:trx-umtrx+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 09:03:44.271735 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 09:03:44.282729 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 09:03:44.351178 tst mo_mt_call.py: using LAC 39850 09:03:44.469812 tst mo_mt_call.py: using RAC 70 09:03:44.596592 tst mo_mt_call.py: using CellId 39850 09:03:44.724440 tst mo_mt_call.py: using BVCI 39851 09:03:44.842740 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 09:03:44.854404 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 09:03:44.865814 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 09:03:44.877383 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 09:03:44.888700 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 09:03:44.900116 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 09:03:45.016802 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 09:03:45.137084 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:03:45.613101 run create_hlr_db(pid=31376): Launched 09:03:45.729730 bus /sierra_2: Setting Powered False 09:03:46.791322 run create_hlr_db(pid=31376): Terminated: ok {rc=0} 09:03:47.225809 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31378): Launched 09:03:47.532809 run osmo-hlr_10.42.42.2(pid=31379): Launched 09:03:47.650510 run osmo-stp_10.42.42.5: Starting osmo-stp 09:03:48.172517 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31381): Launched 09:03:48.477347 run osmo-stp_10.42.42.5(pid=31382): Launched 09:03:48.593280 run osmo-msc_10.42.42.6: Starting osmo-msc 09:03:49.143895 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31384): Launched 09:03:49.448371 run osmo-msc_10.42.42.6(pid=31385): Launched 09:03:49.618915 run osmo-stp_10.42.42.5(pid=31382): ERR: Terminated: ERROR {rc=1} [trial-2402↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31382)] 09:03:49.748414 run osmo-stp_10.42.42.5(pid=31382): stdout: | (launched: 2022-12-14_09:03:48.420891) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:03:49.876708 run osmo-stp_10.42.42.5(pid=31382): stderr: | 20221214090348592 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214090348592 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214090348592 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214090348593 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214090348593 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214090348593 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214090348593 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:03:50.003173 run osmo-stp_10.42.42.5(pid=31382): stdout: | (launched: 2022-12-14_09:03:48.420891) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:03:50.123812 run osmo-stp_10.42.42.5(pid=31382): stderr: | 20221214090348592 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214090348592 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214090348592 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214090348593 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214090348593 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214090348593 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214090348593 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:03:50.267969 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31382): Process ended prematurely: osmo-stp_10.42.42.5(pid=31382) [trial-2402↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31382)] [trial-2402↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 09:03:50.276910 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 09:03:50.303247 run osmo-hlr_10.42.42.2(pid=31379): ERR: Terminated: ERROR {rc=237} [trial-2402↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31379)] 09:03:50.351671 run osmo-hlr_10.42.42.2(pid=31379): stdout: | (launched: 2022-12-14_09:03:47.475921) 09:03:50.401262 run osmo-hlr_10.42.42.2(pid=31379): stderr: | 20221214090347651 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214090347651 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214090347651 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214090347651 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214090347651 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214090347651 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214090347704 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/voice:trx-umtrx+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214090347714 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214090347714 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214090347714 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:03:50.470574 run osmo-msc_10.42.42.6(pid=31385): ERR: Terminated: ERROR {rc=2} [trial-2402↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31385)] 09:03:50.518109 run osmo-msc_10.42.42.6(pid=31385): stdout: | (launched: 2022-12-14_09:03:49.391883) 09:03:50.567471 run osmo-msc_10.42.42.6(pid=31385): stderr: | 20221214090349663 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214090349664 DLGLOBAL DEBUG validating counter group 0x7fdb91391c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214090349664 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214090349664 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214090349664 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214090349664 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214090349666 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214090349666 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214090349666 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214090349667 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:03:50.617397 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31378): Terminating (SIGTERM) 09:03:50.657676 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31381): Terminating (SIGTERM) 09:03:50.697623 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31384): Terminating (SIGTERM) 09:03:50.737908 --- ParallelTerminationStrategy: PID 31378 died... 09:03:50.757279 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31378): Terminated: ok {rc=0} 09:03:50.801735 --- ParallelTerminationStrategy: PID 31381 died... 09:03:50.820587 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31381): Terminated: ok {rc=0} 09:03:50.865049 --- ParallelTerminationStrategy: PID 31384 died... 09:03:50.884036 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31384): Terminated: ok {rc=0} 09:03:50.969255 bus /sierra_3: Setting Powered False 09:03:52.067433 bus /sierra_3: Setting Powered False 09:03:53.186532 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2402 voice:trx-umtrx+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 09:03:54.333606 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 09:03:54.345547 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 09:03:54.415415 tst mo_mt_call_osmux.py: using LAC 39851 09:03:54.535626 tst mo_mt_call_osmux.py: using RAC 71 09:03:54.657858 tst mo_mt_call_osmux.py: using CellId 39851 09:03:54.780180 tst mo_mt_call_osmux.py: using BVCI 39852 09:03:54.892568 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 09:03:54.903759 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 09:03:54.914726 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 09:03:54.925764 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 09:03:54.937016 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 09:03:54.948338 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 09:03:55.064026 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 09:03:55.186074 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:03:55.695252 run create_hlr_db(pid=31387): Launched 09:03:55.827935 bus /sierra_2: Setting Powered False 09:03:56.892552 run create_hlr_db(pid=31387): Terminated: ok {rc=0} 09:03:57.326019 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31389): Launched 09:03:57.630427 run osmo-hlr_10.42.42.2(pid=31390): Launched 09:03:57.746743 run osmo-stp_10.42.42.5: Starting osmo-stp 09:03:58.270809 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31392): Launched 09:03:58.575678 run osmo-stp_10.42.42.5(pid=31393): Launched 09:03:58.691823 run osmo-msc_10.42.42.6: Starting osmo-msc 09:03:59.250326 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31395): Launched 09:03:59.555629 run osmo-msc_10.42.42.6(pid=31396): Launched 09:03:59.726824 run osmo-stp_10.42.42.5(pid=31393): ERR: Terminated: ERROR {rc=1} [trial-2402↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31393)] 09:03:59.855716 run osmo-stp_10.42.42.5(pid=31393): stdout: | (launched: 2022-12-14_09:03:58.519153) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:03:59.984387 run osmo-stp_10.42.42.5(pid=31393): stderr: | 20221214090358693 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214090358694 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214090358694 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214090358694 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214090358695 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214090358695 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214090358695 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:04:00.111379 run osmo-stp_10.42.42.5(pid=31393): stdout: | (launched: 2022-12-14_09:03:58.519153) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:04:00.232481 run osmo-stp_10.42.42.5(pid=31393): stderr: | 20221214090358693 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214090358694 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214090358694 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214090358694 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214090358695 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214090358695 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214090358695 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:04:00.377637 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31393): Process ended prematurely: osmo-stp_10.42.42.5(pid=31393) [trial-2402↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31393)] [trial-2402↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 09:04:00.386508 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 09:04:00.413128 run osmo-hlr_10.42.42.2(pid=31390): ERR: Terminated: ERROR {rc=237} [trial-2402↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31390)] 09:04:00.461725 run osmo-hlr_10.42.42.2(pid=31390): stdout: | (launched: 2022-12-14_09:03:57.573954) 09:04:00.511531 run osmo-hlr_10.42.42.2(pid=31390): stderr: | 20221214090357749 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214090357750 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214090357750 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214090357750 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214090357750 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214090357750 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214090357762 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/voice:trx-umtrx+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214090357770 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214090357770 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214090357770 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:04:00.581649 run osmo-msc_10.42.42.6(pid=31396): ERR: Terminated: ERROR {rc=2} [trial-2402↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31396)] 09:04:00.629335 run osmo-msc_10.42.42.6(pid=31396): stdout: | (launched: 2022-12-14_09:03:59.498760) 09:04:00.678972 run osmo-msc_10.42.42.6(pid=31396): stderr: | 20221214090359770 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214090359770 DLGLOBAL DEBUG validating counter group 0x7f85dc935c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214090359770 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214090359770 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214090359770 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214090359770 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214090359772 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214090359772 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214090359773 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214090359773 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:04:00.729912 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31389): Terminating (SIGTERM) 09:04:00.770099 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31392): Terminating (SIGTERM) 09:04:00.810040 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31395): Terminating (SIGTERM) 09:04:00.850640 --- ParallelTerminationStrategy: PID 31389 died... 09:04:00.871429 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31389): Terminated: ok {rc=0} 09:04:00.922394 --- ParallelTerminationStrategy: PID 31392 died... 09:04:00.942593 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31392): Terminated: ok {rc=0} 09:04:00.988491 --- ParallelTerminationStrategy: PID 31395 died... 09:04:01.009576 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31395): Terminated: ok {rc=0} 09:04:01.102177 bus /sierra_3: Setting Powered False 09:04:02.216568 bus /sierra_3: Setting Powered False 09:04:03.333311 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2402 voice:trx-umtrx+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 09:04:04.588336 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:04:04.595099 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 09:04:04.628249 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 6 x ip_address (candidates: 9) 09:04:04.655723 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 2 x modem (candidates: 12) 09:04:04.707894 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 09:04:04.741813 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 6 x ip_address (candidates: 9) 09:04:04.770543 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 2 x modem (candidates: 12) 09:04:05.325781 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2402 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call.py ---------------------------------------------- 09:04:05.378906 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 09:04:05.391079 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 09:04:05.443551 tst mo_mt_call.py: using LAC 39852 09:04:05.570886 tst mo_mt_call.py: using RAC 72 09:04:05.699105 tst mo_mt_call.py: using CellId 39852 09:04:05.826216 tst mo_mt_call.py: using BVCI 39853 09:04:05.945294 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 09:04:05.957230 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 09:04:05.968841 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 09:04:05.980522 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 09:04:05.992737 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 09:04:06.005075 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 09:04:06.122589 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 09:04:06.242568 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:04:06.748018 run create_hlr_db(pid=31401): Launched 09:04:06.882342 bus /sierra_2: Setting Powered False 09:04:07.946529 run create_hlr_db(pid=31401): Terminated: ok {rc=0} 09:04:08.379549 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31403): Launched 09:04:08.684630 run osmo-hlr_10.42.42.2(pid=31404): Launched 09:04:08.801056 run osmo-stp_10.42.42.5: Starting osmo-stp 09:04:09.341164 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31406): Launched 09:04:09.647421 run osmo-stp_10.42.42.5(pid=31407): Launched 09:04:09.763541 run osmo-msc_10.42.42.6: Starting osmo-msc 09:04:10.314097 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31409): Launched 09:04:10.619151 run osmo-msc_10.42.42.6(pid=31410): Launched 09:04:10.790199 run osmo-stp_10.42.42.5(pid=31407): ERR: Terminated: ERROR {rc=1} [trial-2402↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31407)] 09:04:10.919719 run osmo-stp_10.42.42.5(pid=31407): stdout: | (launched: 2022-12-14_09:04:09.590866) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:04:11.048456 run osmo-stp_10.42.42.5(pid=31407): stderr: | 20221214090409763 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214090409763 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214090409763 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214090409764 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214090409764 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214090409764 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214090409764 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:04:11.175141 run osmo-stp_10.42.42.5(pid=31407): stdout: | (launched: 2022-12-14_09:04:09.590866) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:04:11.296174 run osmo-stp_10.42.42.5(pid=31407): stderr: | 20221214090409763 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214090409763 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214090409763 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214090409764 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214090409764 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214090409764 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214090409764 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:04:11.440541 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31407): Process ended prematurely: osmo-stp_10.42.42.5(pid=31407) [trial-2402↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31407)] [trial-2402↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8] 09:04:11.449836 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 09:04:11.476261 run osmo-hlr_10.42.42.2(pid=31404): ERR: Terminated: ERROR {rc=237} [trial-2402↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31404)] 09:04:11.524378 run osmo-hlr_10.42.42.2(pid=31404): stdout: | (launched: 2022-12-14_09:04:08.628183) 09:04:11.573929 run osmo-hlr_10.42.42.2(pid=31404): stderr: | 20221214090408804 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214090408804 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214090408804 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214090408804 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214090408805 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214090408805 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214090408820 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214090408831 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214090408831 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214090408831 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:04:11.643339 run osmo-msc_10.42.42.6(pid=31410): ERR: Terminated: ERROR {rc=2} [trial-2402↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31410)] 09:04:11.690673 run osmo-msc_10.42.42.6(pid=31410): stdout: | (launched: 2022-12-14_09:04:10.562505) 09:04:11.739881 run osmo-msc_10.42.42.6(pid=31410): stderr: | 20221214090410835 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214090410835 DLGLOBAL DEBUG validating counter group 0x7f93c16b1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214090410836 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214090410836 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214090410836 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214090410836 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214090410838 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214090410838 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214090410838 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214090410838 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:04:11.789348 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31403): Terminating (SIGTERM) 09:04:11.829513 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31406): Terminating (SIGTERM) 09:04:11.869520 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31409): Terminating (SIGTERM) 09:04:11.910046 --- ParallelTerminationStrategy: PID 31403 died... 09:04:11.929629 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31403): Terminated: ok {rc=0} 09:04:11.973835 --- ParallelTerminationStrategy: PID 31406 died... 09:04:11.992760 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31406): Terminated: ok {rc=0} 09:04:12.036475 --- ParallelTerminationStrategy: PID 31409 died... 09:04:12.055120 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31409): Terminated: ok {rc=0} 09:04:12.141780 bus /sierra_3: Setting Powered False 09:04:13.241078 bus /sierra_3: Setting Powered False 09:04:14.355340 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2402 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call_osmux.py ---------------------------------------------- 09:04:15.500142 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 09:04:15.512323 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 09:04:15.564307 tst mo_mt_call_osmux.py: using LAC 39853 09:04:15.687032 tst mo_mt_call_osmux.py: using RAC 73 09:04:15.809644 tst mo_mt_call_osmux.py: using CellId 39853 09:04:15.967922 tst mo_mt_call_osmux.py: using BVCI 39854 09:04:16.092012 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 09:04:16.105246 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 09:04:16.118277 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 09:04:16.130984 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 09:04:16.144286 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 09:04:16.157848 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 09:04:16.280240 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 09:04:16.405119 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:04:16.925697 run create_hlr_db(pid=31412): Launched 09:04:17.083730 bus /sierra_2: Setting Powered False 09:04:18.145390 run create_hlr_db(pid=31412): Terminated: ok {rc=0} 09:04:18.591960 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31414): Launched 09:04:18.921111 run osmo-hlr_10.42.42.2(pid=31415): Launched 09:04:19.046877 run osmo-stp_10.42.42.5: Starting osmo-stp 09:04:19.613979 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31417): Launched 09:04:19.940666 run osmo-stp_10.42.42.5(pid=31418): Launched 09:04:20.066156 run osmo-msc_10.42.42.6: Starting osmo-msc 09:04:20.658108 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31420): Launched 09:04:20.984143 run osmo-msc_10.42.42.6(pid=31421): Launched 09:04:21.167630 run osmo-stp_10.42.42.5(pid=31418): ERR: Terminated: ERROR {rc=1} [trial-2402↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31418)] 09:04:21.305492 run osmo-stp_10.42.42.5(pid=31418): stdout: | (launched: 2022-12-14_09:04:19.880526) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:04:21.443026 run osmo-stp_10.42.42.5(pid=31418): stderr: | 20221214090420075 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214090420075 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214090420075 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214090420076 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214090420076 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214090420076 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214090420076 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:04:21.579561 run osmo-stp_10.42.42.5(pid=31418): stdout: | (launched: 2022-12-14_09:04:19.880526) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:04:21.708913 run osmo-stp_10.42.42.5(pid=31418): stderr: | 20221214090420075 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214090420075 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214090420075 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214090420076 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214090420076 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214090420076 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214090420076 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:04:21.864044 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31418): Process ended prematurely: osmo-stp_10.42.42.5(pid=31418) [trial-2402↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31418)] [trial-2402↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8] 09:04:21.873879 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 09:04:21.901655 run osmo-hlr_10.42.42.2(pid=31415): ERR: Terminated: ERROR {rc=237} [trial-2402↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31415)] 09:04:21.951680 run osmo-hlr_10.42.42.2(pid=31415): stdout: | (launched: 2022-12-14_09:04:18.860504) 09:04:22.003423 run osmo-hlr_10.42.42.2(pid=31415): stderr: | 20221214090419060 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214090419060 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214090419060 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214090419060 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214090419060 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214090419060 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214090419073 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214090419081 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214090419081 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214090419081 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:04:22.075319 run osmo-msc_10.42.42.6(pid=31421): ERR: Terminated: ERROR {rc=2} [trial-2402↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31421)] 09:04:22.125112 run osmo-msc_10.42.42.6(pid=31421): stdout: | (launched: 2022-12-14_09:04:20.924096) 09:04:22.176348 run osmo-msc_10.42.42.6(pid=31421): stderr: | 20221214090421246 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214090421246 DLGLOBAL DEBUG validating counter group 0x7fd5eaf94c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214090421246 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214090421246 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214090421247 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214090421247 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214090421248 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214090421249 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214090421249 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214090421249 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:04:22.228332 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31414): Terminating (SIGTERM) 09:04:22.269806 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31417): Terminating (SIGTERM) 09:04:22.311224 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31420): Terminating (SIGTERM) 09:04:22.352865 --- ParallelTerminationStrategy: PID 31414 died... 09:04:22.372787 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31414): Terminated: ok {rc=0} 09:04:22.418545 --- ParallelTerminationStrategy: PID 31417 died... 09:04:22.437989 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31417): Terminated: ok {rc=0} 09:04:22.483463 --- ParallelTerminationStrategy: PID 31420 died... 09:04:22.502887 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31420): Terminated: ok {rc=0} 09:04:22.590546 bus /sierra_3: Setting Powered False 09:04:23.689245 bus /sierra_3: Setting Powered False 09:04:24.805271 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2402 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 emergency:trx-umtrx --------------------------------------------------------------------- 09:04:26.054801 tst emergency:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:04:26.059325 tst emergency:trx-umtrx: Verifying 1 x bts (candidates: 11) 09:04:26.091648 tst emergency:trx-umtrx: Verifying 6 x ip_address (candidates: 9) 09:04:26.119064 tst emergency:trx-umtrx: Verifying 4 x modem (candidates: 12) 09:04:26.203530 tst emergency:trx-umtrx: Reserving 1 x bts (candidates: 11) 09:04:26.235131 tst emergency:trx-umtrx: Reserving 6 x ip_address (candidates: 9) 09:04:26.261424 tst emergency:trx-umtrx: Reserving 4 x modem (candidates: 12) 09:04:26.850914 tst emergency:trx-umtrx: RESERVED RESOURCES for emergency: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2402 emergency:trx-umtrx emergency_mo_mt_call.py ---------------------------------------------- 09:04:26.856429 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 09:04:26.867892 tst emergency:trx-umtrx: Using 1 x bts (candidates: 1) 09:04:26.921624 tst emergency_mo_mt_call.py: using LAC 39854 09:04:27.049728 tst emergency_mo_mt_call.py: using RAC 74 09:04:27.176831 tst emergency_mo_mt_call.py: using CellId 39854 09:04:27.302246 tst emergency_mo_mt_call.py: using BVCI 39855 09:04:27.419973 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 09:04:27.431370 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 09:04:27.442509 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 09:04:27.453702 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 09:04:27.464767 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 09:04:27.475914 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 09:04:27.595320 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 09:04:27.717158 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:04:28.216370 run create_hlr_db(pid=31427): Launched 09:04:28.347123 bus /sierra_2: Setting Powered False 09:04:29.410473 run create_hlr_db(pid=31427): Terminated: ok {rc=0} 09:04:29.840082 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31429): Launched 09:04:30.139812 run osmo-hlr_10.42.42.2(pid=31430): Launched 09:04:30.254151 run osmo-stp_10.42.42.5: Starting osmo-stp 09:04:30.788344 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31432): Launched 09:04:31.107692 run osmo-stp_10.42.42.5(pid=31433): Launched 09:04:31.427413 tst emergency_mo_mt_call.py: using MSISDN 8603 09:04:31.600486 run osmo-msc_10.42.42.6: Starting osmo-msc 09:04:32.205449 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31435): Launched 09:04:32.539886 run osmo-msc_10.42.42.6(pid=31436): Launched 09:04:32.719905 run osmo-stp_10.42.42.5(pid=31433): ERR: Terminated: ERROR {rc=1} [trial-2402↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31433)] 09:04:32.855863 run osmo-stp_10.42.42.5(pid=31433): stdout: | (launched: 2022-12-14_09:04:31.049999) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:04:32.992932 run osmo-stp_10.42.42.5(pid=31433): stderr: | 20221214090431294 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214090431294 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214090431295 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214090431295 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214090431296 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214090431296 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214090431296 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:04:33.128299 run osmo-stp_10.42.42.5(pid=31433): stdout: | (launched: 2022-12-14_09:04:31.049999) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:04:33.256215 run osmo-stp_10.42.42.5(pid=31433): stderr: | 20221214090431294 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214090431294 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214090431295 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214090431295 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214090431296 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214090431296 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214090431296 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:04:33.409150 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=31433): Process ended prematurely: osmo-stp_10.42.42.5(pid=31433) [trial-2402↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31433)] [trial-2402↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19] 09:04:33.418243 tst emergency_mo_mt_call.py:19: Test FAILED (6.6 sec) 09:04:33.445804 run osmo-hlr_10.42.42.2(pid=31430): ERR: Terminated: ERROR {rc=237} [trial-2402↪emergency:trx-umtrx↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31430)] 09:04:33.496452 run osmo-hlr_10.42.42.2(pid=31430): stdout: | (launched: 2022-12-14_09:04:30.084101) 09:04:33.548784 run osmo-hlr_10.42.42.2(pid=31430): stderr: | 20221214090430261 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214090430261 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214090430261 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214090430261 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214090430261 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214090430261 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214090430274 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/emergency:trx-umtrx/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214090430284 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214090430284 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214090430285 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:04:33.621847 run osmo-msc_10.42.42.6(pid=31436): ERR: Terminated: ERROR {rc=2} [trial-2402↪emergency:trx-umtrx↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31436)] 09:04:33.672315 run osmo-msc_10.42.42.6(pid=31436): stdout: | (launched: 2022-12-14_09:04:32.480209) 09:04:33.724640 run osmo-msc_10.42.42.6(pid=31436): stderr: | 20221214090432802 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214090432802 DLGLOBAL DEBUG validating counter group 0x7f94a5d51c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214090432802 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214090432802 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214090432803 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214090432803 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214090432805 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214090432805 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214090432805 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214090432805 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:04:33.777075 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31429): Terminating (SIGTERM) 09:04:33.818994 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31432): Terminating (SIGTERM) 09:04:33.861437 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31435): Terminating (SIGTERM) 09:04:33.903938 --- ParallelTerminationStrategy: PID 31429 died... 09:04:33.924112 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31429): Terminated: ok {rc=0} 09:04:33.970286 --- ParallelTerminationStrategy: PID 31432 died... 09:04:33.989915 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31432): Terminated: ok {rc=0} 09:04:34.035794 --- ParallelTerminationStrategy: PID 31435 died... 09:04:34.055243 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31435): Terminated: ok {rc=0} 09:04:34.143094 bus /sierra_3: Setting Powered False 09:04:35.242606 bus /sierra_3: Setting Powered False 09:04:36.358310 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2402 emergency:trx-umtrx emergency_preemptive_call.py ---------------------------------------------- 09:04:37.445941 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 09:04:37.458586 tst emergency:trx-umtrx: Using 1 x bts (candidates: 1) 09:04:37.511067 tst emergency_preemptive_call.py: using LAC 39855 09:04:37.639777 tst emergency_preemptive_call.py: using RAC 75 09:04:37.766597 tst emergency_preemptive_call.py: using CellId 39855 09:04:37.894746 tst emergency_preemptive_call.py: using BVCI 39856 09:04:38.013238 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 09:04:38.024556 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 09:04:38.035748 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 09:04:38.046824 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 09:04:38.058445 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 09:04:38.070014 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 09:04:38.186316 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 09:04:38.307538 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 09:04:38.422289 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 09:04:38.535378 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:04:39.002257 run create_hlr_db(pid=31438): Launched 09:04:39.117909 bus /sierra_2: Setting Powered False 09:04:40.178080 run create_hlr_db(pid=31438): Terminated: ok {rc=0} 09:04:40.619316 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31440): Launched 09:04:40.943788 run osmo-hlr_10.42.42.2(pid=31441): Launched 09:04:41.070087 run osmo-stp_10.42.42.5: Starting osmo-stp 09:04:41.623636 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31443): Launched 09:04:41.947224 run osmo-stp_10.42.42.5(pid=31444): Launched 09:04:42.078418 tst emergency_preemptive_call.py: using MSISDN 8604 09:04:42.243278 run osmo-msc_10.42.42.6: Starting osmo-msc 09:04:42.821450 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31446): Launched 09:04:43.145140 run osmo-msc_10.42.42.6(pid=31447): Launched 09:04:43.326784 run osmo-stp_10.42.42.5(pid=31444): ERR: Terminated: ERROR {rc=1} [trial-2402↪emergency:trx-umtrx↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31444)] 09:04:43.462662 run osmo-stp_10.42.42.5(pid=31444): stdout: | (launched: 2022-12-14_09:04:41.887458) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:04:43.598761 run osmo-stp_10.42.42.5(pid=31444): stderr: | 20221214090442080 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214090442080 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214090442080 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214090442081 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214090442081 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214090442081 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214090442081 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:04:43.734627 run osmo-stp_10.42.42.5(pid=31444): stdout: | (launched: 2022-12-14_09:04:41.887458) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:04:43.862512 run osmo-stp_10.42.42.5(pid=31444): stderr: | 20221214090442080 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214090442080 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214090442080 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214090442081 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214090442081 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214090442081 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214090442081 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:04:44.015370 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=31444): Process ended prematurely: osmo-stp_10.42.42.5(pid=31444) [trial-2402↪emergency:trx-umtrx↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31444)] [trial-2402↪emergency:trx-umtrx↪emergency_preemptive_call.py:32] 09:04:44.024693 tst emergency_preemptive_call.py:32: Test FAILED (6.6 sec) 09:04:44.052499 run osmo-hlr_10.42.42.2(pid=31441): ERR: Terminated: ERROR {rc=237} [trial-2402↪emergency:trx-umtrx↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31441)] 09:04:44.103582 run osmo-hlr_10.42.42.2(pid=31441): stdout: | (launched: 2022-12-14_09:04:40.884274) 09:04:44.156022 run osmo-hlr_10.42.42.2(pid=31441): stderr: | 20221214090441083 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214090441083 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214090441083 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214090441083 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214090441083 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214090441083 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214090441098 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/emergency:trx-umtrx/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214090441108 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214090441108 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214090441108 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:04:44.229693 run osmo-msc_10.42.42.6(pid=31447): ERR: Terminated: ERROR {rc=2} [trial-2402↪emergency:trx-umtrx↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31447)] 09:04:44.280206 run osmo-msc_10.42.42.6(pid=31447): stdout: | (launched: 2022-12-14_09:04:43.085529) 09:04:44.332476 run osmo-msc_10.42.42.6(pid=31447): stderr: | 20221214090443410 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214090443410 DLGLOBAL DEBUG validating counter group 0x7fa516840c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214090443410 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214090443410 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214090443410 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214090443410 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214090443412 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214090443413 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214090443413 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214090443413 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:04:44.384733 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31440): Terminating (SIGTERM) 09:04:44.426790 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31443): Terminating (SIGTERM) 09:04:44.469410 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31446): Terminating (SIGTERM) 09:04:44.511895 --- ParallelTerminationStrategy: PID 31440 died... 09:04:44.532273 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31440): Terminated: ok {rc=0} 09:04:44.579138 --- ParallelTerminationStrategy: PID 31443 died... 09:04:44.599132 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31443): Terminated: ok {rc=0} 09:04:44.645712 --- ParallelTerminationStrategy: PID 31446 died... 09:04:44.665768 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31446): Terminated: ok {rc=0} 09:04:44.754334 bus /sierra_9: Setting Powered False 09:04:45.865941 bus /sierra_9: Setting Powered False 09:04:47.007253 bus /sierra_8: Setting Powered False 09:04:48.111242 bus /sierra_8: Setting Powered False 09:04:49.226731 bus /sierra_3: Setting Powered False 09:04:50.325436 bus /sierra_3: Setting Powered False 09:04:51.441389 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2402 emergency:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 gprs:trx-umtrx --------------------------------------------------------------------- 09:04:52.712652 tst gprs:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:04:52.717082 tst gprs:trx-umtrx: Verifying 1 x bts (candidates: 11) 09:04:52.748848 tst gprs:trx-umtrx: Verifying 9 x ip_address (candidates: 9) 09:04:52.787601 tst gprs:trx-umtrx: Verifying 4 x modem (candidates: 12) 09:04:52.873675 tst gprs:trx-umtrx: Reserving 1 x bts (candidates: 11) 09:04:52.905666 tst gprs:trx-umtrx: Reserving 9 x ip_address (candidates: 9) 09:04:52.943921 tst gprs:trx-umtrx: Reserving 4 x modem (candidates: 12) 09:04:53.532760 tst gprs:trx-umtrx: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2402 gprs:trx-umtrx cs_paging_gprs_active.py ---------------------------------------------- 09:04:53.582864 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 09:04:53.593504 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 09:04:53.641388 tst cs_paging_gprs_active.py: using LAC 39856 09:04:53.761446 tst cs_paging_gprs_active.py: using RAC 76 09:04:53.882458 tst cs_paging_gprs_active.py: using CellId 39856 09:04:54.004336 tst cs_paging_gprs_active.py: using BVCI 39857 09:04:54.124385 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 09:04:54.135741 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 09:04:54.146768 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 09:04:54.157872 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 09:04:54.168751 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 09:04:54.179738 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 09:04:54.190989 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 09:04:54.202342 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 09:04:54.213618 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 09:04:54.330475 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 09:04:54.447358 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 09:04:54.653919 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:04:54.960180 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31452): Launched 09:04:55.227037 run iperf3-srv_10.42.42.10(pid=31453): Launched 09:04:55.343212 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 09:04:55.547873 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:04:55.854601 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31454): Launched 09:04:56.122868 run iperf3-srv_10.42.42.10(pid=31455): Launched 09:04:56.238327 tst cs_paging_gprs_active.py:38: start network... 09:04:56.442148 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:04:56.915149 run create_hlr_db(pid=31456): Launched 09:04:57.031896 bus /sierra_2: Setting Powered False 09:04:58.093386 run create_hlr_db(pid=31456): Terminated: ok {rc=0} 09:04:58.540166 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31458): Launched 09:04:58.867662 run osmo-hlr_10.42.42.2(pid=31459): Launched 09:04:58.991991 run osmo-stp_10.42.42.5: Starting osmo-stp 09:04:59.554707 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31461): Launched 09:04:59.882174 run osmo-stp_10.42.42.5(pid=31462): Launched 09:05:00.007513 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:05:00.571630 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31464): Launched 09:05:00.697451 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:05:00.989119 run patchelf(pid=31465): Launched 09:05:01.192789 run osmo-stp_10.42.42.5(pid=31462): ERR: Terminated: ERROR {rc=1} [trial-2402↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31462)] 09:05:01.330094 run osmo-stp_10.42.42.5(pid=31462): stdout: | (launched: 2022-12-14_09:04:59.821797) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:05:01.467420 run osmo-stp_10.42.42.5(pid=31462): stderr: | 20221214090500013 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214090500014 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214090500014 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214090500014 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214090500015 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214090500015 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214090500015 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:05:01.606563 run osmo-stp_10.42.42.5(pid=31462): stdout: | (launched: 2022-12-14_09:04:59.821797) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:05:01.736887 run osmo-stp_10.42.42.5(pid=31462): stderr: | 20221214090500013 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214090500014 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214090500014 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214090500014 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214090500015 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214090500015 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214090500015 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:05:01.910338 run patchelf(pid=31465): Terminating (SIGINT) 09:05:02.099553 run patchelf(pid=31465): Terminated: ok {rc=0} 09:05:02.233610 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=31462): Process ended prematurely: osmo-stp_10.42.42.5(pid=31462) [trial-2402↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31462)] [trial-2402↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38] 09:05:02.244764 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 09:05:02.274561 run osmo-hlr_10.42.42.2(pid=31459): ERR: Terminated: ERROR {rc=237} [trial-2402↪gprs:trx-umtrx↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31459)] 09:05:02.325157 run osmo-hlr_10.42.42.2(pid=31459): stdout: | (launched: 2022-12-14_09:04:58.807196) 09:05:02.377223 run osmo-hlr_10.42.42.2(pid=31459): stderr: | 20221214090459007 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214090459007 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214090459007 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214090459007 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214090459007 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214090459007 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214090459019 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/gprs:trx-umtrx/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214090459027 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214090459028 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214090459028 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:05:02.429467 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31452): Terminating (SIGTERM) 09:05:02.471373 run iperf3-srv_10.42.42.10(pid=31453): Terminating (SIGTERM) 09:05:02.513958 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31454): Terminating (SIGTERM) 09:05:02.555877 run iperf3-srv_10.42.42.10(pid=31455): Terminating (SIGTERM) 09:05:02.598026 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31458): Terminating (SIGTERM) 09:05:02.639919 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31461): Terminating (SIGTERM) 09:05:02.682255 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31464): Terminating (SIGTERM) 09:05:02.724600 --- ParallelTerminationStrategy: PID 31452 died... 09:05:02.744524 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31452): Terminated: ok {rc=0} 09:05:02.791017 --- ParallelTerminationStrategy: PID 31453 died... 09:05:02.810614 run iperf3-srv_10.42.42.10(pid=31453): Terminated {rc=256} 09:05:02.856863 --- ParallelTerminationStrategy: PID 31454 died... 09:05:02.876680 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31454): Terminated: ok {rc=0} 09:05:02.923189 --- ParallelTerminationStrategy: PID 31455 died... 09:05:02.943012 run iperf3-srv_10.42.42.10(pid=31455): Terminated {rc=256} 09:05:02.989328 --- ParallelTerminationStrategy: PID 31458 died... 09:05:03.008770 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31458): Terminated: ok {rc=0} 09:05:03.055479 --- ParallelTerminationStrategy: PID 31461 died... 09:05:03.075580 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31461): Terminated: ok {rc=0} 09:05:03.122196 --- ParallelTerminationStrategy: PID 31464 died... 09:05:03.142066 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31464): Terminated: ok {rc=0} 09:05:03.231164 bus /gobi_0: Setting Powered False 09:05:04.328638 bus /gobi_0: Setting Powered False 09:05:05.445729 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2402 gprs:trx-umtrx iperf3.py ---------------------------------------------- 09:05:06.596156 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 09:05:06.608398 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 09:05:06.658930 tst iperf3.py: using LAC 39857 09:05:06.781376 tst iperf3.py: using RAC 77 09:05:06.905782 tst iperf3.py: using CellId 39857 09:05:07.029435 tst iperf3.py: using BVCI 39858 09:05:07.143255 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 09:05:07.154057 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 09:05:07.164573 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 09:05:07.175119 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 09:05:07.185678 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 09:05:07.196765 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 09:05:07.208341 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 09:05:07.219307 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 09:05:07.230425 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 09:05:07.351397 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 09:05:07.573602 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:05:07.903371 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31469): Launched 09:05:08.190726 run iperf3-srv_10.42.42.10(pid=31470): Launched 09:05:08.315560 tst iperf3.py:8: start network... 09:05:08.537329 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:05:09.047699 run create_hlr_db(pid=31471): Launched 09:05:09.181117 bus /gobi_6: Setting Powered False 09:05:10.246366 run create_hlr_db(pid=31471): Terminated: ok {rc=0} 09:05:10.683496 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31473): Launched 09:05:10.991133 run osmo-hlr_10.42.42.2(pid=31474): Launched 09:05:11.110365 run osmo-stp_10.42.42.5: Starting osmo-stp 09:05:11.639152 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31476): Launched 09:05:11.946771 run osmo-stp_10.42.42.5(pid=31477): Launched 09:05:12.065238 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:05:12.592754 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31479): Launched 09:05:12.710646 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:05:12.968688 run patchelf(pid=31480): Launched 09:05:13.137968 run osmo-stp_10.42.42.5(pid=31477): ERR: Terminated: ERROR {rc=1} [trial-2402↪gprs:trx-umtrx↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31477)] 09:05:13.267124 run osmo-stp_10.42.42.5(pid=31477): stdout: | (launched: 2022-12-14_09:05:11.889697) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:05:13.398661 run osmo-stp_10.42.42.5(pid=31477): stderr: | 20221214090512062 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214090512062 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214090512062 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214090512063 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214090512063 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214090512063 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214090512063 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:05:13.529517 run osmo-stp_10.42.42.5(pid=31477): stdout: | (launched: 2022-12-14_09:05:11.889697) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:05:13.654878 run osmo-stp_10.42.42.5(pid=31477): stderr: | 20221214090512062 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214090512062 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214090512062 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214090512063 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214090512063 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214090512063 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214090512063 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:05:13.803160 run patchelf(pid=31480): Terminating (SIGINT) 09:05:13.973474 run patchelf(pid=31480): Terminated: ok {rc=0} 09:05:14.096446 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31477): Process ended prematurely: osmo-stp_10.42.42.5(pid=31477) [trial-2402↪gprs:trx-umtrx↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31477)] [trial-2402↪gprs:trx-umtrx↪iperf3.py:8] 09:05:14.106064 tst iperf3.py:8: Test FAILED (7.5 sec) 09:05:14.132904 run osmo-hlr_10.42.42.2(pid=31474): ERR: Terminated: ERROR {rc=237} [trial-2402↪gprs:trx-umtrx↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31474)] 09:05:14.180790 run osmo-hlr_10.42.42.2(pid=31474): stdout: | (launched: 2022-12-14_09:05:10.933904) 09:05:14.229929 run osmo-hlr_10.42.42.2(pid=31474): stderr: | 20221214090511110 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214090511110 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214090511110 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214090511111 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214090511111 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214090511111 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214090511122 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/gprs:trx-umtrx/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214090511131 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214090511131 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214090511131 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:05:14.279450 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31469): Terminating (SIGTERM) 09:05:14.319323 run iperf3-srv_10.42.42.10(pid=31470): Terminating (SIGTERM) 09:05:14.359056 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31473): Terminating (SIGTERM) 09:05:14.398623 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31476): Terminating (SIGTERM) 09:05:14.438277 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31479): Terminating (SIGTERM) 09:05:14.478390 --- ParallelTerminationStrategy: PID 31469 died... 09:05:14.498017 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31469): Terminated: ok {rc=0} 09:05:14.542150 --- ParallelTerminationStrategy: PID 31470 died... 09:05:14.560913 run iperf3-srv_10.42.42.10(pid=31470): Terminated {rc=256} 09:05:14.604854 --- ParallelTerminationStrategy: PID 31473 died... 09:05:14.623795 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31473): Terminated: ok {rc=0} 09:05:14.667546 --- ParallelTerminationStrategy: PID 31476 died... 09:05:14.686444 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31476): Terminated: ok {rc=0} 09:05:14.730167 --- ParallelTerminationStrategy: PID 31479 died... 09:05:14.748868 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31479): Terminated: ok {rc=0} 09:05:14.834920 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2402 gprs:trx-umtrx iperf3m4.py ---------------------------------------------- 09:05:15.986316 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 09:05:15.999113 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 09:05:16.053461 tst iperf3m4.py: using LAC 39858 09:05:16.186960 tst iperf3m4.py: using RAC 78 09:05:16.318671 tst iperf3m4.py: using CellId 39858 09:05:16.459382 tst iperf3m4.py: using BVCI 39859 09:05:16.574047 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 09:05:16.585424 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 09:05:16.596615 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 09:05:16.607940 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 09:05:16.619358 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 09:05:16.630668 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 09:05:16.642338 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 09:05:16.654442 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 09:05:16.667373 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 09:05:16.788443 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 09:05:16.935268 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 09:05:17.063180 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 09:05:17.199727 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 09:05:17.438162 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:05:17.746657 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31481): Launched 09:05:18.014655 run iperf3-srv_10.42.42.10(pid=31482): Launched 09:05:18.129582 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 09:05:18.333886 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:05:18.640305 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31483): Launched 09:05:18.907046 run iperf3-srv_10.42.42.10(pid=31484): Launched 09:05:19.023795 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 09:05:19.228583 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:05:19.537365 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31485): Launched 09:05:19.804611 run iperf3-srv_10.42.42.10(pid=31486): Launched 09:05:19.919552 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 09:05:20.137119 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:05:20.468289 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31487): Launched 09:05:20.755256 run iperf3-srv_10.42.42.10(pid=31488): Launched 09:05:20.879494 tst iperf3m4.py:8: start network... 09:05:21.099411 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:05:21.611839 run create_hlr_db(pid=31489): Launched 09:05:21.745786 bus /gobi_6: Setting Powered False 09:05:22.810386 run create_hlr_db(pid=31489): Terminated: ok {rc=0} 09:05:23.266116 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31491): Launched 09:05:23.595852 run osmo-hlr_10.42.42.2(pid=31492): Launched 09:05:23.722049 run osmo-stp_10.42.42.5: Starting osmo-stp 09:05:24.292836 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31494): Launched 09:05:24.623276 run osmo-stp_10.42.42.5(pid=31495): Launched 09:05:24.749549 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:05:25.316799 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31497): Launched 09:05:25.444224 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:05:25.722550 run patchelf(pid=31498): Launched 09:05:25.905575 run osmo-stp_10.42.42.5(pid=31495): ERR: Terminated: ERROR {rc=1} [trial-2402↪gprs:trx-umtrx↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31495)] 09:05:26.044124 run osmo-stp_10.42.42.5(pid=31495): stdout: | (launched: 2022-12-14_09:05:24.562435) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:05:26.184537 run osmo-stp_10.42.42.5(pid=31495): stderr: | 20221214090524751 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214090524752 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214090524752 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214090524752 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214090524753 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214090524753 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214090524753 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:05:26.325039 run osmo-stp_10.42.42.5(pid=31495): stdout: | (launched: 2022-12-14_09:05:24.562435) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:05:26.459550 run osmo-stp_10.42.42.5(pid=31495): stderr: | 20221214090524751 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214090524752 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214090524752 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214090524752 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214090524753 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214090524753 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214090524753 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:05:26.618699 run patchelf(pid=31498): Terminating (SIGINT) 09:05:26.801280 run patchelf(pid=31498): Terminated: ok {rc=0} 09:05:26.932870 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31495): Process ended prematurely: osmo-stp_10.42.42.5(pid=31495) [trial-2402↪gprs:trx-umtrx↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31495)] [trial-2402↪gprs:trx-umtrx↪iperf3m4.py:8] 09:05:26.943269 tst iperf3m4.py:8: Test FAILED (11.0 sec) 09:05:26.972159 run osmo-hlr_10.42.42.2(pid=31492): ERR: Terminated: ERROR {rc=237} [trial-2402↪gprs:trx-umtrx↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31492)] 09:05:27.022395 run osmo-hlr_10.42.42.2(pid=31492): stdout: | (launched: 2022-12-14_09:05:23.535523) 09:05:27.074170 run osmo-hlr_10.42.42.2(pid=31492): stderr: | 20221214090523731 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214090523731 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214090523732 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214090523732 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214090523732 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214090523732 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214090523744 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/gprs:trx-umtrx/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214090523753 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214090523753 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214090523753 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:05:27.126807 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31481): Terminating (SIGTERM) 09:05:27.178601 run iperf3-srv_10.42.42.10(pid=31482): Terminating (SIGTERM) 09:05:27.220735 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31483): Terminating (SIGTERM) 09:05:27.263061 run iperf3-srv_10.42.42.10(pid=31484): Terminating (SIGTERM) 09:05:27.305361 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31485): Terminating (SIGTERM) 09:05:27.347652 run iperf3-srv_10.42.42.10(pid=31486): Terminating (SIGTERM) 09:05:27.389655 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31487): Terminating (SIGTERM) 09:05:27.432164 run iperf3-srv_10.42.42.10(pid=31488): Terminating (SIGTERM) 09:05:27.473751 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31491): Terminating (SIGTERM) 09:05:27.515552 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31494): Terminating (SIGTERM) 09:05:27.557145 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31497): Terminating (SIGTERM) 09:05:27.598995 --- ParallelTerminationStrategy: PID 31481 died... 09:05:27.619056 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31481): Terminated: ok {rc=0} 09:05:27.665302 --- ParallelTerminationStrategy: PID 31482 died... 09:05:27.684602 run iperf3-srv_10.42.42.10(pid=31482): Terminated {rc=256} 09:05:27.730483 --- ParallelTerminationStrategy: PID 31483 died... 09:05:27.750020 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31483): Terminated: ok {rc=0} 09:05:27.796188 --- ParallelTerminationStrategy: PID 31484 died... 09:05:27.815858 run iperf3-srv_10.42.42.10(pid=31484): Terminated {rc=256} 09:05:27.861802 --- ParallelTerminationStrategy: PID 31485 died... 09:05:27.881370 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31485): Terminated: ok {rc=0} 09:05:27.927283 --- ParallelTerminationStrategy: PID 31486 died... 09:05:27.946843 run iperf3-srv_10.42.42.10(pid=31486): Terminated {rc=256} 09:05:27.992682 --- ParallelTerminationStrategy: PID 31487 died... 09:05:28.012297 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31487): Terminated: ok {rc=0} 09:05:28.058427 --- ParallelTerminationStrategy: PID 31488 died... 09:05:28.078017 run iperf3-srv_10.42.42.10(pid=31488): Terminated {rc=256} 09:05:28.123916 --- ParallelTerminationStrategy: PID 31491 died... 09:05:28.143471 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31491): Terminated: ok {rc=0} 09:05:28.189473 --- ParallelTerminationStrategy: PID 31494 died... 09:05:28.209234 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31494): Terminated: ok {rc=0} 09:05:28.255357 --- ParallelTerminationStrategy: PID 31497 died... 09:05:28.275130 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31497): Terminated: ok {rc=0} 09:05:28.363095 bus /gobi_4: Setting Powered False 09:05:29.463161 bus /gobi_4: Setting Powered False 09:05:30.578695 bus /gobi_1: Setting Powered False 09:05:31.698488 bus /gobi_1: Setting Powered False 09:05:32.823586 bus /gobi_0: Setting Powered False 09:05:33.922425 bus /gobi_0: Setting Powered False 09:05:35.038997 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2402 gprs:trx-umtrx ping.py ---------------------------------------------- 09:05:36.141850 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 09:05:36.153668 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 09:05:36.203231 tst ping.py: using LAC 39859 09:05:36.330539 tst ping.py: using RAC 79 09:05:36.460845 tst ping.py: using CellId 39859 09:05:36.585656 tst ping.py: using BVCI 39860 09:05:36.702354 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 09:05:36.713585 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 09:05:36.724640 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 09:05:36.735646 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 09:05:36.746600 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 09:05:36.757651 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 09:05:36.768743 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 09:05:36.779819 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 09:05:36.898358 tst ping.py:19: start network... 09:05:37.113787 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:05:37.612313 run create_hlr_db(pid=31501): Launched 09:05:37.744035 bus /gobi_6: Setting Powered False 09:05:38.808068 run create_hlr_db(pid=31501): Terminated: ok {rc=0} 09:05:39.236422 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31503): Launched 09:05:39.537555 run osmo-hlr_10.42.42.2(pid=31504): Launched 09:05:39.652554 run osmo-stp_10.42.42.5: Starting osmo-stp 09:05:40.210518 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31506): Launched 09:05:40.512108 run osmo-stp_10.42.42.5(pid=31507): Launched 09:05:40.626691 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:05:41.146615 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31509): Launched 09:05:41.262062 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:05:41.516351 run patchelf(pid=31510): Launched 09:05:41.683919 run osmo-stp_10.42.42.5(pid=31507): ERR: Terminated: ERROR {rc=1} [trial-2402↪gprs:trx-umtrx↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31507)] 09:05:41.811694 run osmo-stp_10.42.42.5(pid=31507): stdout: | (launched: 2022-12-14_09:05:40.456255) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:05:41.965446 run osmo-stp_10.42.42.5(pid=31507): stderr: | 20221214090540626 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214090540626 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214090540626 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214090540626 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214090540627 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214090540627 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214090540627 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:05:42.094755 run osmo-stp_10.42.42.5(pid=31507): stdout: | (launched: 2022-12-14_09:05:40.456255) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:05:42.218796 run osmo-stp_10.42.42.5(pid=31507): stderr: | 20221214090540626 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214090540626 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214090540626 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214090540626 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214090540627 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214090540627 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214090540627 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:05:42.365520 run patchelf(pid=31510): Terminating (SIGINT) 09:05:42.534956 run patchelf(pid=31510): Terminated: ok {rc=0} 09:05:42.656806 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=31507): Process ended prematurely: osmo-stp_10.42.42.5(pid=31507) [trial-2402↪gprs:trx-umtrx↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31507)] [trial-2402↪gprs:trx-umtrx↪ping.py:22] 09:05:42.666013 tst ping.py:22: Test FAILED (6.5 sec) 09:05:42.693212 run osmo-hlr_10.42.42.2(pid=31504): ERR: Terminated: ERROR {rc=237} [trial-2402↪gprs:trx-umtrx↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31504)] 09:05:42.741932 run osmo-hlr_10.42.42.2(pid=31504): stdout: | (launched: 2022-12-14_09:05:39.481347) 09:05:42.791604 run osmo-hlr_10.42.42.2(pid=31504): stderr: | 20221214090539657 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214090539657 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214090539657 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214090539657 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214090539657 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214090539657 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214090539680 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/gprs:trx-umtrx/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214090539688 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214090539689 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214090539689 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:05:42.841734 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31503): Terminating (SIGTERM) 09:05:42.881922 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31506): Terminating (SIGTERM) 09:05:42.922155 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31509): Terminating (SIGTERM) 09:05:42.962415 --- ParallelTerminationStrategy: PID 31503 died... 09:05:42.981881 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31503): Terminated: ok {rc=0} 09:05:43.026216 --- ParallelTerminationStrategy: PID 31506 died... 09:05:43.045493 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31506): Terminated: ok {rc=0} 09:05:43.089755 --- ParallelTerminationStrategy: PID 31509 died... 09:05:43.108733 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31509): Terminated: ok {rc=0} 09:05:43.195409 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2402 gprs:trx-umtrx ping_idle_ping.py ---------------------------------------------- 09:05:44.283598 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 09:05:44.294960 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 09:05:44.346593 tst ping_idle_ping.py: using LAC 39860 09:05:44.471598 tst ping_idle_ping.py: using RAC 80 09:05:44.589656 tst ping_idle_ping.py: using CellId 39860 09:05:44.708386 tst ping_idle_ping.py: using BVCI 39861 09:05:44.818186 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 09:05:44.828881 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 09:05:44.839559 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 09:05:44.850133 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 09:05:44.860537 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 09:05:44.871320 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 09:05:44.882980 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 09:05:44.894282 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 09:05:45.014928 tst ping_idle_ping.py:24: start network... 09:05:45.232844 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:05:45.736326 run create_hlr_db(pid=31511): Launched 09:05:45.878393 bus /gobi_6: Setting Powered False 09:05:46.966009 run create_hlr_db(pid=31511): Terminated: ok {rc=0} 09:05:47.447512 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31513): Launched 09:05:47.772934 run osmo-hlr_10.42.42.2(pid=31514): Launched 09:05:47.895623 run osmo-stp_10.42.42.5: Starting osmo-stp 09:05:48.451759 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31516): Launched 09:05:48.775851 run osmo-stp_10.42.42.5(pid=31517): Launched 09:05:48.899475 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:05:49.457450 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31519): Launched 09:05:49.580248 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:05:49.853679 run patchelf(pid=31520): Launched 09:05:50.032622 run osmo-stp_10.42.42.5(pid=31517): ERR: Terminated: ERROR {rc=1} [trial-2402↪gprs:trx-umtrx↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31517)] 09:05:50.169437 run osmo-stp_10.42.42.5(pid=31517): stdout: | (launched: 2022-12-14_09:05:48.716145) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:05:50.307716 run osmo-stp_10.42.42.5(pid=31517): stderr: | 20221214090548908 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214090548908 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214090548908 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214090548909 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214090548909 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214090548909 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214090548910 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:05:50.446272 run osmo-stp_10.42.42.5(pid=31517): stdout: | (launched: 2022-12-14_09:05:48.716145) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:05:50.578536 run osmo-stp_10.42.42.5(pid=31517): stderr: | 20221214090548908 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214090548908 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214090548908 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214090548909 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214090548909 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214090548909 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214090548910 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:05:50.735017 run patchelf(pid=31520): Terminating (SIGINT) 09:05:50.915243 run patchelf(pid=31520): Terminated: ok {rc=0} 09:05:51.044744 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=31517): Process ended prematurely: osmo-stp_10.42.42.5(pid=31517) [trial-2402↪gprs:trx-umtrx↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31517)] [trial-2402↪gprs:trx-umtrx↪ping_idle_ping.py:27] 09:05:51.054480 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 09:05:51.082641 run osmo-hlr_10.42.42.2(pid=31514): ERR: Terminated: ERROR {rc=237} [trial-2402↪gprs:trx-umtrx↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31514)] 09:05:51.133073 run osmo-hlr_10.42.42.2(pid=31514): stdout: | (launched: 2022-12-14_09:05:47.713288) 09:05:51.185167 run osmo-hlr_10.42.42.2(pid=31514): stderr: | 20221214090547911 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214090547911 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214090547911 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214090547911 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214090547911 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214090547912 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214090547923 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/gprs:trx-umtrx/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214090547931 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214090547932 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214090547932 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:05:51.237874 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31513): Terminating (SIGTERM) 09:05:51.280011 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31516): Terminating (SIGTERM) 09:05:51.322015 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31519): Terminating (SIGTERM) 09:05:51.364329 --- ParallelTerminationStrategy: PID 31513 died... 09:05:51.384835 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31513): Terminated: ok {rc=0} 09:05:51.431526 --- ParallelTerminationStrategy: PID 31516 died... 09:05:51.451429 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31516): Terminated: ok {rc=0} 09:05:51.497905 --- ParallelTerminationStrategy: PID 31519 died... 09:05:51.517685 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31519): Terminated: ok {rc=0} 09:05:51.605751 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2402 gprs:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 gprs:trx-umtrx+mod-bts0-egprs --------------------------------------------------------------------- 09:05:52.899742 tst gprs:trx-umtrx+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:05:52.905046 tst gprs:trx-umtrx+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 09:05:52.936885 tst gprs:trx-umtrx+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 09:05:52.975433 tst gprs:trx-umtrx+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 09:05:53.061873 tst gprs:trx-umtrx+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 09:05:53.094091 tst gprs:trx-umtrx+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 09:05:53.132465 tst gprs:trx-umtrx+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 09:05:53.725217 tst gprs:trx-umtrx+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2402 gprs:trx-umtrx+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 09:05:53.774876 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:05:53.785909 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 09:05:53.835869 tst cs_paging_gprs_active.py: using LAC 39861 09:05:53.968015 tst cs_paging_gprs_active.py: using RAC 81 09:05:54.100150 tst cs_paging_gprs_active.py: using CellId 39861 09:05:54.222447 tst cs_paging_gprs_active.py: using BVCI 39862 09:05:54.336142 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:05:54.347345 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:05:54.358160 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:05:54.369090 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:05:54.380079 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:05:54.391025 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:05:54.402241 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:05:54.413141 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:05:54.424306 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:05:54.546019 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:05:54.667134 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 09:05:54.889801 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:05:55.219742 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31525): Launched 09:05:55.507523 run iperf3-srv_10.42.42.10(pid=31526): Launched 09:05:55.631898 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 09:05:55.853542 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:05:56.183508 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31527): Launched 09:05:56.471736 run iperf3-srv_10.42.42.10(pid=31528): Launched 09:05:56.596030 tst cs_paging_gprs_active.py:38: start network... 09:05:56.817136 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:05:57.328129 run create_hlr_db(pid=31529): Launched 09:05:57.461201 bus /gobi_6: Setting Powered False 09:05:58.525599 run create_hlr_db(pid=31529): Terminated: ok {rc=0} 09:05:58.963074 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31531): Launched 09:05:59.270375 run osmo-hlr_10.42.42.2(pid=31532): Launched 09:05:59.387307 run osmo-stp_10.42.42.5: Starting osmo-stp 09:05:59.930342 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31534): Launched 09:06:00.238689 run osmo-stp_10.42.42.5(pid=31535): Launched 09:06:00.357942 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:06:00.904890 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31537): Launched 09:06:01.062336 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:06:01.349673 run patchelf(pid=31538): Launched 09:06:01.531709 run osmo-stp_10.42.42.5(pid=31535): ERR: Terminated: ERROR {rc=1} [trial-2402↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31535)] 09:06:01.665318 run osmo-stp_10.42.42.5(pid=31535): stdout: | (launched: 2022-12-14_09:06:00.181671) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:06:01.800823 run osmo-stp_10.42.42.5(pid=31535): stderr: | 20221214090600350 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214090600350 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214090600350 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214090600351 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214090600351 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214090600351 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214090600351 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:06:01.936566 run osmo-stp_10.42.42.5(pid=31535): stdout: | (launched: 2022-12-14_09:06:00.181671) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:06:02.066569 run osmo-stp_10.42.42.5(pid=31535): stderr: | 20221214090600350 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214090600350 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214090600350 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214090600351 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214090600351 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214090600351 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214090600351 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:06:02.219364 run patchelf(pid=31538): Terminating (SIGINT) 09:06:02.391478 run patchelf(pid=31538): Terminated: ok {rc=0} 09:06:02.515686 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=31535): Process ended prematurely: osmo-stp_10.42.42.5(pid=31535) [trial-2402↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31535)] [trial-2402↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 09:06:02.525678 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 09:06:02.553381 run osmo-hlr_10.42.42.2(pid=31532): ERR: Terminated: ERROR {rc=237} [trial-2402↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31532)] 09:06:02.602141 run osmo-hlr_10.42.42.2(pid=31532): stdout: | (launched: 2022-12-14_09:05:59.213472) 09:06:02.651957 run osmo-hlr_10.42.42.2(pid=31532): stderr: | 20221214090559388 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214090559388 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214090559388 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214090559388 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214090559388 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214090559388 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214090559401 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/gprs:trx-umtrx+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214090559410 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214090559411 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214090559411 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:06:02.702240 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31525): Terminating (SIGTERM) 09:06:02.742697 run iperf3-srv_10.42.42.10(pid=31526): Terminating (SIGTERM) 09:06:02.782722 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31527): Terminating (SIGTERM) 09:06:02.822932 run iperf3-srv_10.42.42.10(pid=31528): Terminating (SIGTERM) 09:06:02.863061 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31531): Terminating (SIGTERM) 09:06:02.903452 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31534): Terminating (SIGTERM) 09:06:02.943894 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31537): Terminating (SIGTERM) 09:06:02.984496 --- ParallelTerminationStrategy: PID 31525 died... 09:06:03.004311 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31525): Terminated: ok {rc=0} 09:06:03.049317 --- ParallelTerminationStrategy: PID 31526 died... 09:06:03.068296 run iperf3-srv_10.42.42.10(pid=31526): Terminated {rc=256} 09:06:03.112253 --- ParallelTerminationStrategy: PID 31527 died... 09:06:03.131449 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31527): Terminated: ok {rc=0} 09:06:03.175396 --- ParallelTerminationStrategy: PID 31528 died... 09:06:03.194325 run iperf3-srv_10.42.42.10(pid=31528): Terminated {rc=256} 09:06:03.238194 --- ParallelTerminationStrategy: PID 31531 died... 09:06:03.256932 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31531): Terminated: ok {rc=0} 09:06:03.301426 --- ParallelTerminationStrategy: PID 31534 died... 09:06:03.320604 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31534): Terminated: ok {rc=0} 09:06:03.364617 --- ParallelTerminationStrategy: PID 31537 died... 09:06:03.383749 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31537): Terminated: ok {rc=0} 09:06:03.470246 bus /gobi_0: Setting Powered False 09:06:04.569398 bus /gobi_0: Setting Powered False 09:06:05.680169 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2402 gprs:trx-umtrx+mod-bts0-egprs iperf3.py ---------------------------------------------- 09:06:06.829698 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:06:06.841986 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 09:06:06.899183 tst iperf3.py: using LAC 39862 09:06:07.020685 tst iperf3.py: using RAC 82 09:06:07.140267 tst iperf3.py: using CellId 39862 09:06:07.259750 tst iperf3.py: using BVCI 39863 09:06:07.371592 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:06:07.382861 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:06:07.393916 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:06:07.404911 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:06:07.415952 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:06:07.426900 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:06:07.438138 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:06:07.448894 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:06:07.460063 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:06:07.579742 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 09:06:07.801790 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:06:08.131697 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31539): Launched 09:06:08.418505 run iperf3-srv_10.42.42.10(pid=31540): Launched 09:06:08.542682 tst iperf3.py:8: start network... 09:06:08.763220 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:06:09.272131 run create_hlr_db(pid=31541): Launched 09:06:09.406865 bus /gobi_6: Setting Powered False 09:06:10.466108 run create_hlr_db(pid=31541): Terminated: ok {rc=0} 09:06:10.922134 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31543): Launched 09:06:11.250890 run osmo-hlr_10.42.42.2(pid=31544): Launched 09:06:11.377223 run osmo-stp_10.42.42.5: Starting osmo-stp 09:06:11.952141 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31546): Launched 09:06:12.281740 run osmo-stp_10.42.42.5(pid=31547): Launched 09:06:12.405902 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:06:12.968619 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31549): Launched 09:06:13.092887 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:06:13.370253 run patchelf(pid=31550): Launched 09:06:13.551234 run osmo-stp_10.42.42.5(pid=31547): ERR: Terminated: ERROR {rc=1} [trial-2402↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31547)] 09:06:13.688928 run osmo-stp_10.42.42.5(pid=31547): stdout: | (launched: 2022-12-14_09:06:12.220682) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:06:13.828307 run osmo-stp_10.42.42.5(pid=31547): stderr: | 20221214090612416 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214090612416 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214090612416 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214090612417 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214090612417 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214090612417 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214090612417 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:06:13.967488 run osmo-stp_10.42.42.5(pid=31547): stdout: | (launched: 2022-12-14_09:06:12.220682) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:06:14.100655 run osmo-stp_10.42.42.5(pid=31547): stderr: | 20221214090612416 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214090612416 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214090612416 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214090612417 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214090612417 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214090612417 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214090612417 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:06:14.259031 run patchelf(pid=31550): Terminating (SIGINT) 09:06:14.440474 run patchelf(pid=31550): Terminated: ok {rc=0} 09:06:14.571605 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31547): Process ended prematurely: osmo-stp_10.42.42.5(pid=31547) [trial-2402↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31547)] [trial-2402↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8] 09:06:14.581887 tst iperf3.py:8: Test FAILED (7.8 sec) 09:06:14.610164 run osmo-hlr_10.42.42.2(pid=31544): ERR: Terminated: ERROR {rc=237} [trial-2402↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31544)] 09:06:14.659739 run osmo-hlr_10.42.42.2(pid=31544): stdout: | (launched: 2022-12-14_09:06:11.189930) 09:06:14.711097 run osmo-hlr_10.42.42.2(pid=31544): stderr: | 20221214090611389 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214090611389 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214090611389 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214090611389 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214090611389 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214090611389 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214090611401 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/gprs:trx-umtrx+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214090611411 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214090611411 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214090611411 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:06:14.762952 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31539): Terminating (SIGTERM) 09:06:14.804466 run iperf3-srv_10.42.42.10(pid=31540): Terminating (SIGTERM) 09:06:14.845830 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31543): Terminating (SIGTERM) 09:06:14.887269 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31546): Terminating (SIGTERM) 09:06:14.928584 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31549): Terminating (SIGTERM) 09:06:14.970470 --- ParallelTerminationStrategy: PID 31539 died... 09:06:14.990466 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31539): Terminated: ok {rc=0} 09:06:15.036483 --- ParallelTerminationStrategy: PID 31540 died... 09:06:15.056121 run iperf3-srv_10.42.42.10(pid=31540): Terminated {rc=256} 09:06:15.101719 --- ParallelTerminationStrategy: PID 31543 died... 09:06:15.121137 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31543): Terminated: ok {rc=0} 09:06:15.166773 --- ParallelTerminationStrategy: PID 31546 died... 09:06:15.186243 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31546): Terminated: ok {rc=0} 09:06:15.232120 --- ParallelTerminationStrategy: PID 31549 died... 09:06:15.252025 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31549): Terminated: ok {rc=0} 09:06:15.338812 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2402 gprs:trx-umtrx+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 09:06:16.516413 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:06:16.533168 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 09:06:16.599754 tst iperf3m4.py: using LAC 39863 09:06:16.763538 tst iperf3m4.py: using RAC 83 09:06:16.894430 tst iperf3m4.py: using CellId 39863 09:06:17.019477 tst iperf3m4.py: using BVCI 39864 09:06:17.135508 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:06:17.147716 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:06:17.159583 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:06:17.171361 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:06:17.184309 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:06:17.197402 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:06:17.210417 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:06:17.223097 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:06:17.236217 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:06:17.356125 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:06:17.477662 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:06:17.594879 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:06:17.716590 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 09:06:17.931252 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:06:18.240849 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31551): Launched 09:06:18.510185 run iperf3-srv_10.42.42.10(pid=31552): Launched 09:06:18.627514 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 09:06:18.832408 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:06:19.141022 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31553): Launched 09:06:19.408436 run iperf3-srv_10.42.42.10(pid=31554): Launched 09:06:19.523478 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 09:06:19.728780 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:06:20.038557 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31555): Launched 09:06:20.308313 run iperf3-srv_10.42.42.10(pid=31556): Launched 09:06:20.423751 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 09:06:20.628901 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:06:20.938003 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31557): Launched 09:06:21.207204 run iperf3-srv_10.42.42.10(pid=31558): Launched 09:06:21.322709 tst iperf3m4.py:8: start network... 09:06:21.527303 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:06:22.005967 run create_hlr_db(pid=31559): Launched 09:06:22.126987 bus /gobi_6: Setting Powered False 09:06:23.188247 run create_hlr_db(pid=31559): Terminated: ok {rc=0} 09:06:23.615745 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31561): Launched 09:06:23.923909 run osmo-hlr_10.42.42.2(pid=31562): Launched 09:06:24.041466 run osmo-stp_10.42.42.5: Starting osmo-stp 09:06:24.575440 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31564): Launched 09:06:24.883857 run osmo-stp_10.42.42.5(pid=31565): Launched 09:06:25.003604 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:06:25.534897 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31567): Launched 09:06:25.651680 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:06:25.911607 run patchelf(pid=31568): Launched 09:06:26.083210 run osmo-stp_10.42.42.5(pid=31565): ERR: Terminated: ERROR {rc=1} [trial-2402↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31565)] 09:06:26.212881 run osmo-stp_10.42.42.5(pid=31565): stdout: | (launched: 2022-12-14_09:06:24.826281) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:06:26.344241 run osmo-stp_10.42.42.5(pid=31565): stderr: | 20221214090624993 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214090624993 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214090624993 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214090624994 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214090624994 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214090624994 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214090624994 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:06:26.475336 run osmo-stp_10.42.42.5(pid=31565): stdout: | (launched: 2022-12-14_09:06:24.826281) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:06:26.600671 run osmo-stp_10.42.42.5(pid=31565): stderr: | 20221214090624993 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214090624993 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214090624993 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214090624994 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214090624994 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214090624994 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214090624994 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:06:26.749306 run patchelf(pid=31568): Terminating (SIGINT) 09:06:26.920079 run patchelf(pid=31568): Terminated: ok {rc=0} 09:06:27.043477 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31565): Process ended prematurely: osmo-stp_10.42.42.5(pid=31565) [trial-2402↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31565)] [trial-2402↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8] 09:06:27.053213 tst iperf3m4.py:8: Test FAILED (10.6 sec) 09:06:27.080723 run osmo-hlr_10.42.42.2(pid=31562): ERR: Terminated: ERROR {rc=237} [trial-2402↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31562)] 09:06:27.129131 run osmo-hlr_10.42.42.2(pid=31562): stdout: | (launched: 2022-12-14_09:06:23.866638) 09:06:27.178870 run osmo-hlr_10.42.42.2(pid=31562): stderr: | 20221214090624042 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214090624042 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214090624042 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214090624042 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214090624042 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214090624042 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214090624054 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/gprs:trx-umtrx+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214090624062 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214090624063 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214090624063 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:06:27.229082 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31551): Terminating (SIGTERM) 09:06:27.269320 run iperf3-srv_10.42.42.10(pid=31552): Terminating (SIGTERM) 09:06:27.309212 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31553): Terminating (SIGTERM) 09:06:27.349087 run iperf3-srv_10.42.42.10(pid=31554): Terminating (SIGTERM) 09:06:27.389082 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31555): Terminating (SIGTERM) 09:06:27.429137 run iperf3-srv_10.42.42.10(pid=31556): Terminating (SIGTERM) 09:06:27.469113 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31557): Terminating (SIGTERM) 09:06:27.509185 run iperf3-srv_10.42.42.10(pid=31558): Terminating (SIGTERM) 09:06:27.549059 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31561): Terminating (SIGTERM) 09:06:27.589183 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31564): Terminating (SIGTERM) 09:06:27.629150 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31567): Terminating (SIGTERM) 09:06:27.669535 --- ParallelTerminationStrategy: PID 31551 died... 09:06:27.689195 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31551): Terminated: ok {rc=0} 09:06:27.733523 --- ParallelTerminationStrategy: PID 31552 died... 09:06:27.752139 run iperf3-srv_10.42.42.10(pid=31552): Terminated {rc=256} 09:06:27.796801 --- ParallelTerminationStrategy: PID 31553 died... 09:06:27.816384 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31553): Terminated: ok {rc=0} 09:06:27.861192 --- ParallelTerminationStrategy: PID 31554 died... 09:06:27.880073 run iperf3-srv_10.42.42.10(pid=31554): Terminated {rc=256} 09:06:27.924787 --- ParallelTerminationStrategy: PID 31555 died... 09:06:27.943846 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31555): Terminated: ok {rc=0} 09:06:27.988090 --- ParallelTerminationStrategy: PID 31556 died... 09:06:28.007144 run iperf3-srv_10.42.42.10(pid=31556): Terminated {rc=256} 09:06:28.050990 --- ParallelTerminationStrategy: PID 31557 died... 09:06:28.070261 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31557): Terminated: ok {rc=0} 09:06:28.114682 --- ParallelTerminationStrategy: PID 31558 died... 09:06:28.133896 run iperf3-srv_10.42.42.10(pid=31558): Terminated {rc=256} 09:06:28.177944 --- ParallelTerminationStrategy: PID 31561 died... 09:06:28.197176 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31561): Terminated: ok {rc=0} 09:06:28.241742 --- ParallelTerminationStrategy: PID 31564 died... 09:06:28.260811 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31564): Terminated: ok {rc=0} 09:06:28.305669 --- ParallelTerminationStrategy: PID 31567 died... 09:06:28.324848 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31567): Terminated: ok {rc=0} 09:06:28.408595 bus /gobi_4: Setting Powered False 09:06:29.507405 bus /gobi_4: Setting Powered False 09:06:30.626770 bus /gobi_1: Setting Powered False 09:06:31.723128 bus /gobi_1: Setting Powered False 09:06:32.836615 bus /gobi_0: Setting Powered False 09:06:33.933959 bus /gobi_0: Setting Powered False 09:06:35.049080 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2402 gprs:trx-umtrx+mod-bts0-egprs ping.py ---------------------------------------------- 09:06:36.151690 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:06:36.163974 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 09:06:36.215641 tst ping.py: using LAC 39864 09:06:36.346472 tst ping.py: using RAC 84 09:06:36.474251 tst ping.py: using CellId 39864 09:06:36.603157 tst ping.py: using BVCI 39865 09:06:36.722447 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:06:36.734207 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:06:36.745760 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:06:36.757200 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:06:36.769051 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:06:36.780881 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:06:36.793067 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:06:36.804884 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:06:36.921599 tst ping.py:19: start network... 09:06:37.122176 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:06:37.589419 run create_hlr_db(pid=31569): Launched 09:06:37.705232 bus /gobi_6: Setting Powered False 09:06:38.765701 run create_hlr_db(pid=31569): Terminated: ok {rc=0} 09:06:39.207463 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31571): Launched 09:06:39.532503 run osmo-hlr_10.42.42.2(pid=31572): Launched 09:06:39.657471 run osmo-stp_10.42.42.5: Starting osmo-stp 09:06:40.213288 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31574): Launched 09:06:40.536191 run osmo-stp_10.42.42.5(pid=31575): Launched 09:06:40.660191 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:06:41.218300 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31577): Launched 09:06:41.342789 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:06:41.615413 run patchelf(pid=31578): Launched 09:06:41.795458 run osmo-stp_10.42.42.5(pid=31575): ERR: Terminated: ERROR {rc=1} [trial-2402↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31575)] 09:06:41.932060 run osmo-stp_10.42.42.5(pid=31575): stdout: | (launched: 2022-12-14_09:06:40.476686) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:06:42.070277 run osmo-stp_10.42.42.5(pid=31575): stderr: | 20221214090640671 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214090640671 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214090640671 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214090640671 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214090640672 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214090640672 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214090640672 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:06:42.207822 run osmo-stp_10.42.42.5(pid=31575): stdout: | (launched: 2022-12-14_09:06:40.476686) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:06:42.340686 run osmo-stp_10.42.42.5(pid=31575): stderr: | 20221214090640671 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214090640671 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214090640671 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214090640671 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214090640672 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214090640672 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214090640672 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:06:42.497601 run patchelf(pid=31578): Terminating (SIGINT) 09:06:42.677335 run patchelf(pid=31578): Terminated: ok {rc=0} 09:06:42.806597 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=31575): Process ended prematurely: osmo-stp_10.42.42.5(pid=31575) [trial-2402↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31575)] [trial-2402↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22] 09:06:42.816284 tst ping.py:22: Test FAILED (6.7 sec) 09:06:42.844679 run osmo-hlr_10.42.42.2(pid=31572): ERR: Terminated: ERROR {rc=237} [trial-2402↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31572)] 09:06:42.895002 run osmo-hlr_10.42.42.2(pid=31572): stdout: | (launched: 2022-12-14_09:06:39.472851) 09:06:42.947171 run osmo-hlr_10.42.42.2(pid=31572): stderr: | 20221214090639672 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214090639672 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214090639672 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214090639672 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214090639672 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214090639672 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214090639685 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/gprs:trx-umtrx+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214090639693 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214090639693 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214090639693 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:06:42.999530 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31571): Terminating (SIGTERM) 09:06:43.041577 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31574): Terminating (SIGTERM) 09:06:43.083736 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31577): Terminating (SIGTERM) 09:06:43.126335 --- ParallelTerminationStrategy: PID 31571 died... 09:06:43.146753 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31571): Terminated: ok {rc=0} 09:06:43.193703 --- ParallelTerminationStrategy: PID 31574 died... 09:06:43.213579 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31574): Terminated: ok {rc=0} 09:06:43.260314 --- ParallelTerminationStrategy: PID 31577 died... 09:06:43.280242 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31577): Terminated: ok {rc=0} 09:06:43.368390 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2402 gprs:trx-umtrx+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 09:06:44.455716 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:06:44.468091 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 09:06:44.520375 tst ping_idle_ping.py: using LAC 39865 09:06:44.649006 tst ping_idle_ping.py: using RAC 85 09:06:44.779366 tst ping_idle_ping.py: using CellId 39865 09:06:44.904614 tst ping_idle_ping.py: using BVCI 39866 09:06:45.016043 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:06:45.027089 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:06:45.038031 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:06:45.048869 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:06:45.060460 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:06:45.072148 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:06:45.083855 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:06:45.095490 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:06:45.212516 tst ping_idle_ping.py:24: start network... 09:06:45.414575 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:06:45.905673 run create_hlr_db(pid=31579): Launched 09:06:46.060549 bus /gobi_6: Setting Powered False 09:06:47.149930 run create_hlr_db(pid=31579): Terminated: ok {rc=0} 09:06:47.594309 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31581): Launched 09:06:47.898809 run osmo-hlr_10.42.42.2(pid=31582): Launched 09:06:48.015402 run osmo-stp_10.42.42.5: Starting osmo-stp 09:06:48.548265 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31584): Launched 09:06:48.851326 run osmo-stp_10.42.42.5(pid=31585): Launched 09:06:48.966212 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:06:49.488632 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31587): Launched 09:06:49.604769 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:06:49.860524 run patchelf(pid=31588): Launched 09:06:50.030833 run osmo-stp_10.42.42.5(pid=31585): ERR: Terminated: ERROR {rc=1} [trial-2402↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31585)] 09:06:50.159502 run osmo-stp_10.42.42.5(pid=31585): stdout: | (launched: 2022-12-14_09:06:48.795030) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:06:50.288840 run osmo-stp_10.42.42.5(pid=31585): stderr: | 20221214090648965 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214090648965 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214090648965 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214090648965 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214090648966 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214090648966 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214090648966 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:06:50.418388 run osmo-stp_10.42.42.5(pid=31585): stdout: | (launched: 2022-12-14_09:06:48.795030) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:06:50.542639 run osmo-stp_10.42.42.5(pid=31585): stderr: | 20221214090648965 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214090648965 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214090648965 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214090648965 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214090648966 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214090648966 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214090648966 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:06:50.689697 run patchelf(pid=31588): Terminating (SIGINT) 09:06:50.858475 run patchelf(pid=31588): Terminated: ok {rc=0} 09:06:50.980040 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=31585): Process ended prematurely: osmo-stp_10.42.42.5(pid=31585) [trial-2402↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31585)] [trial-2402↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27] 09:06:50.989331 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 09:06:51.016439 run osmo-hlr_10.42.42.2(pid=31582): ERR: Terminated: ERROR {rc=237} [trial-2402↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31582)] 09:06:51.064914 run osmo-hlr_10.42.42.2(pid=31582): stdout: | (launched: 2022-12-14_09:06:47.842217) 09:06:51.115178 run osmo-hlr_10.42.42.2(pid=31582): stderr: | 20221214090648018 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214090648018 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214090648018 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214090648018 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214090648018 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214090648018 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214090648031 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/gprs:trx-umtrx+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214090648042 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214090648042 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214090648042 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:06:51.165809 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31581): Terminating (SIGTERM) 09:06:51.206522 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31584): Terminating (SIGTERM) 09:06:51.247109 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31587): Terminating (SIGTERM) 09:06:51.287948 --- ParallelTerminationStrategy: PID 31581 died... 09:06:51.307911 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31581): Terminated: ok {rc=0} 09:06:51.352707 --- ParallelTerminationStrategy: PID 31584 died... 09:06:51.371957 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31584): Terminated: ok {rc=0} 09:06:51.416549 --- ParallelTerminationStrategy: PID 31587 died... 09:06:51.435735 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31587): Terminated: ok {rc=0} 09:06:51.523245 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2402 gprs:trx-umtrx+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 gprs:trx-umtrx+mod-bts0-dynts-ipa --------------------------------------------------------------------- 09:06:52.832469 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:06:52.839206 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 09:06:52.872358 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 09:06:52.914167 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 09:06:53.005231 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 09:06:53.038839 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 09:06:53.079566 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 09:06:53.674031 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2402 gprs:trx-umtrx+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 09:06:53.726881 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:06:53.738033 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 09:06:53.806729 tst cs_paging_gprs_active.py: using LAC 39866 09:06:53.927364 tst cs_paging_gprs_active.py: using RAC 86 09:06:54.049739 tst cs_paging_gprs_active.py: using CellId 39866 09:06:54.169195 tst cs_paging_gprs_active.py: using BVCI 39867 09:06:54.280564 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:06:54.291592 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:06:54.302498 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:06:54.313440 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:06:54.324322 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:06:54.336265 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:06:54.347859 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:06:54.359234 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:06:54.370860 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:06:54.492823 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:06:54.613390 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 09:06:54.835402 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:06:55.165468 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31592): Launched 09:06:55.453702 run iperf3-srv_10.42.42.10(pid=31593): Launched 09:06:55.576336 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 09:06:55.797246 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:06:56.127292 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31594): Launched 09:06:56.414231 run iperf3-srv_10.42.42.10(pid=31595): Launched 09:06:56.538367 tst cs_paging_gprs_active.py:38: start network... 09:06:56.759552 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:06:57.270632 run create_hlr_db(pid=31596): Launched 09:06:57.406450 bus /gobi_6: Setting Powered False 09:06:58.470841 run create_hlr_db(pid=31596): Terminated: ok {rc=0} 09:06:58.908761 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31598): Launched 09:06:59.215554 run osmo-hlr_10.42.42.2(pid=31599): Launched 09:06:59.332251 run osmo-stp_10.42.42.5: Starting osmo-stp 09:06:59.864729 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31601): Launched 09:07:00.173993 run osmo-stp_10.42.42.5(pid=31602): Launched 09:07:00.290735 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:07:00.820633 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31604): Launched 09:07:00.967368 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:07:01.261602 run patchelf(pid=31605): Launched 09:07:01.451355 run osmo-stp_10.42.42.5(pid=31602): ERR: Terminated: ERROR {rc=1} [trial-2402↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31602)] 09:07:01.585137 run osmo-stp_10.42.42.5(pid=31602): stdout: | (launched: 2022-12-14_09:07:00.116427) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:07:01.720494 run osmo-stp_10.42.42.5(pid=31602): stderr: | 20221214090700287 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214090700287 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214090700287 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214090700287 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214090700288 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214090700288 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214090700288 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:07:01.856474 run osmo-stp_10.42.42.5(pid=31602): stdout: | (launched: 2022-12-14_09:07:00.116427) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:07:01.987196 run osmo-stp_10.42.42.5(pid=31602): stderr: | 20221214090700287 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214090700287 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214090700287 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214090700287 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214090700288 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214090700288 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214090700288 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:07:02.140311 run patchelf(pid=31605): Terminating (SIGINT) 09:07:02.316006 run patchelf(pid=31605): Terminated: ok {rc=0} 09:07:02.440666 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=31602): Process ended prematurely: osmo-stp_10.42.42.5(pid=31602) [trial-2402↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31602)] [trial-2402↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 09:07:02.450792 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 09:07:02.478549 run osmo-hlr_10.42.42.2(pid=31599): ERR: Terminated: ERROR {rc=237} [trial-2402↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31599)] 09:07:02.527936 run osmo-hlr_10.42.42.2(pid=31599): stdout: | (launched: 2022-12-14_09:06:59.158665) 09:07:02.578233 run osmo-hlr_10.42.42.2(pid=31599): stderr: | 20221214090659336 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214090659336 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214090659336 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214090659336 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214090659336 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214090659336 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214090659347 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/gprs:trx-umtrx+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214090659355 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214090659355 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214090659356 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:07:02.628940 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31592): Terminating (SIGTERM) 09:07:02.669522 run iperf3-srv_10.42.42.10(pid=31593): Terminating (SIGTERM) 09:07:02.709796 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31594): Terminating (SIGTERM) 09:07:02.750398 run iperf3-srv_10.42.42.10(pid=31595): Terminating (SIGTERM) 09:07:02.790359 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31598): Terminating (SIGTERM) 09:07:02.830520 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31601): Terminating (SIGTERM) 09:07:02.870919 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31604): Terminating (SIGTERM) 09:07:02.911621 --- ParallelTerminationStrategy: PID 31592 died... 09:07:02.931573 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31592): Terminated: ok {rc=0} 09:07:02.976220 --- ParallelTerminationStrategy: PID 31593 died... 09:07:02.995756 run iperf3-srv_10.42.42.10(pid=31593): Terminated {rc=256} 09:07:03.040673 --- ParallelTerminationStrategy: PID 31594 died... 09:07:03.060121 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31594): Terminated: ok {rc=0} 09:07:03.104596 --- ParallelTerminationStrategy: PID 31595 died... 09:07:03.123923 run iperf3-srv_10.42.42.10(pid=31595): Terminated {rc=256} 09:07:03.168261 --- ParallelTerminationStrategy: PID 31598 died... 09:07:03.187609 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31598): Terminated: ok {rc=0} 09:07:03.232201 --- ParallelTerminationStrategy: PID 31601 died... 09:07:03.251654 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31601): Terminated: ok {rc=0} 09:07:03.296178 --- ParallelTerminationStrategy: PID 31604 died... 09:07:03.315506 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31604): Terminated: ok {rc=0} 09:07:03.402371 bus /gobi_0: Setting Powered False 09:07:04.500157 bus /gobi_0: Setting Powered False 09:07:05.613468 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2402 gprs:trx-umtrx+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 09:07:06.762061 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:07:06.774327 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 09:07:06.847738 tst iperf3.py: using LAC 39867 09:07:06.977723 tst iperf3.py: using RAC 87 09:07:07.109477 tst iperf3.py: using CellId 39867 09:07:07.241827 tst iperf3.py: using BVCI 39868 09:07:07.357063 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:07:07.368092 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:07:07.379102 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:07:07.390064 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:07:07.401832 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:07:07.413768 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:07:07.425642 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:07:07.437449 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:07:07.449396 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:07:07.573133 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 09:07:07.794580 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:07:08.124128 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31607): Launched 09:07:08.412889 run iperf3-srv_10.42.42.10(pid=31608): Launched 09:07:08.537721 tst iperf3.py:8: start network... 09:07:08.758185 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:07:09.267441 run create_hlr_db(pid=31609): Launched 09:07:09.400540 bus /gobi_6: Setting Powered False 09:07:10.465354 run create_hlr_db(pid=31609): Terminated: ok {rc=0} 09:07:10.920121 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31611): Launched 09:07:11.249661 run osmo-hlr_10.42.42.2(pid=31612): Launched 09:07:11.377099 run osmo-stp_10.42.42.5: Starting osmo-stp 09:07:12.041713 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31614): Launched 09:07:12.362943 run osmo-stp_10.42.42.5(pid=31615): Launched 09:07:12.485329 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:07:13.041324 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31617): Launched 09:07:13.165240 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:07:13.437593 run patchelf(pid=31618): Launched 09:07:13.615302 run osmo-stp_10.42.42.5(pid=31615): ERR: Terminated: ERROR {rc=1} [trial-2402↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31615)] 09:07:13.751569 run osmo-stp_10.42.42.5(pid=31615): stdout: | (launched: 2022-12-14_09:07:12.303648) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:07:13.888741 run osmo-stp_10.42.42.5(pid=31615): stderr: | 20221214090712496 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214090712496 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214090712496 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214090712497 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214090712497 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214090712497 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214090712497 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:07:14.026462 run osmo-stp_10.42.42.5(pid=31615): stdout: | (launched: 2022-12-14_09:07:12.303648) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:07:14.158219 run osmo-stp_10.42.42.5(pid=31615): stderr: | 20221214090712496 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214090712496 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214090712496 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214090712497 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214090712497 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214090712497 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214090712497 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:07:14.315515 run patchelf(pid=31618): Terminating (SIGINT) 09:07:14.494948 run patchelf(pid=31618): Terminated: ok {rc=0} 09:07:14.624603 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31615): Process ended prematurely: osmo-stp_10.42.42.5(pid=31615) [trial-2402↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31615)] [trial-2402↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8] 09:07:14.634874 tst iperf3.py:8: Test FAILED (7.9 sec) 09:07:14.663434 run osmo-hlr_10.42.42.2(pid=31612): ERR: Terminated: ERROR {rc=237} [trial-2402↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31612)] 09:07:14.714030 run osmo-hlr_10.42.42.2(pid=31612): stdout: | (launched: 2022-12-14_09:07:11.189078) 09:07:14.766408 run osmo-hlr_10.42.42.2(pid=31612): stderr: | 20221214090711387 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214090711387 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214090711387 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214090711387 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214090711388 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214090711388 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214090711400 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/gprs:trx-umtrx+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214090711409 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214090711409 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214090711410 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:07:14.818809 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31607): Terminating (SIGTERM) 09:07:14.860699 run iperf3-srv_10.42.42.10(pid=31608): Terminating (SIGTERM) 09:07:14.902602 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31611): Terminating (SIGTERM) 09:07:14.945093 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31614): Terminating (SIGTERM) 09:07:14.987749 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31617): Terminating (SIGTERM) 09:07:15.030743 --- ParallelTerminationStrategy: PID 31607 died... 09:07:15.050862 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31607): Terminated: ok {rc=0} 09:07:15.097234 --- ParallelTerminationStrategy: PID 31608 died... 09:07:15.116767 run iperf3-srv_10.42.42.10(pid=31608): Terminated {rc=256} 09:07:15.162665 --- ParallelTerminationStrategy: PID 31611 died... 09:07:15.182441 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31611): Terminated: ok {rc=0} 09:07:15.228760 --- ParallelTerminationStrategy: PID 31614 died... 09:07:15.248311 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31614): Terminated: ok {rc=0} 09:07:15.294413 --- ParallelTerminationStrategy: PID 31617 died... 09:07:15.314027 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31617): Terminated: ok {rc=0} 09:07:15.402178 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2402 gprs:trx-umtrx+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 09:07:16.579482 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:07:16.592801 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 09:07:16.677370 tst iperf3m4.py: using LAC 39868 09:07:16.844773 tst iperf3m4.py: using RAC 88 09:07:16.966606 tst iperf3m4.py: using CellId 39868 09:07:17.088751 tst iperf3m4.py: using BVCI 39869 09:07:17.233214 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:07:17.244516 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:07:17.256458 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:07:17.267842 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:07:17.279823 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:07:17.291573 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:07:17.303464 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:07:17.315080 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:07:17.327454 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:07:17.447792 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:07:17.567035 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:07:17.686369 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:07:17.802888 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 09:07:18.005242 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:07:18.309138 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31620): Launched 09:07:18.571675 run iperf3-srv_10.42.42.10(pid=31621): Launched 09:07:18.684884 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 09:07:18.885851 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:07:19.188802 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31622): Launched 09:07:19.451199 run iperf3-srv_10.42.42.10(pid=31623): Launched 09:07:19.565773 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 09:07:19.766154 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:07:20.068901 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31624): Launched 09:07:20.332030 run iperf3-srv_10.42.42.10(pid=31625): Launched 09:07:20.445080 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 09:07:20.645568 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:07:20.947999 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31626): Launched 09:07:21.210044 run iperf3-srv_10.42.42.10(pid=31627): Launched 09:07:21.322912 tst iperf3m4.py:8: start network... 09:07:21.523771 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:07:21.994580 run create_hlr_db(pid=31628): Launched 09:07:22.109766 bus /gobi_6: Setting Powered False 09:07:23.169587 run create_hlr_db(pid=31628): Terminated: ok {rc=0} 09:07:23.611377 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31630): Launched 09:07:23.934974 run osmo-hlr_10.42.42.2(pid=31631): Launched 09:07:24.056825 run osmo-stp_10.42.42.5: Starting osmo-stp 09:07:24.612517 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31633): Launched 09:07:24.934415 run osmo-stp_10.42.42.5(pid=31634): Launched 09:07:25.057937 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:07:25.613568 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31636): Launched 09:07:25.737237 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:07:26.009378 run patchelf(pid=31637): Launched 09:07:26.186726 run osmo-stp_10.42.42.5(pid=31634): ERR: Terminated: ERROR {rc=1} [trial-2402↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31634)] 09:07:26.323032 run osmo-stp_10.42.42.5(pid=31634): stdout: | (launched: 2022-12-14_09:07:24.875146) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:07:26.460841 run osmo-stp_10.42.42.5(pid=31634): stderr: | 20221214090725062 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214090725063 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214090725063 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214090725063 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214090725064 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214090725064 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214090725064 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:07:26.598210 run osmo-stp_10.42.42.5(pid=31634): stdout: | (launched: 2022-12-14_09:07:24.875146) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:07:26.729851 run osmo-stp_10.42.42.5(pid=31634): stderr: | 20221214090725062 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214090725063 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214090725063 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214090725063 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214090725064 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214090725064 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214090725064 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:07:26.885739 run patchelf(pid=31637): Terminating (SIGINT) 09:07:27.063900 run patchelf(pid=31637): Terminated: ok {rc=0} 09:07:27.192733 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31634): Process ended prematurely: osmo-stp_10.42.42.5(pid=31634) [trial-2402↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31634)] [trial-2402↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8] 09:07:27.203089 tst iperf3m4.py:8: Test FAILED (10.7 sec) 09:07:27.231934 run osmo-hlr_10.42.42.2(pid=31631): ERR: Terminated: ERROR {rc=237} [trial-2402↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31631)] 09:07:27.283059 run osmo-hlr_10.42.42.2(pid=31631): stdout: | (launched: 2022-12-14_09:07:23.874190) 09:07:27.335435 run osmo-hlr_10.42.42.2(pid=31631): stderr: | 20221214090724071 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214090724071 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214090724071 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214090724071 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214090724071 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214090724071 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214090724084 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/gprs:trx-umtrx+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214090724094 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214090724094 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214090724094 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:07:27.388338 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31620): Terminating (SIGTERM) 09:07:27.431108 run iperf3-srv_10.42.42.10(pid=31621): Terminating (SIGTERM) 09:07:27.473291 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31622): Terminating (SIGTERM) 09:07:27.515796 run iperf3-srv_10.42.42.10(pid=31623): Terminating (SIGTERM) 09:07:27.557947 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31624): Terminating (SIGTERM) 09:07:27.600213 run iperf3-srv_10.42.42.10(pid=31625): Terminating (SIGTERM) 09:07:27.642388 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31626): Terminating (SIGTERM) 09:07:27.684496 run iperf3-srv_10.42.42.10(pid=31627): Terminating (SIGTERM) 09:07:27.726528 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31630): Terminating (SIGTERM) 09:07:27.768794 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31633): Terminating (SIGTERM) 09:07:27.811374 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31636): Terminating (SIGTERM) 09:07:27.854201 --- ParallelTerminationStrategy: PID 31620 died... 09:07:27.874336 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31620): Terminated: ok {rc=0} 09:07:27.920892 --- ParallelTerminationStrategy: PID 31621 died... 09:07:27.940795 run iperf3-srv_10.42.42.10(pid=31621): Terminated {rc=256} 09:07:27.986911 --- ParallelTerminationStrategy: PID 31622 died... 09:07:28.006461 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31622): Terminated: ok {rc=0} 09:07:28.052387 --- ParallelTerminationStrategy: PID 31623 died... 09:07:28.071952 run iperf3-srv_10.42.42.10(pid=31623): Terminated {rc=256} 09:07:28.117941 --- ParallelTerminationStrategy: PID 31624 died... 09:07:28.137430 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31624): Terminated: ok {rc=0} 09:07:28.183492 --- ParallelTerminationStrategy: PID 31625 died... 09:07:28.202957 run iperf3-srv_10.42.42.10(pid=31625): Terminated {rc=256} 09:07:28.249103 --- ParallelTerminationStrategy: PID 31626 died... 09:07:28.268843 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31626): Terminated: ok {rc=0} 09:07:28.315087 --- ParallelTerminationStrategy: PID 31627 died... 09:07:28.334745 run iperf3-srv_10.42.42.10(pid=31627): Terminated {rc=256} 09:07:28.381207 --- ParallelTerminationStrategy: PID 31630 died... 09:07:28.400819 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31630): Terminated: ok {rc=0} 09:07:28.447171 --- ParallelTerminationStrategy: PID 31633 died... 09:07:28.466800 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31633): Terminated: ok {rc=0} 09:07:28.512648 --- ParallelTerminationStrategy: PID 31636 died... 09:07:28.532323 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31636): Terminated: ok {rc=0} 09:07:28.620360 bus /gobi_4: Setting Powered False 09:07:29.718899 bus /gobi_4: Setting Powered False 09:07:30.835083 bus /gobi_1: Setting Powered False 09:07:31.931765 bus /gobi_1: Setting Powered False 09:07:33.046361 bus /gobi_0: Setting Powered False 09:07:34.145628 bus /gobi_0: Setting Powered False 09:07:35.263592 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2402 gprs:trx-umtrx+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 09:07:36.367124 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:07:36.379528 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 09:07:36.451303 tst ping.py: using LAC 39869 09:07:36.580925 tst ping.py: using RAC 89 09:07:36.705069 tst ping.py: using CellId 39869 09:07:36.827085 tst ping.py: using BVCI 39870 09:07:36.941732 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:07:36.953194 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:07:36.964438 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:07:36.975734 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:07:36.986962 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:07:36.998303 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:07:37.009680 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:07:37.020874 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:07:37.138268 tst ping.py:19: start network... 09:07:37.351736 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:07:37.845793 run create_hlr_db(pid=31638): Launched 09:07:37.975808 bus /gobi_6: Setting Powered False 09:07:39.039241 run create_hlr_db(pid=31638): Terminated: ok {rc=0} 09:07:39.464592 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31640): Launched 09:07:39.762644 run osmo-hlr_10.42.42.2(pid=31641): Launched 09:07:39.876023 run osmo-stp_10.42.42.5: Starting osmo-stp 09:07:40.393841 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31643): Launched 09:07:40.691765 run osmo-stp_10.42.42.5(pid=31644): Launched 09:07:40.804929 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:07:41.317921 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31646): Launched 09:07:41.432825 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:07:41.683572 run patchelf(pid=31647): Launched 09:07:41.848355 run osmo-stp_10.42.42.5(pid=31644): ERR: Terminated: ERROR {rc=1} [trial-2402↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31644)] 09:07:41.974509 run osmo-stp_10.42.42.5(pid=31644): stdout: | (launched: 2022-12-14_09:07:40.636602) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:07:42.101787 run osmo-stp_10.42.42.5(pid=31644): stderr: | 20221214090740806 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214090740806 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214090740806 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214090740807 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214090740807 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214090740807 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214090740807 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:07:42.229734 run osmo-stp_10.42.42.5(pid=31644): stdout: | (launched: 2022-12-14_09:07:40.636602) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:07:42.351925 run osmo-stp_10.42.42.5(pid=31644): stderr: | 20221214090740806 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214090740806 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214090740806 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214090740807 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214090740807 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214090740807 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214090740807 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:07:42.496544 run patchelf(pid=31647): Terminating (SIGINT) 09:07:42.662851 run patchelf(pid=31647): Terminated: ok {rc=0} 09:07:42.782851 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=31644): Process ended prematurely: osmo-stp_10.42.42.5(pid=31644) [trial-2402↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31644)] [trial-2402↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22] 09:07:42.791892 tst ping.py:22: Test FAILED (6.4 sec) 09:07:42.818529 run osmo-hlr_10.42.42.2(pid=31641): ERR: Terminated: ERROR {rc=237} [trial-2402↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31641)] 09:07:42.866758 run osmo-hlr_10.42.42.2(pid=31641): stdout: | (launched: 2022-12-14_09:07:39.707418) 09:07:42.916321 run osmo-hlr_10.42.42.2(pid=31641): stderr: | 20221214090739881 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214090739881 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214090739881 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214090739881 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214090739881 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214090739881 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214090739893 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/gprs:trx-umtrx+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214090739902 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214090739902 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214090739902 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:07:42.966301 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31640): Terminating (SIGTERM) 09:07:43.006583 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31643): Terminating (SIGTERM) 09:07:43.046652 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31646): Terminating (SIGTERM) 09:07:43.086847 --- ParallelTerminationStrategy: PID 31640 died... 09:07:43.106455 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31640): Terminated: ok {rc=0} 09:07:43.150803 --- ParallelTerminationStrategy: PID 31643 died... 09:07:43.169723 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31643): Terminated: ok {rc=0} 09:07:43.213880 --- ParallelTerminationStrategy: PID 31646 died... 09:07:43.232983 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31646): Terminated: ok {rc=0} 09:07:43.319153 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2402 gprs:trx-umtrx+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 09:07:44.407844 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:07:44.419703 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 09:07:44.494016 tst ping_idle_ping.py: using LAC 39870 09:07:44.621817 tst ping_idle_ping.py: using RAC 90 09:07:44.746578 tst ping_idle_ping.py: using CellId 39870 09:07:44.872775 tst ping_idle_ping.py: using BVCI 39871 09:07:44.989658 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:07:45.001319 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:07:45.012692 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:07:45.023952 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:07:45.035189 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:07:45.046463 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:07:45.057782 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:07:45.068939 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:07:45.185782 tst ping_idle_ping.py:24: start network... 09:07:45.384259 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:07:45.861362 run create_hlr_db(pid=31648): Launched 09:07:46.043016 bus /gobi_6: Setting Powered False 09:07:47.105967 run create_hlr_db(pid=31648): Terminated: ok {rc=0} 09:07:47.555046 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31650): Launched 09:07:47.874729 run osmo-hlr_10.42.42.2(pid=31651): Launched 09:07:47.997424 run osmo-stp_10.42.42.5: Starting osmo-stp 09:07:48.544649 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31653): Launched 09:07:48.865516 run osmo-stp_10.42.42.5(pid=31654): Launched 09:07:48.986735 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:07:49.537794 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31656): Launched 09:07:49.661352 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:07:49.930929 run patchelf(pid=31657): Launched 09:07:50.107279 run osmo-stp_10.42.42.5(pid=31654): ERR: Terminated: ERROR {rc=1} [trial-2402↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31654)] 09:07:50.242079 run osmo-stp_10.42.42.5(pid=31654): stdout: | (launched: 2022-12-14_09:07:48.806479) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:07:50.378687 run osmo-stp_10.42.42.5(pid=31654): stderr: | 20221214090748997 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214090748997 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214090748998 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214090748998 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214090748999 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214090748999 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214090748999 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:07:50.515510 run osmo-stp_10.42.42.5(pid=31654): stdout: | (launched: 2022-12-14_09:07:48.806479) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:07:50.647007 run osmo-stp_10.42.42.5(pid=31654): stderr: | 20221214090748997 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214090748997 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214090748998 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214090748998 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214090748999 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214090748999 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214090748999 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:07:50.801378 run patchelf(pid=31657): Terminating (SIGINT) 09:07:50.979616 run patchelf(pid=31657): Terminated: ok {rc=0} 09:07:51.108017 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=31654): Process ended prematurely: osmo-stp_10.42.42.5(pid=31654) [trial-2402↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31654)] [trial-2402↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 09:07:51.117864 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 09:07:51.146078 run osmo-hlr_10.42.42.2(pid=31651): ERR: Terminated: ERROR {rc=237} [trial-2402↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31651)] 09:07:51.196778 run osmo-hlr_10.42.42.2(pid=31651): stdout: | (launched: 2022-12-14_09:07:47.816331) 09:07:51.249326 run osmo-hlr_10.42.42.2(pid=31651): stderr: | 20221214090748013 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214090748014 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214090748014 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214090748014 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214090748014 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214090748014 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214090748025 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/gprs:trx-umtrx+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214090748033 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214090748033 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214090748033 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:07:51.302441 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31650): Terminating (SIGTERM) 09:07:51.344730 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31653): Terminating (SIGTERM) 09:07:51.386835 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31656): Terminating (SIGTERM) 09:07:51.429109 --- ParallelTerminationStrategy: PID 31650 died... 09:07:51.449268 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31650): Terminated: ok {rc=0} 09:07:51.496078 --- ParallelTerminationStrategy: PID 31653 died... 09:07:51.515922 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31653): Terminated: ok {rc=0} 09:07:51.562456 --- ParallelTerminationStrategy: PID 31656 died... 09:07:51.582271 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31656): Terminated: ok {rc=0} 09:07:51.670589 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2402 gprs:trx-umtrx+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 gprs:trx-umtrx+mod-bts0-dynts-osmo --------------------------------------------------------------------- 09:07:52.968179 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:07:52.974826 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 09:07:53.006807 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 09:07:53.046169 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 09:07:53.132743 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 09:07:53.164889 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 09:07:53.203310 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 09:07:53.797488 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2402 gprs:trx-umtrx+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 09:07:53.846640 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:07:53.857897 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 09:07:53.926739 tst cs_paging_gprs_active.py: using LAC 39871 09:07:54.047588 tst cs_paging_gprs_active.py: using RAC 91 09:07:54.168024 tst cs_paging_gprs_active.py: using CellId 39871 09:07:54.289147 tst cs_paging_gprs_active.py: using BVCI 39872 09:07:54.400572 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:07:54.411638 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:07:54.422512 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:07:54.433444 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:07:54.444467 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:07:54.455739 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:07:54.467181 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:07:54.478556 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:07:54.490030 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 09:07:54.614042 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 09:07:54.739264 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 09:07:54.958226 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:07:55.284500 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31661): Launched 09:07:55.569639 run iperf3-srv_10.42.42.10(pid=31662): Launched 09:07:55.691086 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 09:07:55.909148 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:07:56.235151 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31663): Launched 09:07:56.519329 run iperf3-srv_10.42.42.10(pid=31664): Launched 09:07:56.643141 tst cs_paging_gprs_active.py:38: start network... 09:07:56.861424 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:07:57.366728 run create_hlr_db(pid=31665): Launched 09:07:57.499636 bus /gobi_6: Setting Powered False 09:07:58.563531 run create_hlr_db(pid=31665): Terminated: ok {rc=0} 09:07:58.997492 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31667): Launched 09:07:59.300682 run osmo-hlr_10.42.42.2(pid=31668): Launched 09:07:59.416871 run osmo-stp_10.42.42.5: Starting osmo-stp 09:07:59.938401 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31670): Launched 09:08:00.240549 run osmo-stp_10.42.42.5(pid=31671): Launched 09:08:00.356576 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:08:00.921644 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31673): Launched 09:08:01.063799 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:08:01.345426 run patchelf(pid=31674): Launched 09:08:01.542174 run osmo-stp_10.42.42.5(pid=31671): ERR: Terminated: ERROR {rc=1} [trial-2402↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31671)] 09:08:01.683655 run osmo-stp_10.42.42.5(pid=31671): stdout: | (launched: 2022-12-14_09:08:00.184506) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:08:01.825493 run osmo-stp_10.42.42.5(pid=31671): stderr: | 20221214090800352 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214090800352 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214090800353 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214090800353 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214090800354 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214090800354 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214090800354 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:08:01.966995 run osmo-stp_10.42.42.5(pid=31671): stdout: | (launched: 2022-12-14_09:08:00.184506) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:08:02.103213 run osmo-stp_10.42.42.5(pid=31671): stderr: | 20221214090800352 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214090800352 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214090800353 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214090800353 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214090800354 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214090800354 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214090800354 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:08:02.262933 run patchelf(pid=31674): Terminating (SIGINT) 09:08:02.443736 run patchelf(pid=31674): Terminated: ok {rc=0} 09:08:02.573944 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=31671): Process ended prematurely: osmo-stp_10.42.42.5(pid=31671) [trial-2402↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31671)] [trial-2402↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 09:08:02.584509 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 09:08:02.613125 run osmo-hlr_10.42.42.2(pid=31668): ERR: Terminated: ERROR {rc=237} [trial-2402↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31668)] 09:08:02.663769 run osmo-hlr_10.42.42.2(pid=31668): stdout: | (launched: 2022-12-14_09:07:59.244729) 09:08:02.715498 run osmo-hlr_10.42.42.2(pid=31668): stderr: | 20221214090759420 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214090759420 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214090759420 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214090759420 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214090759420 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214090759420 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214090759432 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/gprs:trx-umtrx+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214090759442 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214090759442 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214090759442 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:08:02.767622 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31661): Terminating (SIGTERM) 09:08:02.809420 run iperf3-srv_10.42.42.10(pid=31662): Terminating (SIGTERM) 09:08:02.850923 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31663): Terminating (SIGTERM) 09:08:02.892772 run iperf3-srv_10.42.42.10(pid=31664): Terminating (SIGTERM) 09:08:02.934169 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31667): Terminating (SIGTERM) 09:08:02.975518 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31670): Terminating (SIGTERM) 09:08:03.017088 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31673): Terminating (SIGTERM) 09:08:03.058742 --- ParallelTerminationStrategy: PID 31661 died... 09:08:03.078658 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31661): Terminated: ok {rc=0} 09:08:03.124527 --- ParallelTerminationStrategy: PID 31662 died... 09:08:03.143999 run iperf3-srv_10.42.42.10(pid=31662): Terminated {rc=256} 09:08:03.189777 --- ParallelTerminationStrategy: PID 31663 died... 09:08:03.209146 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31663): Terminated: ok {rc=0} 09:08:03.254969 --- ParallelTerminationStrategy: PID 31664 died... 09:08:03.274297 run iperf3-srv_10.42.42.10(pid=31664): Terminated {rc=256} 09:08:03.320424 --- ParallelTerminationStrategy: PID 31667 died... 09:08:03.340091 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31667): Terminated: ok {rc=0} 09:08:03.386171 --- ParallelTerminationStrategy: PID 31670 died... 09:08:03.405730 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31670): Terminated: ok {rc=0} 09:08:03.451674 --- ParallelTerminationStrategy: PID 31673 died... 09:08:03.471194 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31673): Terminated: ok {rc=0} 09:08:03.558959 bus /gobi_0: Setting Powered False 09:08:04.657515 bus /gobi_0: Setting Powered False 09:08:05.773063 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2402 gprs:trx-umtrx+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 09:08:06.921286 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:08:06.933282 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 09:08:07.005158 tst iperf3.py: using LAC 39872 09:08:07.132864 tst iperf3.py: using RAC 92 09:08:07.260138 tst iperf3.py: using CellId 39872 09:08:07.387452 tst iperf3.py: using BVCI 39873 09:08:07.504765 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:08:07.516316 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:08:07.527613 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:08:07.538896 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:08:07.550087 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:08:07.561514 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:08:07.572869 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:08:07.584200 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:08:07.595646 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 09:08:07.715782 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 09:08:07.932469 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:08:08.255354 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31675): Launched 09:08:08.538392 run iperf3-srv_10.42.42.10(pid=31676): Launched 09:08:08.661002 tst iperf3.py:8: start network... 09:08:08.878529 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:08:09.382316 run create_hlr_db(pid=31677): Launched 09:08:09.513330 bus /gobi_6: Setting Powered False 09:08:10.577209 run create_hlr_db(pid=31677): Terminated: ok {rc=0} 09:08:11.009985 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31679): Launched 09:08:11.312640 run osmo-hlr_10.42.42.2(pid=31680): Launched 09:08:11.428229 run osmo-stp_10.42.42.5: Starting osmo-stp 09:08:11.963267 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31682): Launched 09:08:12.266531 run osmo-stp_10.42.42.5(pid=31683): Launched 09:08:12.383105 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:08:12.907188 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31685): Launched 09:08:13.024850 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:08:13.281511 run patchelf(pid=31686): Launched 09:08:13.449668 run osmo-stp_10.42.42.5(pid=31683): ERR: Terminated: ERROR {rc=1} [trial-2402↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31683)] 09:08:13.577957 run osmo-stp_10.42.42.5(pid=31683): stdout: | (launched: 2022-12-14_09:08:12.210118) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:08:13.707831 run osmo-stp_10.42.42.5(pid=31683): stderr: | 20221214090812379 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214090812380 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214090812380 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214090812380 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214090812381 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214090812381 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214090812381 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:08:13.837772 run osmo-stp_10.42.42.5(pid=31683): stdout: | (launched: 2022-12-14_09:08:12.210118) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:08:13.961945 run osmo-stp_10.42.42.5(pid=31683): stderr: | 20221214090812379 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214090812380 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214090812380 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214090812380 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214090812381 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214090812381 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214090812381 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:08:14.109072 run patchelf(pid=31686): Terminating (SIGINT) 09:08:14.278590 run patchelf(pid=31686): Terminated: ok {rc=0} 09:08:14.400826 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31683): Process ended prematurely: osmo-stp_10.42.42.5(pid=31683) [trial-2402↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31683)] [trial-2402↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8] 09:08:14.410564 tst iperf3.py:8: Test FAILED (7.5 sec) 09:08:14.437809 run osmo-hlr_10.42.42.2(pid=31680): ERR: Terminated: ERROR {rc=237} [trial-2402↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31680)] 09:08:14.486389 run osmo-hlr_10.42.42.2(pid=31680): stdout: | (launched: 2022-12-14_09:08:11.256460) 09:08:14.536526 run osmo-hlr_10.42.42.2(pid=31680): stderr: | 20221214090811432 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214090811432 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214090811432 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214090811432 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214090811433 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214090811433 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214090811444 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/gprs:trx-umtrx+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214090811453 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214090811453 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214090811454 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:08:14.586912 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31675): Terminating (SIGTERM) 09:08:14.627231 run iperf3-srv_10.42.42.10(pid=31676): Terminating (SIGTERM) 09:08:14.667428 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31679): Terminating (SIGTERM) 09:08:14.707806 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31682): Terminating (SIGTERM) 09:08:14.748286 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31685): Terminating (SIGTERM) 09:08:14.788858 --- ParallelTerminationStrategy: PID 31675 died... 09:08:14.808590 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31675): Terminated: ok {rc=0} 09:08:14.853213 --- ParallelTerminationStrategy: PID 31676 died... 09:08:14.872113 run iperf3-srv_10.42.42.10(pid=31676): Terminated {rc=256} 09:08:14.916215 --- ParallelTerminationStrategy: PID 31679 died... 09:08:14.935284 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31679): Terminated: ok {rc=0} 09:08:14.979473 --- ParallelTerminationStrategy: PID 31682 died... 09:08:14.998646 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31682): Terminated: ok {rc=0} 09:08:15.042656 --- ParallelTerminationStrategy: PID 31685 died... 09:08:15.061695 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31685): Terminated: ok {rc=0} 09:08:15.148166 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2402 gprs:trx-umtrx+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 09:08:16.303329 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:08:16.316061 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 09:08:16.389909 tst iperf3m4.py: using LAC 39873 09:08:16.515432 tst iperf3m4.py: using RAC 93 09:08:16.679873 tst iperf3m4.py: using CellId 39873 09:08:16.809641 tst iperf3m4.py: using BVCI 39874 09:08:16.955232 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:08:16.970919 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:08:16.986214 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:08:17.002956 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:08:17.019007 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:08:17.035428 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:08:17.049989 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:08:17.066126 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:08:17.082721 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 09:08:17.229735 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 09:08:17.351479 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 09:08:17.471373 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 09:08:17.590417 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 09:08:17.793438 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:08:18.097203 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31687): Launched 09:08:18.360204 run iperf3-srv_10.42.42.10(pid=31688): Launched 09:08:18.473929 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 09:08:18.676022 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:08:18.980646 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31689): Launched 09:08:19.244709 run iperf3-srv_10.42.42.10(pid=31690): Launched 09:08:19.368217 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 09:08:19.585811 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:08:19.910703 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31691): Launched 09:08:20.193474 run iperf3-srv_10.42.42.10(pid=31692): Launched 09:08:20.315224 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 09:08:20.533445 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:08:20.859180 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31693): Launched 09:08:21.142515 run iperf3-srv_10.42.42.10(pid=31694): Launched 09:08:21.264194 tst iperf3m4.py:8: start network... 09:08:21.482292 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:08:21.987402 run create_hlr_db(pid=31695): Launched 09:08:22.120023 bus /gobi_6: Setting Powered False 09:08:23.183165 run create_hlr_db(pid=31695): Terminated: ok {rc=0} 09:08:23.633691 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31697): Launched 09:08:23.958549 run osmo-hlr_10.42.42.2(pid=31698): Launched 09:08:24.083756 run osmo-stp_10.42.42.5: Starting osmo-stp 09:08:24.642860 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31700): Launched 09:08:24.968814 run osmo-stp_10.42.42.5(pid=31701): Launched 09:08:25.093420 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:08:25.653498 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31703): Launched 09:08:25.777970 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:08:26.051607 run patchelf(pid=31704): Launched 09:08:26.232055 run osmo-stp_10.42.42.5(pid=31701): ERR: Terminated: ERROR {rc=1} [trial-2402↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31701)] 09:08:26.369257 run osmo-stp_10.42.42.5(pid=31701): stdout: | (launched: 2022-12-14_09:08:24.908774) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:08:26.507098 run osmo-stp_10.42.42.5(pid=31701): stderr: | 20221214090825099 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214090825099 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214090825099 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214090825100 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214090825100 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214090825100 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214090825100 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:08:26.645213 run osmo-stp_10.42.42.5(pid=31701): stdout: | (launched: 2022-12-14_09:08:24.908774) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:08:26.777416 run osmo-stp_10.42.42.5(pid=31701): stderr: | 20221214090825099 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214090825099 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214090825099 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214090825100 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214090825100 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214090825100 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214090825100 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:08:26.934612 run patchelf(pid=31704): Terminating (SIGINT) 09:08:27.114379 run patchelf(pid=31704): Terminated: ok {rc=0} 09:08:27.243822 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31701): Process ended prematurely: osmo-stp_10.42.42.5(pid=31701) [trial-2402↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31701)] [trial-2402↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8] 09:08:27.254227 tst iperf3m4.py:8: Test FAILED (11.0 sec) 09:08:27.282905 run osmo-hlr_10.42.42.2(pid=31698): ERR: Terminated: ERROR {rc=237} [trial-2402↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31698)] 09:08:27.333473 run osmo-hlr_10.42.42.2(pid=31698): stdout: | (launched: 2022-12-14_09:08:23.898322) 09:08:27.385305 run osmo-hlr_10.42.42.2(pid=31698): stderr: | 20221214090824094 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214090824094 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214090824094 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214090824094 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214090824094 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214090824094 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214090824107 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/gprs:trx-umtrx+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214090824117 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214090824118 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214090824118 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:08:27.437661 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31687): Terminating (SIGTERM) 09:08:27.479427 run iperf3-srv_10.42.42.10(pid=31688): Terminating (SIGTERM) 09:08:27.522392 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31689): Terminating (SIGTERM) 09:08:27.565380 run iperf3-srv_10.42.42.10(pid=31690): Terminating (SIGTERM) 09:08:27.607075 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31691): Terminating (SIGTERM) 09:08:27.651860 run iperf3-srv_10.42.42.10(pid=31692): Terminating (SIGTERM) 09:08:27.694095 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31693): Terminating (SIGTERM) 09:08:27.736030 run iperf3-srv_10.42.42.10(pid=31694): Terminating (SIGTERM) 09:08:27.777215 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31697): Terminating (SIGTERM) 09:08:27.818736 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31700): Terminating (SIGTERM) 09:08:27.860040 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31703): Terminating (SIGTERM) 09:08:27.901762 --- ParallelTerminationStrategy: PID 31687 died... 09:08:27.921589 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31687): Terminated: ok {rc=0} 09:08:27.967365 --- ParallelTerminationStrategy: PID 31688 died... 09:08:27.986717 run iperf3-srv_10.42.42.10(pid=31688): Terminated {rc=256} 09:08:28.032272 --- ParallelTerminationStrategy: PID 31689 died... 09:08:28.051707 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31689): Terminated: ok {rc=0} 09:08:28.097255 --- ParallelTerminationStrategy: PID 31690 died... 09:08:28.116406 run iperf3-srv_10.42.42.10(pid=31690): Terminated {rc=256} 09:08:28.162220 --- ParallelTerminationStrategy: PID 31691 died... 09:08:28.181682 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31691): Terminated: ok {rc=0} 09:08:28.227301 --- ParallelTerminationStrategy: PID 31692 died... 09:08:28.246662 run iperf3-srv_10.42.42.10(pid=31692): Terminated {rc=256} 09:08:28.292445 --- ParallelTerminationStrategy: PID 31693 died... 09:08:28.312207 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31693): Terminated: ok {rc=0} 09:08:28.357937 --- ParallelTerminationStrategy: PID 31694 died... 09:08:28.377347 run iperf3-srv_10.42.42.10(pid=31694): Terminated {rc=256} 09:08:28.422703 --- ParallelTerminationStrategy: PID 31697 died... 09:08:28.442159 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31697): Terminated: ok {rc=0} 09:08:28.487584 --- ParallelTerminationStrategy: PID 31700 died... 09:08:28.506929 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31700): Terminated: ok {rc=0} 09:08:28.552468 --- ParallelTerminationStrategy: PID 31703 died... 09:08:28.572059 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31703): Terminated: ok {rc=0} 09:08:28.658642 bus /gobi_4: Setting Powered False 09:08:29.757519 bus /gobi_4: Setting Powered False 09:08:30.877666 bus /gobi_1: Setting Powered False 09:08:32.000882 bus /gobi_1: Setting Powered False 09:08:33.130365 bus /gobi_0: Setting Powered False 09:08:34.229065 bus /gobi_0: Setting Powered False 09:08:35.347678 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2402 gprs:trx-umtrx+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 09:08:36.450145 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:08:36.461993 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 09:08:36.533776 tst ping.py: using LAC 39874 09:08:36.649759 tst ping.py: using RAC 94 09:08:36.771159 tst ping.py: using CellId 39874 09:08:36.888762 tst ping.py: using BVCI 39875 09:08:36.996645 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:08:37.007642 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:08:37.018477 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:08:37.029274 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:08:37.040414 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:08:37.051560 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:08:37.062688 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:08:37.073778 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 09:08:37.194146 tst ping.py:19: start network... 09:08:37.407675 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:08:37.902800 run create_hlr_db(pid=31706): Launched 09:08:38.031513 bus /gobi_6: Setting Powered False 09:08:39.094163 run create_hlr_db(pid=31706): Terminated: ok {rc=0} 09:08:39.519578 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31708): Launched 09:08:39.817780 run osmo-hlr_10.42.42.2(pid=31709): Launched 09:08:39.931652 run osmo-stp_10.42.42.5: Starting osmo-stp 09:08:40.459507 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31711): Launched 09:08:40.755126 run osmo-stp_10.42.42.5(pid=31712): Launched 09:08:40.869396 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:08:41.380796 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31714): Launched 09:08:41.494707 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:08:41.746147 run patchelf(pid=31715): Launched 09:08:41.911156 run osmo-stp_10.42.42.5(pid=31712): ERR: Terminated: ERROR {rc=1} [trial-2402↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31712)] 09:08:42.037351 run osmo-stp_10.42.42.5(pid=31712): stdout: | (launched: 2022-12-14_09:08:40.699947) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:08:42.164853 run osmo-stp_10.42.42.5(pid=31712): stderr: | 20221214090840869 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214090840869 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214090840869 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214090840870 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214090840870 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214090840870 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214090840870 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:08:42.292905 run osmo-stp_10.42.42.5(pid=31712): stdout: | (launched: 2022-12-14_09:08:40.699947) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:08:42.415605 run osmo-stp_10.42.42.5(pid=31712): stderr: | 20221214090840869 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214090840869 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214090840869 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214090840870 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214090840870 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214090840870 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214090840870 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:08:42.560155 run patchelf(pid=31715): Terminating (SIGINT) 09:08:42.726745 run patchelf(pid=31715): Terminated: ok {rc=0} 09:08:42.846462 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=31712): Process ended prematurely: osmo-stp_10.42.42.5(pid=31712) [trial-2402↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31712)] [trial-2402↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22] 09:08:42.855409 tst ping.py:22: Test FAILED (6.4 sec) 09:08:42.882290 run osmo-hlr_10.42.42.2(pid=31709): ERR: Terminated: ERROR {rc=237} [trial-2402↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31709)] 09:08:42.930536 run osmo-hlr_10.42.42.2(pid=31709): stdout: | (launched: 2022-12-14_09:08:39.762567) 09:08:42.980301 run osmo-hlr_10.42.42.2(pid=31709): stderr: | 20221214090839938 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214090839938 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214090839938 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214090839938 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214090839938 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214090839938 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214090839951 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/gprs:trx-umtrx+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214090839962 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214090839962 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214090839962 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:08:43.030510 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31708): Terminating (SIGTERM) 09:08:43.070839 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31711): Terminating (SIGTERM) 09:08:43.111132 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31714): Terminating (SIGTERM) 09:08:43.152007 --- ParallelTerminationStrategy: PID 31708 died... 09:08:43.171643 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31708): Terminated: ok {rc=0} 09:08:43.216104 --- ParallelTerminationStrategy: PID 31711 died... 09:08:43.235039 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31711): Terminated: ok {rc=0} 09:08:43.279183 --- ParallelTerminationStrategy: PID 31714 died... 09:08:43.298292 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31714): Terminated: ok {rc=0} 09:08:43.384467 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2402 gprs:trx-umtrx+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 09:08:44.472709 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:08:44.484558 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 09:08:44.558232 tst ping_idle_ping.py: using LAC 39875 09:08:44.677197 tst ping_idle_ping.py: using RAC 95 09:08:44.794307 tst ping_idle_ping.py: using CellId 39875 09:08:44.913597 tst ping_idle_ping.py: using BVCI 39876 09:08:45.023181 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:08:45.034370 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:08:45.045291 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:08:45.056084 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:08:45.068081 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:08:45.081897 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:08:45.093591 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:08:45.105171 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 09:08:45.220356 tst ping_idle_ping.py:24: start network... 09:08:45.419216 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:08:45.885693 run create_hlr_db(pid=31716): Launched 09:08:46.051400 bus /gobi_6: Setting Powered False 09:08:47.124931 run create_hlr_db(pid=31716): Terminated: ok {rc=0} 09:08:47.607857 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31718): Launched 09:08:47.906283 run osmo-hlr_10.42.42.2(pid=31719): Launched 09:08:48.021340 run osmo-stp_10.42.42.5: Starting osmo-stp 09:08:48.535114 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31721): Launched 09:08:48.834839 run osmo-stp_10.42.42.5(pid=31722): Launched 09:08:48.950925 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:08:49.464743 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31724): Launched 09:08:49.578640 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:08:49.830411 run patchelf(pid=31725): Launched 09:08:49.997094 run osmo-stp_10.42.42.5(pid=31722): ERR: Terminated: ERROR {rc=1} [trial-2402↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31722)] 09:08:50.123790 run osmo-stp_10.42.42.5(pid=31722): stdout: | (launched: 2022-12-14_09:08:48.779101) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:08:50.252043 run osmo-stp_10.42.42.5(pid=31722): stderr: | 20221214090848948 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214090848948 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214090848948 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214090848949 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214090848949 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214090848950 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214090848950 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:08:50.380217 run osmo-stp_10.42.42.5(pid=31722): stdout: | (launched: 2022-12-14_09:08:48.779101) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:08:50.502741 run osmo-stp_10.42.42.5(pid=31722): stderr: | 20221214090848948 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214090848948 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214090848948 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214090848949 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214090848949 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214090848950 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214090848950 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:08:50.647724 run patchelf(pid=31725): Terminating (SIGINT) 09:08:50.814538 run patchelf(pid=31725): Terminated: ok {rc=0} 09:08:50.934654 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=31722): Process ended prematurely: osmo-stp_10.42.42.5(pid=31722) [trial-2402↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31722)] [trial-2402↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 09:08:50.943612 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 09:08:50.970351 run osmo-hlr_10.42.42.2(pid=31719): ERR: Terminated: ERROR {rc=237} [trial-2402↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31719)] 09:08:51.018408 run osmo-hlr_10.42.42.2(pid=31719): stdout: | (launched: 2022-12-14_09:08:47.850705) 09:08:51.067559 run osmo-hlr_10.42.42.2(pid=31719): stderr: | 20221214090848024 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214090848025 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214090848025 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214090848025 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214090848025 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214090848025 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214090848036 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/gprs:trx-umtrx+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214090848045 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214090848045 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214090848045 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:08:51.118024 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31718): Terminating (SIGTERM) 09:08:51.158006 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31721): Terminating (SIGTERM) 09:08:51.197864 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31724): Terminating (SIGTERM) 09:08:51.237948 --- ParallelTerminationStrategy: PID 31718 died... 09:08:51.257279 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31718): Terminated: ok {rc=0} 09:08:51.301102 --- ParallelTerminationStrategy: PID 31721 died... 09:08:51.319831 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31721): Terminated: ok {rc=0} 09:08:51.363974 --- ParallelTerminationStrategy: PID 31724 died... 09:08:51.383020 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31724): Terminated: ok {rc=0} 09:08:51.470223 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2402 gprs:trx-umtrx+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 09:08:52.779924 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:08:52.787507 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 09:08:52.821666 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 9 x ip_address (candidates: 9) 09:08:52.861704 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 4 x modem (candidates: 12) 09:08:52.951344 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 09:08:52.984480 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 9 x ip_address (candidates: 9) 09:08:53.023699 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 4 x modem (candidates: 12) 09:08:53.634305 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2402 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend cs_paging_gprs_active.py ---------------------------------------------- 09:08:53.686137 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:08:53.698042 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 09:08:53.749338 tst cs_paging_gprs_active.py: using LAC 39876 09:08:53.875058 tst cs_paging_gprs_active.py: using RAC 96 09:08:54.000801 tst cs_paging_gprs_active.py: using CellId 39876 09:08:54.129069 tst cs_paging_gprs_active.py: using BVCI 39877 09:08:54.246735 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:08:54.258577 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:08:54.270182 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:08:54.281738 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:08:54.293281 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:08:54.304776 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:08:54.316889 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:08:54.328402 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:08:54.340243 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 09:08:54.459239 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 09:08:54.580237 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 09:08:54.798703 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:08:55.123983 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31729): Launched 09:08:55.406757 run iperf3-srv_10.42.42.10(pid=31730): Launched 09:08:55.529713 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 09:08:55.747972 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:08:56.073487 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31731): Launched 09:08:56.355950 run iperf3-srv_10.42.42.10(pid=31732): Launched 09:08:56.479150 tst cs_paging_gprs_active.py:38: start network... 09:08:56.697848 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:08:57.204856 run create_hlr_db(pid=31733): Launched 09:08:57.336369 bus /gobi_6: Setting Powered False 09:08:58.400774 run create_hlr_db(pid=31733): Terminated: ok {rc=0} 09:08:58.835476 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31735): Launched 09:08:59.141939 run osmo-hlr_10.42.42.2(pid=31736): Launched 09:08:59.259450 run osmo-stp_10.42.42.5: Starting osmo-stp 09:08:59.796620 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31738): Launched 09:09:00.101615 run osmo-stp_10.42.42.5(pid=31739): Launched 09:09:00.217796 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:09:00.742892 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31741): Launched 09:09:00.859532 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:09:01.127322 run patchelf(pid=31742): Launched 09:09:01.312866 run osmo-stp_10.42.42.5(pid=31739): ERR: Terminated: ERROR {rc=1} [trial-2402↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31739)] 09:09:01.444239 run osmo-stp_10.42.42.5(pid=31739): stdout: | (launched: 2022-12-14_09:09:00.045209) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:09:01.581368 run osmo-stp_10.42.42.5(pid=31739): stderr: | 20221214090900214 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214090900215 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214090900215 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214090900215 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214090900216 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214090900216 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214090900216 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:09:01.728435 run osmo-stp_10.42.42.5(pid=31739): stdout: | (launched: 2022-12-14_09:09:00.045209) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:09:01.889523 run osmo-stp_10.42.42.5(pid=31739): stderr: | 20221214090900214 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214090900215 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214090900215 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214090900215 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214090900216 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214090900216 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214090900216 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:09:02.044034 run patchelf(pid=31742): Terminating (SIGINT) 09:09:02.217458 run patchelf(pid=31742): Terminated: ok {rc=0} 09:09:02.350772 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=31739): Process ended prematurely: osmo-stp_10.42.42.5(pid=31739) [trial-2402↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31739)] [trial-2402↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38] 09:09:02.368099 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 09:09:02.406052 run osmo-hlr_10.42.42.2(pid=31736): ERR: Terminated: ERROR {rc=237} [trial-2402↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31736)] 09:09:02.469720 run osmo-hlr_10.42.42.2(pid=31736): stdout: | (launched: 2022-12-14_09:08:59.084727) 09:09:02.532826 run osmo-hlr_10.42.42.2(pid=31736): stderr: | 20221214090859261 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214090859261 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214090859262 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214090859262 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214090859262 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214090859262 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214090859277 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214090859285 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214090859285 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214090859285 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:09:02.593635 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31729): Terminating (SIGTERM) 09:09:02.643423 run iperf3-srv_10.42.42.10(pid=31730): Terminating (SIGTERM) 09:09:02.693442 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31731): Terminating (SIGTERM) 09:09:02.742466 run iperf3-srv_10.42.42.10(pid=31732): Terminating (SIGTERM) 09:09:02.794775 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31735): Terminating (SIGTERM) 09:09:02.842783 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31738): Terminating (SIGTERM) 09:09:02.887844 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31741): Terminating (SIGTERM) 09:09:02.938681 --- ParallelTerminationStrategy: PID 31729 died... 09:09:02.963753 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31729): Terminated: ok {rc=0} 09:09:03.013516 --- ParallelTerminationStrategy: PID 31730 died... 09:09:03.035778 run iperf3-srv_10.42.42.10(pid=31730): Terminated {rc=256} 09:09:03.092305 --- ParallelTerminationStrategy: PID 31731 died... 09:09:03.113022 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31731): Terminated: ok {rc=0} 09:09:03.165499 --- ParallelTerminationStrategy: PID 31732 died... 09:09:03.191081 run iperf3-srv_10.42.42.10(pid=31732): Terminated {rc=256} 09:09:03.247214 --- ParallelTerminationStrategy: PID 31735 died... 09:09:03.271332 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31735): Terminated: ok {rc=0} 09:09:03.332221 --- ParallelTerminationStrategy: PID 31738 died... 09:09:03.360628 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31738): Terminated: ok {rc=0} 09:09:03.417240 --- ParallelTerminationStrategy: PID 31741 died... 09:09:03.441876 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31741): Terminated: ok {rc=0} 09:09:03.562355 bus /gobi_0: Setting Powered False 09:09:04.674812 bus /gobi_0: Setting Powered False 09:09:05.790553 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2402 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3.py ---------------------------------------------- 09:09:06.941634 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:09:06.954892 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 09:09:07.013733 tst iperf3.py: using LAC 39877 09:09:07.138634 tst iperf3.py: using RAC 97 09:09:07.263726 tst iperf3.py: using CellId 39877 09:09:07.385338 tst iperf3.py: using BVCI 39878 09:09:07.500873 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:09:07.514370 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:09:07.526777 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:09:07.539102 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:09:07.552479 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:09:07.566093 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:09:07.580453 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:09:07.593433 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:09:07.606724 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 09:09:07.731986 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 09:09:07.939871 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:09:08.252474 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32014): Launched 09:09:08.535946 run iperf3-srv_10.42.42.10(pid=32015): Launched 09:09:08.670978 tst iperf3.py:8: start network... 09:09:08.891524 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:09:09.407028 run create_hlr_db(pid=32016): Launched 09:09:09.569609 bus /gobi_6: Setting Powered False 09:09:10.636456 run create_hlr_db(pid=32016): Terminated: ok {rc=0} 09:09:11.101161 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32018): Launched 09:09:11.447152 run osmo-hlr_10.42.42.2(pid=32019): Launched 09:09:11.700089 run osmo-stp_10.42.42.5: Starting osmo-stp 09:09:12.375810 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32021): Launched 09:09:12.723561 run osmo-stp_10.42.42.5(pid=32022): Launched 09:09:12.971881 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:09:13.638599 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32024): Launched 09:09:13.776862 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:09:14.061879 run patchelf(pid=32025): Launched 09:09:14.260428 run osmo-stp_10.42.42.5(pid=32022): ERR: Terminated: ERROR {rc=1} [trial-2402↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32022)] 09:09:14.403225 run osmo-stp_10.42.42.5(pid=32022): stdout: | (launched: 2022-12-14_09:09:12.660938) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:09:14.548365 run osmo-stp_10.42.42.5(pid=32022): stderr: | 20221214090912953 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214090912953 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214090912954 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214090912954 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214090912955 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214090912955 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214090912955 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:09:14.694693 run osmo-stp_10.42.42.5(pid=32022): stdout: | (launched: 2022-12-14_09:09:12.660938) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:09:14.833355 run osmo-stp_10.42.42.5(pid=32022): stderr: | 20221214090912953 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214090912953 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214090912954 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214090912954 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214090912955 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214090912955 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214090912955 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:09:14.996094 run patchelf(pid=32025): Terminating (SIGINT) 09:09:15.184017 run patchelf(pid=32025): Terminated: ok {rc=0} 09:09:15.321159 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32022): Process ended prematurely: osmo-stp_10.42.42.5(pid=32022) [trial-2402↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32022)] [trial-2402↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8] 09:09:15.332800 tst iperf3.py:8: Test FAILED (8.4 sec) 09:09:15.363756 run osmo-hlr_10.42.42.2(pid=32019): ERR: Terminated: ERROR {rc=237} [trial-2402↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32019)] 09:09:15.417595 run osmo-hlr_10.42.42.2(pid=32019): stdout: | (launched: 2022-12-14_09:09:11.385101) 09:09:15.472376 run osmo-hlr_10.42.42.2(pid=32019): stderr: | 20221214090911694 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214090911694 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214090911694 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214090911694 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214090911694 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214090911694 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214090911707 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214090911724 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214090911724 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214090911724 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:09:15.527025 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32014): Terminating (SIGTERM) 09:09:15.570943 run iperf3-srv_10.42.42.10(pid=32015): Terminating (SIGTERM) 09:09:15.618110 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32018): Terminating (SIGTERM) 09:09:15.662384 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32021): Terminating (SIGTERM) 09:09:15.709916 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32024): Terminating (SIGTERM) 09:09:15.755486 --- ParallelTerminationStrategy: PID 32014 died... 09:09:15.776433 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32014): Terminated: ok {rc=0} 09:09:15.826685 --- ParallelTerminationStrategy: PID 32015 died... 09:09:15.854340 run iperf3-srv_10.42.42.10(pid=32015): Terminated {rc=256} 09:09:15.920136 --- ParallelTerminationStrategy: PID 32018 died... 09:09:15.946459 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32018): Terminated: ok {rc=0} 09:09:16.004414 --- ParallelTerminationStrategy: PID 32021 died... 09:09:16.025877 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32021): Terminated: ok {rc=0} 09:09:16.078012 --- ParallelTerminationStrategy: PID 32024 died... 09:09:16.099985 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32024): Terminated: ok {rc=0} 09:09:16.210423 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2402 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3m4.py ---------------------------------------------- 09:09:17.385841 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:09:17.399106 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 09:09:17.463753 tst iperf3m4.py: using LAC 39878 09:09:17.636171 tst iperf3m4.py: using RAC 98 09:09:17.765333 tst iperf3m4.py: using CellId 39878 09:09:17.891840 tst iperf3m4.py: using BVCI 39879 09:09:18.007040 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:09:18.020542 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:09:18.032897 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:09:18.045561 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:09:18.059294 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:09:18.072688 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:09:18.086052 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:09:18.099391 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:09:18.113181 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 09:09:18.239702 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 09:09:18.369580 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 09:09:18.494257 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 09:09:18.620108 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 09:09:18.846473 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:09:19.182314 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32026): Launched 09:09:19.482803 run iperf3-srv_10.42.42.10(pid=32027): Launched 09:09:19.621866 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 09:09:19.846515 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:09:20.182388 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32028): Launched 09:09:20.482185 run iperf3-srv_10.42.42.10(pid=32029): Launched 09:09:20.621408 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 09:09:20.846908 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:09:21.183114 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32030): Launched 09:09:21.483828 run iperf3-srv_10.42.42.10(pid=32031): Launched 09:09:21.623110 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 09:09:21.847492 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:09:22.182895 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32032): Launched 09:09:22.482817 run iperf3-srv_10.42.42.10(pid=32033): Launched 09:09:22.623211 tst iperf3m4.py:8: start network... 09:09:22.848641 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:09:23.366704 run create_hlr_db(pid=32034): Launched 09:09:23.533739 bus /gobi_6: Setting Powered False 09:09:24.599226 run create_hlr_db(pid=32034): Terminated: ok {rc=0} 09:09:25.051524 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32037): Launched 09:09:25.379549 run osmo-hlr_10.42.42.2(pid=32038): Launched 09:09:25.504068 run osmo-stp_10.42.42.5: Starting osmo-stp 09:09:26.070938 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32040): Launched 09:09:26.397500 run osmo-stp_10.42.42.5(pid=32041): Launched 09:09:26.521570 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:09:27.082533 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32043): Launched 09:09:27.206197 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:09:27.482595 run patchelf(pid=32044): Launched 09:09:27.673617 run osmo-stp_10.42.42.5(pid=32041): ERR: Terminated: ERROR {rc=1} [trial-2402↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32041)] 09:09:27.811032 run osmo-stp_10.42.42.5(pid=32041): stdout: | (launched: 2022-12-14_09:09:26.336817) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:09:27.949560 run osmo-stp_10.42.42.5(pid=32041): stderr: | 20221214090926527 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214090926528 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214090926528 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214090926528 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214090926529 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214090926529 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214090926529 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:09:28.088415 run osmo-stp_10.42.42.5(pid=32041): stdout: | (launched: 2022-12-14_09:09:26.336817) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:09:28.221209 run osmo-stp_10.42.42.5(pid=32041): stderr: | 20221214090926527 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214090926528 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214090926528 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214090926528 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214090926529 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214090926529 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214090926529 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:09:28.379082 run patchelf(pid=32044): Terminating (SIGINT) 09:09:28.559889 run patchelf(pid=32044): Terminated: ok {rc=0} 09:09:28.690541 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32041): Process ended prematurely: osmo-stp_10.42.42.5(pid=32041) [trial-2402↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32041)] [trial-2402↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8] 09:09:28.700796 tst iperf3m4.py:8: Test FAILED (11.4 sec) 09:09:28.729807 run osmo-hlr_10.42.42.2(pid=32038): ERR: Terminated: ERROR {rc=237} [trial-2402↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32038)] 09:09:28.780160 run osmo-hlr_10.42.42.2(pid=32038): stdout: | (launched: 2022-12-14_09:09:25.318512) 09:09:28.831983 run osmo-hlr_10.42.42.2(pid=32038): stderr: | 20221214090925518 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214090925518 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214090925518 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214090925519 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214090925519 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214090925519 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214090925531 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214090925539 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214090925539 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214090925540 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:09:28.884430 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32026): Terminating (SIGTERM) 09:09:28.926539 run iperf3-srv_10.42.42.10(pid=32027): Terminating (SIGTERM) 09:09:28.968259 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32028): Terminating (SIGTERM) 09:09:29.010694 run iperf3-srv_10.42.42.10(pid=32029): Terminating (SIGTERM) 09:09:29.052440 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32030): Terminating (SIGTERM) 09:09:29.094768 run iperf3-srv_10.42.42.10(pid=32031): Terminating (SIGTERM) 09:09:29.136335 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32032): Terminating (SIGTERM) 09:09:29.178190 run iperf3-srv_10.42.42.10(pid=32033): Terminating (SIGTERM) 09:09:29.219581 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32037): Terminating (SIGTERM) 09:09:29.261295 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32040): Terminating (SIGTERM) 09:09:29.302926 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32043): Terminating (SIGTERM) 09:09:29.345693 --- ParallelTerminationStrategy: PID 32026 died... 09:09:29.365753 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32026): Terminated: ok {rc=0} 09:09:29.412098 --- ParallelTerminationStrategy: PID 32027 died... 09:09:29.431571 run iperf3-srv_10.42.42.10(pid=32027): Terminated {rc=256} 09:09:29.477437 --- ParallelTerminationStrategy: PID 32028 died... 09:09:29.496926 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32028): Terminated: ok {rc=0} 09:09:29.542722 --- ParallelTerminationStrategy: PID 32029 died... 09:09:29.562113 run iperf3-srv_10.42.42.10(pid=32029): Terminated {rc=256} 09:09:29.607806 --- ParallelTerminationStrategy: PID 32030 died... 09:09:29.627345 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32030): Terminated: ok {rc=0} 09:09:29.673227 --- ParallelTerminationStrategy: PID 32031 died... 09:09:29.692588 run iperf3-srv_10.42.42.10(pid=32031): Terminated {rc=256} 09:09:29.738581 --- ParallelTerminationStrategy: PID 32032 died... 09:09:29.758153 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32032): Terminated: ok {rc=0} 09:09:29.803896 --- ParallelTerminationStrategy: PID 32033 died... 09:09:29.823349 run iperf3-srv_10.42.42.10(pid=32033): Terminated {rc=256} 09:09:29.869295 --- ParallelTerminationStrategy: PID 32037 died... 09:09:29.888992 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32037): Terminated: ok {rc=0} 09:09:29.934989 --- ParallelTerminationStrategy: PID 32040 died... 09:09:29.954633 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32040): Terminated: ok {rc=0} 09:09:30.000672 --- ParallelTerminationStrategy: PID 32043 died... 09:09:30.020352 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32043): Terminated: ok {rc=0} 09:09:30.108666 bus /gobi_4: Setting Powered False 09:09:31.214069 bus /gobi_4: Setting Powered False 09:09:32.340475 bus /gobi_1: Setting Powered False 09:09:33.438745 bus /gobi_1: Setting Powered False 09:09:34.556886 bus /gobi_0: Setting Powered False 09:09:35.655094 bus /gobi_0: Setting Powered False 09:09:36.769663 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2402 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping.py ---------------------------------------------- 09:09:37.871972 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:09:37.884055 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 09:09:37.941464 tst ping.py: using LAC 39879 09:09:38.057870 tst ping.py: using RAC 99 09:09:38.174097 tst ping.py: using CellId 39879 09:09:38.291484 tst ping.py: using BVCI 39880 09:09:38.399408 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:09:38.410900 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:09:38.422121 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:09:38.433237 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:09:38.445206 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:09:38.457204 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:09:38.469230 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:09:38.481213 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 09:09:38.598103 tst ping.py:19: start network... 09:09:38.795663 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:09:39.285205 run create_hlr_db(pid=32045): Launched 09:09:39.417460 bus /gobi_6: Setting Powered False 09:09:40.480583 run create_hlr_db(pid=32045): Terminated: ok {rc=0} 09:09:40.923430 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32047): Launched 09:09:41.242909 run osmo-hlr_10.42.42.2(pid=32048): Launched 09:09:41.365390 run osmo-stp_10.42.42.5: Starting osmo-stp 09:09:41.918284 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32050): Launched 09:09:42.238400 run osmo-stp_10.42.42.5(pid=32051): Launched 09:09:42.360410 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:09:42.917688 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32053): Launched 09:09:43.040453 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:09:43.311083 run patchelf(pid=32054): Launched 09:09:43.490396 run osmo-stp_10.42.42.5(pid=32051): ERR: Terminated: ERROR {rc=1} [trial-2402↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32051)] 09:09:43.625500 run osmo-stp_10.42.42.5(pid=32051): stdout: | (launched: 2022-12-14_09:09:42.179071) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:09:43.761869 run osmo-stp_10.42.42.5(pid=32051): stderr: | 20221214090942373 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214090942373 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214090942373 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214090942374 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214090942374 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214090942374 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214090942374 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:09:43.898567 run osmo-stp_10.42.42.5(pid=32051): stdout: | (launched: 2022-12-14_09:09:42.179071) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:09:44.029591 run osmo-stp_10.42.42.5(pid=32051): stderr: | 20221214090942373 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214090942373 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214090942373 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214090942374 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214090942374 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214090942374 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214090942374 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:09:44.184367 run patchelf(pid=32054): Terminating (SIGINT) 09:09:44.363093 run patchelf(pid=32054): Terminated: ok {rc=0} 09:09:44.491053 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=32051): Process ended prematurely: osmo-stp_10.42.42.5(pid=32051) [trial-2402↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32051)] [trial-2402↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22] 09:09:44.500875 tst ping.py:22: Test FAILED (6.6 sec) 09:09:44.529161 run osmo-hlr_10.42.42.2(pid=32048): ERR: Terminated: ERROR {rc=237} [trial-2402↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32048)] 09:09:44.579265 run osmo-hlr_10.42.42.2(pid=32048): stdout: | (launched: 2022-12-14_09:09:41.183784) 09:09:44.630758 run osmo-hlr_10.42.42.2(pid=32048): stderr: | 20221214090941381 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214090941381 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214090941381 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214090941381 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214090941381 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214090941381 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214090941393 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214090941401 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214090941401 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214090941401 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:09:44.682987 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32047): Terminating (SIGTERM) 09:09:44.724918 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32050): Terminating (SIGTERM) 09:09:44.766755 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32053): Terminating (SIGTERM) 09:09:44.808639 --- ParallelTerminationStrategy: PID 32047 died... 09:09:44.828707 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32047): Terminated: ok {rc=0} 09:09:44.874865 --- ParallelTerminationStrategy: PID 32050 died... 09:09:44.894557 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32050): Terminated: ok {rc=0} 09:09:44.940595 --- ParallelTerminationStrategy: PID 32053 died... 09:09:44.960428 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32053): Terminated: ok {rc=0} 09:09:45.049139 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2402 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping_idle_ping.py ---------------------------------------------- 09:09:46.137862 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:09:46.152567 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 09:09:46.213133 tst ping_idle_ping.py: using LAC 39880 09:09:46.338693 tst ping_idle_ping.py: using RAC 100 09:09:46.464460 tst ping_idle_ping.py: using CellId 39880 09:09:46.620279 tst ping_idle_ping.py: using BVCI 39881 09:09:46.734513 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:09:46.747077 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:09:46.759599 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:09:46.771966 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:09:46.785427 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:09:46.798829 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:09:46.814450 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:09:46.827998 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 09:09:46.946577 tst ping_idle_ping.py:24: start network... 09:09:47.151673 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:09:47.623689 run create_hlr_db(pid=32055): Launched 09:09:47.740159 bus /gobi_6: Setting Powered False 09:09:48.800377 run create_hlr_db(pid=32055): Terminated: ok {rc=0} 09:09:49.218063 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32057): Launched 09:09:49.517131 run osmo-hlr_10.42.42.2(pid=32058): Launched 09:09:49.630841 run osmo-stp_10.42.42.5: Starting osmo-stp 09:09:50.159119 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32060): Launched 09:09:50.459184 run osmo-stp_10.42.42.5(pid=32061): Launched 09:09:50.573261 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:09:51.089940 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32063): Launched 09:09:51.205627 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:09:51.458551 run patchelf(pid=32064): Launched 09:09:51.626796 run osmo-stp_10.42.42.5(pid=32061): ERR: Terminated: ERROR {rc=1} [trial-2402↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32061)] 09:09:51.753705 run osmo-stp_10.42.42.5(pid=32061): stdout: | (launched: 2022-12-14_09:09:50.403021) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:09:51.882382 run osmo-stp_10.42.42.5(pid=32061): stderr: | 20221214090950572 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214090950573 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214090950573 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214090950573 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214090950575 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214090950576 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214090950576 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:09:52.010860 run osmo-stp_10.42.42.5(pid=32061): stdout: | (launched: 2022-12-14_09:09:50.403021) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:09:52.134063 run osmo-stp_10.42.42.5(pid=32061): stderr: | 20221214090950572 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214090950573 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214090950573 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214090950573 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214090950575 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214090950576 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214090950576 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:09:52.279470 run patchelf(pid=32064): Terminating (SIGINT) 09:09:52.446413 run patchelf(pid=32064): Terminated: ok {rc=0} 09:09:52.566717 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=32061): Process ended prematurely: osmo-stp_10.42.42.5(pid=32061) [trial-2402↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32061)] [trial-2402↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27] 09:09:52.575765 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 09:09:52.602481 run osmo-hlr_10.42.42.2(pid=32058): ERR: Terminated: ERROR {rc=237} [trial-2402↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32058)] 09:09:52.650498 run osmo-hlr_10.42.42.2(pid=32058): stdout: | (launched: 2022-12-14_09:09:49.461012) 09:09:52.699966 run osmo-hlr_10.42.42.2(pid=32058): stderr: | 20221214090949639 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214090949639 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214090949639 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214090949639 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214090949639 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214090949639 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214090949651 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214090949660 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214090949660 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214090949660 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:09:52.749814 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32057): Terminating (SIGTERM) 09:09:52.789728 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32060): Terminating (SIGTERM) 09:09:52.829731 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32063): Terminating (SIGTERM) 09:09:52.869941 --- ParallelTerminationStrategy: PID 32057 died... 09:09:52.889404 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32057): Terminated: ok {rc=0} 09:09:52.933485 --- ParallelTerminationStrategy: PID 32060 died... 09:09:52.952268 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32060): Terminated: ok {rc=0} 09:09:52.996472 --- ParallelTerminationStrategy: PID 32063 died... 09:09:53.015486 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32063): Terminated: ok {rc=0} 09:09:53.102357 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2402 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 09:09:54.406991 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:09:54.413723 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 09:09:54.446117 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 09:09:54.482409 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 09:09:54.536121 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 09:09:54.568719 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 09:09:54.604339 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 09:09:55.171966 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2402 dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 09:09:55.178177 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 09:09:55.190086 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 09:09:55.261462 tst switch_tch_pdch.py: using LAC 39881 09:09:55.380472 tst switch_tch_pdch.py: using RAC 101 09:09:55.497360 tst switch_tch_pdch.py: using CellId 39881 09:09:55.614812 tst switch_tch_pdch.py: using BVCI 39882 09:09:55.731506 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 09:09:55.743352 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 09:09:55.755036 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 09:09:55.766732 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 09:09:55.778335 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 09:09:55.789968 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 09:09:55.801660 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 09:09:55.813375 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 09:09:55.929447 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 09:09:56.046833 tst switch_tch_pdch.py:51: start network... 09:09:56.245004 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:09:56.706770 run create_hlr_db(pid=32069): Launched 09:09:56.823681 bus /gobi_6: Setting Powered False 09:09:57.883601 run create_hlr_db(pid=32069): Terminated: ok {rc=0} 09:09:58.319329 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32071): Launched 09:09:58.639680 run osmo-hlr_10.42.42.2(pid=32072): Launched 09:09:58.762478 run osmo-stp_10.42.42.5: Starting osmo-stp 09:09:59.310038 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32074): Launched 09:09:59.630522 run osmo-stp_10.42.42.5(pid=32075): Launched 09:09:59.751861 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:10:00.302393 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32077): Launched 09:10:00.424684 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:10:00.694161 run patchelf(pid=32078): Launched 09:10:00.896008 run osmo-stp_10.42.42.5(pid=32075): ERR: Terminated: ERROR {rc=1} [trial-2402↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32075)] 09:10:01.037983 run osmo-stp_10.42.42.5(pid=32075): stdout: | (launched: 2022-12-14_09:09:59.571086) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:10:01.176357 run osmo-stp_10.42.42.5(pid=32075): stderr: | 20221214090959765 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214090959765 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214090959765 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214090959766 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214090959766 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214090959766 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214090959766 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:10:01.315457 run osmo-stp_10.42.42.5(pid=32075): stdout: | (launched: 2022-12-14_09:09:59.571086) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:10:01.449918 run osmo-stp_10.42.42.5(pid=32075): stderr: | 20221214090959765 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214090959765 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214090959765 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214090959766 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214090959766 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214090959766 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214090959766 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:10:01.609383 run patchelf(pid=32078): Terminating (SIGINT) 09:10:01.790664 run patchelf(pid=32078): Terminated: ok {rc=0} 09:10:01.953985 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=32075): Process ended prematurely: osmo-stp_10.42.42.5(pid=32075) [trial-2402↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32075)] [trial-2402↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 09:10:01.964431 tst switch_tch_pdch.py:54: Test FAILED (6.8 sec) 09:10:01.997818 run osmo-hlr_10.42.42.2(pid=32072): ERR: Terminated: ERROR {rc=237} [trial-2402↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32072)] 09:10:02.048915 run osmo-hlr_10.42.42.2(pid=32072): stdout: | (launched: 2022-12-14_09:09:58.580663) 09:10:02.101879 run osmo-hlr_10.42.42.2(pid=32072): stderr: | 20221214090958779 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214090958779 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214090958779 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214090958779 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214090958779 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214090958779 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214090958792 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214090958802 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214090958802 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214090958802 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:10:02.155185 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32071): Terminating (SIGTERM) 09:10:02.197892 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32074): Terminating (SIGTERM) 09:10:02.240353 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32077): Terminating (SIGTERM) 09:10:02.283128 --- ParallelTerminationStrategy: PID 32071 died... 09:10:02.303271 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32071): Terminated: ok {rc=0} 09:10:02.350021 --- ParallelTerminationStrategy: PID 32074 died... 09:10:02.369461 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32074): Terminated: ok {rc=0} 09:10:02.415663 --- ParallelTerminationStrategy: PID 32077 died... 09:10:02.435097 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32077): Terminated: ok {rc=0} 09:10:02.523114 bus /gobi_0: Setting Powered False 09:10:03.622639 bus /gobi_0: Setting Powered False 09:10:04.738855 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2402 dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 dynts:trx-umtrx+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 09:10:05.991004 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:10:05.998477 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 09:10:06.031912 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 09:10:06.068590 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 09:10:06.123409 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 09:10:06.156614 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 09:10:06.191755 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 09:10:06.748807 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2402 dynts:trx-umtrx+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 09:10:06.754968 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 09:10:06.766637 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 09:10:06.838885 tst switch_tch_pdch.py: using LAC 39882 09:10:06.964280 tst switch_tch_pdch.py: using RAC 102 09:10:07.091120 tst switch_tch_pdch.py: using CellId 39882 09:10:07.217253 tst switch_tch_pdch.py: using BVCI 39883 09:10:07.326827 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 09:10:07.338250 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 09:10:07.349552 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 09:10:07.360506 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 09:10:07.371591 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 09:10:07.382798 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 09:10:07.394107 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 09:10:07.405307 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 09:10:07.526128 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 09:10:07.642351 tst switch_tch_pdch.py:51: start network... 09:10:07.841761 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:10:08.279140 run create_hlr_db(pid=32086): Launched 09:10:08.392550 bus /gobi_6: Setting Powered False 09:10:09.452378 run create_hlr_db(pid=32086): Terminated: ok {rc=0} 09:10:09.844283 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32088): Launched 09:10:10.142059 run osmo-hlr_10.42.42.2(pid=32089): Launched 09:10:10.255341 run osmo-stp_10.42.42.5: Starting osmo-stp 09:10:10.759692 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32091): Launched 09:10:11.058539 run osmo-stp_10.42.42.5(pid=32092): Launched 09:10:11.172107 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:10:11.661076 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32094): Launched 09:10:11.774844 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:10:12.027168 run patchelf(pid=32095): Launched 09:10:12.192814 run osmo-stp_10.42.42.5(pid=32092): ERR: Terminated: ERROR {rc=1} [trial-2402↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32092)] 09:10:12.319290 run osmo-stp_10.42.42.5(pid=32092): stdout: | (launched: 2022-12-14_09:10:11.002913) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:10:12.447129 run osmo-stp_10.42.42.5(pid=32092): stderr: | 20221214091011172 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214091011172 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214091011172 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214091011173 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214091011173 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214091011173 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214091011174 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:10:12.575421 run osmo-stp_10.42.42.5(pid=32092): stdout: | (launched: 2022-12-14_09:10:11.002913) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:10:12.697844 run osmo-stp_10.42.42.5(pid=32092): stderr: | 20221214091011172 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214091011172 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214091011172 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214091011173 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214091011173 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214091011173 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214091011174 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:10:12.842895 run patchelf(pid=32095): Terminating (SIGINT) 09:10:13.009737 run patchelf(pid=32095): Terminated: ok {rc=0} 09:10:13.130345 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=32092): Process ended prematurely: osmo-stp_10.42.42.5(pid=32092) [trial-2402↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32092)] [trial-2402↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 09:10:13.139308 tst switch_tch_pdch.py:54: Test FAILED (6.4 sec) 09:10:13.165701 run osmo-hlr_10.42.42.2(pid=32089): ERR: Terminated: ERROR {rc=237} [trial-2402↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32089)] 09:10:13.213968 run osmo-hlr_10.42.42.2(pid=32089): stdout: | (launched: 2022-12-14_09:10:10.086386) 09:10:13.263632 run osmo-hlr_10.42.42.2(pid=32089): stderr: | 20221214091010261 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214091010261 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214091010262 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214091010262 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214091010262 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214091010262 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214091010273 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/dynts:trx-umtrx+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214091010282 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214091010282 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214091010282 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:10:13.314069 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32088): Terminating (SIGTERM) 09:10:13.354211 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32091): Terminating (SIGTERM) 09:10:13.394405 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32094): Terminating (SIGTERM) 09:10:13.434602 --- ParallelTerminationStrategy: PID 32088 died... 09:10:13.454139 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32088): Terminated: ok {rc=0} 09:10:13.498476 --- ParallelTerminationStrategy: PID 32091 died... 09:10:13.517463 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32091): Terminated: ok {rc=0} 09:10:13.561646 --- ParallelTerminationStrategy: PID 32094 died... 09:10:13.580716 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32094): Terminated: ok {rc=0} 09:10:13.667507 bus /gobi_0: Setting Powered False 09:10:14.766870 bus /gobi_0: Setting Powered False 09:10:15.890631 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2402 dynts:trx-umtrx+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 nitb_sms:trx-lms --------------------------------------------------------------------- 09:10:17.178761 tst nitb_sms:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:10:17.186340 tst nitb_sms:trx-lms: Verifying 1 x bts (candidates: 11) 09:10:17.227066 tst nitb_sms:trx-lms: Verifying 1 x ip_address (candidates: 9) 09:10:17.234823 tst nitb_sms:trx-lms: Verifying 2 x modem (candidates: 12) 09:10:17.287982 tst nitb_sms:trx-lms: Reserving 1 x bts (candidates: 11) 09:10:17.322931 tst nitb_sms:trx-lms: Reserving 1 x ip_address (candidates: 9) 09:10:17.331032 tst nitb_sms:trx-lms: Reserving 2 x modem (candidates: 12) 09:10:17.868412 tst nitb_sms:trx-lms: RESERVED RESOURCES for nitb_sms: bts LimeSDR-USB ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2402 nitb_sms:trx-lms mo_mt_sms.py ---------------------------------------------- 09:10:17.873917 tst nitb_sms:trx-lms: Using 1 x ip_address (candidates: 1) 09:10:17.885300 tst nitb_sms:trx-lms: Using 1 x bts (candidates: 1) 09:10:17.934567 tst mo_mt_sms.py: using LAC 39883 09:10:18.060014 tst mo_mt_sms.py: using RAC 103 09:10:18.184539 tst mo_mt_sms.py: using CellId 39883 09:10:18.308897 tst mo_mt_sms.py: using BVCI 39884 09:10:18.424335 tst nitb_sms:trx-lms: Using 1 x modem (candidates: 2) 09:10:18.540500 tst nitb_sms:trx-lms: Using 1 x modem (candidates: 2) 09:10:18.656107 tst mo_mt_sms.py:9: start nitb and bts... 09:10:18.871411 run osmo-nitb_10.42.42.2: Starting osmo-nitb 09:10:19.521221 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=32099): Launched 09:10:19.840131 run osmo-nitb_10.42.42.2(pid=32100): Launched 09:10:20.016057 run osmo-nitb_10.42.42.2(pid=32100): ERR: Terminated: ERROR {rc=2} [trial-2402↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=32100)] 09:10:20.158722 run osmo-nitb_10.42.42.2(pid=32100): stdout: | (launched: 2022-12-14_09:10:19.780825) 09:10:20.302225 run osmo-nitb_10.42.42.2(pid=32100): stderr: | (launched: 2022-12-14_09:10:19.828272) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 09:10:20.446293 run osmo-nitb_10.42.42.2(pid=32100): stdout: | (launched: 2022-12-14_09:10:19.780825) 09:10:20.584319 run osmo-nitb_10.42.42.2(pid=32100): stderr: | (launched: 2022-12-14_09:10:19.828272) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fe4ae4b0268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=32100): Process ended prematurely: osmo-nitb_10.42.42.2(pid=32100) [trial-2402↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=32100)] 09:10:20.959807 tst osmo-nitb_10.42.42.2(pid=32100): stdout: | (launched: 2022-12-14_09:10:19.780825) 09:10:21.087619 tst osmo-nitb_10.42.42.2(pid=32100): stderr: | (launched: 2022-12-14_09:10:19.828272) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 09:10:21.238231 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=32100): Process ended prematurely: osmo-nitb_10.42.42.2(pid=32100) [trial-2402↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=32100)] [trial-2402↪nitb_sms:trx-lms↪mo_mt_sms.py:11] 09:10:21.247279 tst mo_mt_sms.py:11: Test FAILED (3.4 sec) 09:10:21.254424 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=32099): Terminating (SIGTERM) 09:10:21.464560 --- ParallelTerminationStrategy: PID 32099 died... 09:10:21.485814 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=32099): Terminated: ok {rc=0} 09:10:21.572929 bus /sierra_3: Setting Powered False 09:10:22.672584 bus /sierra_3: Setting Powered False 09:10:23.789969 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2402 nitb_sms:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 sms:trx-lms --------------------------------------------------------------------- 09:10:24.994197 tst sms:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:10:24.998620 tst sms:trx-lms: Verifying 1 x bts (candidates: 11) 09:10:25.032518 tst sms:trx-lms: Verifying 6 x ip_address (candidates: 9) 09:10:25.060155 tst sms:trx-lms: Verifying 2 x modem (candidates: 12) 09:10:25.113195 tst sms:trx-lms: Reserving 1 x bts (candidates: 11) 09:10:25.146547 tst sms:trx-lms: Reserving 6 x ip_address (candidates: 9) 09:10:25.173812 tst sms:trx-lms: Reserving 2 x modem (candidates: 12) 09:10:25.722281 tst sms:trx-lms: RESERVED RESOURCES for sms: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2402 sms:trx-lms mo_mt_sms.py ---------------------------------------------- 09:10:25.728428 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 09:10:25.740104 tst sms:trx-lms: Using 1 x bts (candidates: 1) 09:10:25.792783 tst mo_mt_sms.py: using LAC 39884 09:10:25.908447 tst mo_mt_sms.py: using RAC 104 09:10:26.023331 tst mo_mt_sms.py: using CellId 39884 09:10:26.139054 tst mo_mt_sms.py: using BVCI 39885 09:10:26.246898 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 09:10:26.257514 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 09:10:26.267892 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 09:10:26.278245 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 09:10:26.288558 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 09:10:26.299636 tst sms:trx-lms: Using 1 x modem (candidates: 2) 09:10:26.417467 tst sms:trx-lms: Using 1 x modem (candidates: 2) 09:10:26.538373 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:10:27.031282 run create_hlr_db(pid=32104): Launched 09:10:27.160239 bus /sierra_2: Setting Powered False 09:10:28.223473 run create_hlr_db(pid=32104): Terminated: ok {rc=0} 09:10:28.650013 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32106): Launched 09:10:28.949184 run osmo-hlr_10.42.42.2(pid=32107): Launched 09:10:29.063067 run osmo-stp_10.42.42.5: Starting osmo-stp 09:10:29.592831 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32109): Launched 09:10:29.891356 run osmo-stp_10.42.42.5(pid=32110): Launched 09:10:30.004738 run osmo-msc_10.42.42.6: Starting osmo-msc 09:10:30.544711 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32112): Launched 09:10:30.846096 run osmo-msc_10.42.42.6(pid=32113): Launched 09:10:31.223525 run osmo-stp_10.42.42.5(pid=32110): ERR: Terminated: ERROR {rc=1} [trial-2402↪sms:trx-lms↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32110)] 09:10:31.495641 run osmo-stp_10.42.42.5(pid=32110): stdout: | (launched: 2022-12-14_09:10:29.835782) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:10:31.665241 run osmo-stp_10.42.42.5(pid=32110): stderr: | 20221214091030007 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214091030007 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214091030007 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214091030008 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214091030008 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214091030008 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214091030008 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:10:31.812371 run osmo-stp_10.42.42.5(pid=32110): stdout: | (launched: 2022-12-14_09:10:29.835782) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:10:31.944678 run osmo-stp_10.42.42.5(pid=32110): stderr: | 20221214091030007 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214091030007 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214091030007 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214091030008 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214091030008 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214091030008 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214091030008 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:10:32.130936 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=32110): Process ended prematurely: osmo-stp_10.42.42.5(pid=32110) [trial-2402↪sms:trx-lms↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32110)] [trial-2402↪sms:trx-lms↪mo_mt_sms.py:16] 09:10:32.143049 tst mo_mt_sms.py:16: Test FAILED (6.4 sec) 09:10:32.170289 run osmo-hlr_10.42.42.2(pid=32107): ERR: Terminated: ERROR {rc=237} [trial-2402↪sms:trx-lms↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32107)] 09:10:32.221994 run osmo-hlr_10.42.42.2(pid=32107): stdout: | (launched: 2022-12-14_09:10:28.893243) 09:10:32.275149 run osmo-hlr_10.42.42.2(pid=32107): stderr: | 20221214091029068 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214091029069 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214091029069 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214091029069 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214091029069 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214091029069 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214091029081 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/sms:trx-lms/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214091029089 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214091029090 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214091029090 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:10:32.348800 run osmo-msc_10.42.42.6(pid=32113): ERR: Terminated: ERROR {rc=2} [trial-2402↪sms:trx-lms↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32113)] 09:10:32.399338 run osmo-msc_10.42.42.6(pid=32113): stdout: | (launched: 2022-12-14_09:10:30.787126) 09:10:32.451542 run osmo-msc_10.42.42.6(pid=32113): stderr: | 20221214091031230 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214091031230 DLGLOBAL DEBUG validating counter group 0x7fb97648bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214091031230 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214091031230 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214091031230 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214091031231 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214091031242 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214091031243 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214091031243 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214091031243 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:10:32.503798 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32106): Terminating (SIGTERM) 09:10:32.545748 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32109): Terminating (SIGTERM) 09:10:32.587975 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32112): Terminating (SIGTERM) 09:10:32.629998 --- ParallelTerminationStrategy: PID 32106 died... 09:10:32.650138 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32106): Terminated: ok {rc=0} 09:10:32.696362 --- ParallelTerminationStrategy: PID 32109 died... 09:10:32.716053 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32109): Terminated: ok {rc=0} 09:10:32.762004 --- ParallelTerminationStrategy: PID 32112 died... 09:10:32.781677 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32112): Terminated: ok {rc=0} 09:10:32.869759 bus /sierra_3: Setting Powered False 09:10:33.968349 bus /sierra_3: Setting Powered False 09:10:35.086736 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2402 sms:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 nitb_ussd:trx-lms --------------------------------------------------------------------- 09:10:36.315628 tst nitb_ussd:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:10:36.319396 tst nitb_ussd:trx-lms: Verifying 1 x bts (candidates: 11) 09:10:36.352006 tst nitb_ussd:trx-lms: Verifying 1 x ip_address (candidates: 9) 09:10:36.359346 tst nitb_ussd:trx-lms: Verifying 1 x modem (candidates: 12) 09:10:36.404409 tst nitb_ussd:trx-lms: Reserving 1 x bts (candidates: 11) 09:10:36.438636 tst nitb_ussd:trx-lms: Reserving 1 x ip_address (candidates: 9) 09:10:36.445336 tst nitb_ussd:trx-lms: Reserving 1 x modem (candidates: 12) 09:10:36.959302 tst nitb_ussd:trx-lms: RESERVED RESOURCES for nitb_ussd: bts LimeSDR-USB ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2402 nitb_ussd:trx-lms assert_extension.py ---------------------------------------------- 09:10:36.965713 tst nitb_ussd:trx-lms: Using 1 x ip_address (candidates: 1) 09:10:36.976922 tst nitb_ussd:trx-lms: Using 1 x bts (candidates: 1) 09:10:37.028859 tst assert_extension.py: using LAC 39885 09:10:37.148826 tst assert_extension.py: using RAC 105 09:10:37.275258 tst assert_extension.py: using CellId 39885 09:10:37.401229 tst assert_extension.py: using BVCI 39886 09:10:37.518081 tst nitb_ussd:trx-lms: Using 1 x modem (candidates: 1) 09:10:37.634294 tst assert_extension.py:10: start nitb and bts... 09:10:37.833659 run osmo-nitb_10.42.42.2: Starting osmo-nitb 09:10:38.443802 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=32118): Launched 09:10:38.741768 run osmo-nitb_10.42.42.2(pid=32119): Launched 09:10:38.906678 run osmo-nitb_10.42.42.2(pid=32119): ERR: Terminated: ERROR {rc=2} [trial-2402↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=32119)] 09:10:39.040392 run osmo-nitb_10.42.42.2(pid=32119): stdout: | (launched: 2022-12-14_09:10:38.686273) 09:10:39.175698 run osmo-nitb_10.42.42.2(pid=32119): stderr: | (launched: 2022-12-14_09:10:38.730467) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 09:10:39.311003 run osmo-nitb_10.42.42.2(pid=32119): stdout: | (launched: 2022-12-14_09:10:38.686273) 09:10:39.441022 run osmo-nitb_10.42.42.2(pid=32119): stderr: | (launched: 2022-12-14_09:10:38.730467) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fe4ae4b0268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=32119): Process ended prematurely: osmo-nitb_10.42.42.2(pid=32119) [trial-2402↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=32119)] 09:10:39.854166 tst osmo-nitb_10.42.42.2(pid=32119): stdout: | (launched: 2022-12-14_09:10:38.686273) 09:10:39.975222 tst osmo-nitb_10.42.42.2(pid=32119): stderr: | (launched: 2022-12-14_09:10:38.730467) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 09:10:40.116732 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=32119): Process ended prematurely: osmo-nitb_10.42.42.2(pid=32119) [trial-2402↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=32119)] [trial-2402↪nitb_ussd:trx-lms↪assert_extension.py:12] 09:10:40.125497 tst assert_extension.py:12: Test FAILED (3.2 sec) 09:10:40.132279 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=32118): Terminating (SIGTERM) 09:10:40.341206 --- ParallelTerminationStrategy: PID 32118 died... 09:10:40.361604 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=32118): Terminated: ok {rc=0} 09:10:40.448647 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2402 nitb_ussd:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 ussd:trx-lms --------------------------------------------------------------------- 09:10:41.629208 tst ussd:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:10:41.633248 tst ussd:trx-lms: Verifying 1 x bts (candidates: 11) 09:10:41.665633 tst ussd:trx-lms: Verifying 6 x ip_address (candidates: 9) 09:10:41.692850 tst ussd:trx-lms: Verifying 1 x modem (candidates: 12) 09:10:41.728492 tst ussd:trx-lms: Reserving 1 x bts (candidates: 11) 09:10:41.763553 tst ussd:trx-lms: Reserving 6 x ip_address (candidates: 9) 09:10:41.791443 tst ussd:trx-lms: Reserving 1 x modem (candidates: 12) 09:10:42.318741 tst ussd:trx-lms: RESERVED RESOURCES for ussd: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2402 ussd:trx-lms assert_extension.py ---------------------------------------------- 09:10:42.324015 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 09:10:42.335126 tst ussd:trx-lms: Using 1 x bts (candidates: 1) 09:10:42.385158 tst assert_extension.py: using LAC 39886 09:10:42.508997 tst assert_extension.py: using RAC 106 09:10:42.632667 tst assert_extension.py: using CellId 39886 09:10:42.758112 tst assert_extension.py: using BVCI 39887 09:10:42.872907 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 09:10:42.883967 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 09:10:42.894964 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 09:10:42.905841 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 09:10:42.916770 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 09:10:42.927693 tst ussd:trx-lms: Using 1 x modem (candidates: 1) 09:10:43.043223 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:10:43.507906 run create_hlr_db(pid=32124): Launched 09:10:43.623064 bus /sierra_2: Setting Powered False 09:10:44.683085 run create_hlr_db(pid=32124): Terminated: ok {rc=0} 09:10:45.120765 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32126): Launched 09:10:45.442011 run osmo-hlr_10.42.42.2(pid=32127): Launched 09:10:45.565835 run osmo-stp_10.42.42.5: Starting osmo-stp 09:10:46.131241 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32129): Launched 09:10:46.459695 run osmo-stp_10.42.42.5(pid=32130): Launched 09:10:46.686829 run osmo-msc_10.42.42.6: Starting osmo-msc 09:10:47.317819 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32132): Launched 09:10:47.639232 run osmo-msc_10.42.42.6(pid=32133): Launched 09:10:47.818420 run osmo-stp_10.42.42.5(pid=32130): ERR: Terminated: ERROR {rc=1} [trial-2402↪ussd:trx-lms↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32130)] 09:10:47.952742 run osmo-stp_10.42.42.5(pid=32130): stdout: | (launched: 2022-12-14_09:10:46.399623) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:10:48.088088 run osmo-stp_10.42.42.5(pid=32130): stderr: | 20221214091046635 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214091046635 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214091046635 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214091046636 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214091046636 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214091046636 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214091046645 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:10:48.222444 run osmo-stp_10.42.42.5(pid=32130): stdout: | (launched: 2022-12-14_09:10:46.399623) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:10:48.349454 run osmo-stp_10.42.42.5(pid=32130): stderr: | 20221214091046635 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214091046635 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214091046635 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214091046636 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214091046636 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214091046636 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214091046645 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:10:48.501605 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=32130): Process ended prematurely: osmo-stp_10.42.42.5(pid=32130) [trial-2402↪ussd:trx-lms↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32130)] [trial-2402↪ussd:trx-lms↪assert_extension.py:17] 09:10:48.510712 tst assert_extension.py:17: Test FAILED (6.2 sec) 09:10:48.538086 run osmo-hlr_10.42.42.2(pid=32127): ERR: Terminated: ERROR {rc=237} [trial-2402↪ussd:trx-lms↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32127)] 09:10:48.588139 run osmo-hlr_10.42.42.2(pid=32127): stdout: | (launched: 2022-12-14_09:10:45.382626) 09:10:48.640037 run osmo-hlr_10.42.42.2(pid=32127): stderr: | 20221214091045578 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214091045579 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214091045579 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214091045579 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214091045579 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214091045579 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214091045593 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/ussd:trx-lms/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214091045603 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214091045603 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214091045603 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:10:48.712198 run osmo-msc_10.42.42.6(pid=32133): ERR: Terminated: ERROR {rc=2} [trial-2402↪ussd:trx-lms↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32133)] 09:10:48.762119 run osmo-msc_10.42.42.6(pid=32133): stdout: | (launched: 2022-12-14_09:10:47.580107) 09:10:48.813552 run osmo-msc_10.42.42.6(pid=32133): stderr: | 20221214091047902 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214091047902 DLGLOBAL DEBUG validating counter group 0x7f986ee34c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214091047902 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214091047902 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214091047902 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214091047902 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214091047904 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214091047904 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214091047905 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214091047905 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:10:48.865546 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32126): Terminating (SIGTERM) 09:10:48.906952 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32129): Terminating (SIGTERM) 09:10:48.948559 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32132): Terminating (SIGTERM) 09:10:48.990276 --- ParallelTerminationStrategy: PID 32126 died... 09:10:49.010269 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32126): Terminated: ok {rc=0} 09:10:49.056225 --- ParallelTerminationStrategy: PID 32129 died... 09:10:49.075797 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32129): Terminated: ok {rc=0} 09:10:49.121698 --- ParallelTerminationStrategy: PID 32132 died... 09:10:49.141333 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32132): Terminated: ok {rc=0} 09:10:49.228906 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2402 ussd:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 09:10:50.441315 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:10:50.448384 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 09:10:50.481954 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 09:10:50.509275 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 09:10:50.561754 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 09:10:50.596381 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 09:10:50.624734 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 09:10:51.174692 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2402 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 09:10:51.226838 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:10:51.238038 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 09:10:51.308484 tst mo_mt_call.py: using LAC 39887 09:10:51.429327 tst mo_mt_call.py: using RAC 107 09:10:51.547751 tst mo_mt_call.py: using CellId 39887 09:10:51.666509 tst mo_mt_call.py: using BVCI 39888 09:10:51.778665 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:10:51.790043 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:10:51.800938 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:10:51.811912 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:10:51.823187 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:10:51.834508 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 09:10:51.954980 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 09:10:52.079595 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:10:52.585223 run create_hlr_db(pid=32140): Launched 09:10:52.717128 bus /sierra_2: Setting Powered False 09:10:53.781274 run create_hlr_db(pid=32140): Terminated: ok {rc=0} 09:10:54.215830 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32142): Launched 09:10:54.521614 run osmo-hlr_10.42.42.2(pid=32143): Launched 09:10:54.641241 run osmo-stp_10.42.42.5: Starting osmo-stp 09:10:55.171046 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32145): Launched 09:10:55.475561 run osmo-stp_10.42.42.5(pid=32146): Launched 09:10:55.591600 run osmo-msc_10.42.42.6: Starting osmo-msc 09:10:56.142195 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32148): Launched 09:10:56.445517 run osmo-msc_10.42.42.6(pid=32149): Launched 09:10:56.615335 run osmo-stp_10.42.42.5(pid=32146): ERR: Terminated: ERROR {rc=1} [trial-2402↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32146)] 09:10:56.743187 run osmo-stp_10.42.42.5(pid=32146): stdout: | (launched: 2022-12-14_09:10:55.418939) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:10:56.871163 run osmo-stp_10.42.42.5(pid=32146): stderr: | 20221214091055589 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214091055589 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214091055589 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214091055589 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214091055590 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214091055590 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214091055590 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:10:56.997523 run osmo-stp_10.42.42.5(pid=32146): stdout: | (launched: 2022-12-14_09:10:55.418939) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:10:57.117976 run osmo-stp_10.42.42.5(pid=32146): stderr: | 20221214091055589 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214091055589 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214091055589 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214091055589 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214091055590 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214091055590 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214091055590 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:10:57.262077 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32146): Process ended prematurely: osmo-stp_10.42.42.5(pid=32146) [trial-2402↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32146)] [trial-2402↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 09:10:57.271128 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 09:10:57.297349 run osmo-hlr_10.42.42.2(pid=32143): ERR: Terminated: ERROR {rc=237} [trial-2402↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32143)] 09:10:57.345271 run osmo-hlr_10.42.42.2(pid=32143): stdout: | (launched: 2022-12-14_09:10:54.464733) 09:10:57.394604 run osmo-hlr_10.42.42.2(pid=32143): stderr: | 20221214091054640 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214091054640 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214091054640 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214091054640 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214091054640 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214091054640 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214091054653 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214091054661 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214091054661 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214091054661 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:10:57.463727 run osmo-msc_10.42.42.6(pid=32149): ERR: Terminated: ERROR {rc=2} [trial-2402↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32149)] 09:10:57.511510 run osmo-msc_10.42.42.6(pid=32149): stdout: | (launched: 2022-12-14_09:10:56.388712) 09:10:57.561322 run osmo-msc_10.42.42.6(pid=32149): stderr: | 20221214091056663 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214091056663 DLGLOBAL DEBUG validating counter group 0x7fe4a3ce8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214091056664 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214091056664 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214091056664 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214091056664 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214091056666 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214091056666 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214091056666 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214091056666 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:10:57.610798 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32142): Terminating (SIGTERM) 09:10:57.650627 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32145): Terminating (SIGTERM) 09:10:57.690455 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32148): Terminating (SIGTERM) 09:10:57.730408 --- ParallelTerminationStrategy: PID 32142 died... 09:10:57.749847 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32142): Terminated: ok {rc=0} 09:10:57.793989 --- ParallelTerminationStrategy: PID 32145 died... 09:10:57.812839 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32145): Terminated: ok {rc=0} 09:10:57.857136 --- ParallelTerminationStrategy: PID 32148 died... 09:10:57.876146 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32148): Terminated: ok {rc=0} 09:10:57.960521 bus /sierra_3: Setting Powered False 09:10:59.059022 bus /sierra_3: Setting Powered False 09:11:00.175181 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2402 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 09:11:01.320297 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:11:01.333292 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 09:11:01.410209 tst mo_mt_call_osmux.py: using LAC 39888 09:11:01.544386 tst mo_mt_call_osmux.py: using RAC 108 09:11:01.709117 tst mo_mt_call_osmux.py: using CellId 39888 09:11:01.868153 tst mo_mt_call_osmux.py: using BVCI 39889 09:11:01.989420 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:11:02.002191 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:11:02.014766 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:11:02.027275 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:11:02.039780 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:11:02.053216 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 09:11:02.178303 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 09:11:02.307608 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:11:02.814600 run create_hlr_db(pid=32151): Launched 09:11:02.948466 bus /sierra_2: Setting Powered False 09:11:04.011197 run create_hlr_db(pid=32151): Terminated: ok {rc=0} 09:11:04.440352 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32153): Launched 09:11:04.737102 run osmo-hlr_10.42.42.2(pid=32154): Launched 09:11:04.850812 run osmo-stp_10.42.42.5: Starting osmo-stp 09:11:05.359263 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32156): Launched 09:11:05.654555 run osmo-stp_10.42.42.5(pid=32157): Launched 09:11:05.766562 run osmo-msc_10.42.42.6: Starting osmo-msc 09:11:06.300929 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32159): Launched 09:11:06.596824 run osmo-msc_10.42.42.6(pid=32160): Launched 09:11:06.762404 run osmo-stp_10.42.42.5(pid=32157): ERR: Terminated: ERROR {rc=1} [trial-2402↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32157)] 09:11:06.888014 run osmo-stp_10.42.42.5(pid=32157): stdout: | (launched: 2022-12-14_09:11:05.599627) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:11:07.012698 run osmo-stp_10.42.42.5(pid=32157): stderr: | 20221214091105767 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214091105767 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214091105767 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214091105768 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214091105768 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214091105768 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214091105768 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:11:07.135617 run osmo-stp_10.42.42.5(pid=32157): stdout: | (launched: 2022-12-14_09:11:05.599627) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:11:07.252667 run osmo-stp_10.42.42.5(pid=32157): stderr: | 20221214091105767 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214091105767 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214091105767 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214091105768 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214091105768 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214091105768 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214091105768 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:11:07.393073 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32157): Process ended prematurely: osmo-stp_10.42.42.5(pid=32157) [trial-2402↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32157)] [trial-2402↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 09:11:07.402031 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 09:11:07.427977 run osmo-hlr_10.42.42.2(pid=32154): ERR: Terminated: ERROR {rc=237} [trial-2402↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32154)] 09:11:07.475777 run osmo-hlr_10.42.42.2(pid=32154): stdout: | (launched: 2022-12-14_09:11:04.681941) 09:11:07.524853 run osmo-hlr_10.42.42.2(pid=32154): stderr: | 20221214091104856 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214091104856 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214091104856 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214091104856 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214091104856 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214091104856 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214091104868 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214091104877 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214091104877 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214091104877 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:11:07.594003 run osmo-msc_10.42.42.6(pid=32160): ERR: Terminated: ERROR {rc=2} [trial-2402↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32160)] 09:11:07.640935 run osmo-msc_10.42.42.6(pid=32160): stdout: | (launched: 2022-12-14_09:11:06.541804) 09:11:07.690226 run osmo-msc_10.42.42.6(pid=32160): stderr: | 20221214091106811 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214091106811 DLGLOBAL DEBUG validating counter group 0x7f723d897c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214091106811 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214091106811 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214091106811 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214091106812 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214091106813 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214091106814 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214091106814 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214091106814 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:11:07.739766 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32153): Terminating (SIGTERM) 09:11:07.779481 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32156): Terminating (SIGTERM) 09:11:07.819373 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32159): Terminating (SIGTERM) 09:11:07.859322 --- ParallelTerminationStrategy: PID 32153 died... 09:11:07.878676 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32153): Terminated: ok {rc=0} 09:11:07.922711 --- ParallelTerminationStrategy: PID 32156 died... 09:11:07.941320 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32156): Terminated: ok {rc=0} 09:11:07.984877 --- ParallelTerminationStrategy: PID 32159 died... 09:11:08.003996 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32159): Terminated: ok {rc=0} 09:11:08.091834 bus /sierra_3: Setting Powered False 09:11:09.193253 bus /sierra_3: Setting Powered False 09:11:10.309144 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2402 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 09:11:11.559491 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:11:11.566683 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 09:11:11.600224 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 09:11:11.627919 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 09:11:11.680464 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 09:11:11.714708 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 09:11:11.742022 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 09:11:12.298243 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2402 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 09:11:12.348870 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:11:12.360520 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 09:11:12.430788 tst mo_mt_call.py: using LAC 39889 09:11:12.554243 tst mo_mt_call.py: using RAC 109 09:11:12.678917 tst mo_mt_call.py: using CellId 39889 09:11:12.802744 tst mo_mt_call.py: using BVCI 39890 09:11:12.916655 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:11:12.928154 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:11:12.939551 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:11:12.950834 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:11:12.962243 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:11:12.973651 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 09:11:13.089504 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 09:11:13.205584 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:11:13.695266 run create_hlr_db(pid=32166): Launched 09:11:13.822898 bus /sierra_2: Setting Powered False 09:11:14.885236 run create_hlr_db(pid=32166): Terminated: ok {rc=0} 09:11:15.304783 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32168): Launched 09:11:15.601238 run osmo-hlr_10.42.42.2(pid=32169): Launched 09:11:15.713448 run osmo-stp_10.42.42.5: Starting osmo-stp 09:11:16.281777 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32171): Launched 09:11:16.611388 run osmo-stp_10.42.42.5(pid=32172): Launched 09:11:16.851288 run osmo-msc_10.42.42.6: Starting osmo-msc 09:11:17.503118 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32174): Launched 09:11:17.817916 run osmo-msc_10.42.42.6(pid=32175): Launched 09:11:17.993415 run osmo-stp_10.42.42.5(pid=32172): ERR: Terminated: ERROR {rc=1} [trial-2402↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32172)] 09:11:18.125073 run osmo-stp_10.42.42.5(pid=32172): stdout: | (launched: 2022-12-14_09:11:16.546408) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:11:18.259044 run osmo-stp_10.42.42.5(pid=32172): stderr: | 20221214091116841 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214091116841 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214091116841 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214091116842 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214091116842 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214091116842 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214091116842 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:11:18.391030 run osmo-stp_10.42.42.5(pid=32172): stdout: | (launched: 2022-12-14_09:11:16.546408) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:11:18.515960 run osmo-stp_10.42.42.5(pid=32172): stderr: | 20221214091116841 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214091116841 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214091116841 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214091116842 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214091116842 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214091116842 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214091116842 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:11:18.664770 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32172): Process ended prematurely: osmo-stp_10.42.42.5(pid=32172) [trial-2402↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32172)] [trial-2402↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 09:11:18.674602 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 09:11:18.702150 run osmo-hlr_10.42.42.2(pid=32169): ERR: Terminated: ERROR {rc=237} [trial-2402↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32169)] 09:11:18.752333 run osmo-hlr_10.42.42.2(pid=32169): stdout: | (launched: 2022-12-14_09:11:15.546198) 09:11:18.803585 run osmo-hlr_10.42.42.2(pid=32169): stderr: | 20221214091115718 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214091115718 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214091115718 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214091115718 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214091115718 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214091115718 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214091115730 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214091115739 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214091115739 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214091115739 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:11:18.875263 run osmo-msc_10.42.42.6(pid=32175): ERR: Terminated: ERROR {rc=2} [trial-2402↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32175)] 09:11:18.925138 run osmo-msc_10.42.42.6(pid=32175): stdout: | (launched: 2022-12-14_09:11:17.759155) 09:11:18.976442 run osmo-msc_10.42.42.6(pid=32175): stderr: | 20221214091118078 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214091118078 DLGLOBAL DEBUG validating counter group 0x7f87116dfc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214091118078 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214091118078 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214091118079 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214091118079 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214091118080 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214091118081 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214091118081 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214091118081 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:11:19.028311 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32168): Terminating (SIGTERM) 09:11:19.069805 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32171): Terminating (SIGTERM) 09:11:19.111208 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32174): Terminating (SIGTERM) 09:11:19.152630 --- ParallelTerminationStrategy: PID 32168 died... 09:11:19.172593 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32168): Terminated: ok {rc=0} 09:11:19.218317 --- ParallelTerminationStrategy: PID 32171 died... 09:11:19.237882 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32171): Terminated: ok {rc=0} 09:11:19.283301 --- ParallelTerminationStrategy: PID 32174 died... 09:11:19.302767 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32174): Terminated: ok {rc=0} 09:11:19.390293 bus /sierra_3: Setting Powered False 09:11:20.487765 bus /sierra_3: Setting Powered False 09:11:21.603147 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2402 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 09:11:22.745428 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:11:22.757003 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 09:11:22.826087 tst mo_mt_call_osmux.py: using LAC 39890 09:11:22.944486 tst mo_mt_call_osmux.py: using RAC 110 09:11:23.060635 tst mo_mt_call_osmux.py: using CellId 39890 09:11:23.177423 tst mo_mt_call_osmux.py: using BVCI 39891 09:11:23.292124 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:11:23.303961 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:11:23.315570 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:11:23.327139 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:11:23.338965 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:11:23.350672 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 09:11:23.466849 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 09:11:23.583584 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:11:24.071313 run create_hlr_db(pid=32177): Launched 09:11:24.199534 bus /sierra_2: Setting Powered False 09:11:25.261584 run create_hlr_db(pid=32177): Terminated: ok {rc=0} 09:11:25.699913 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32179): Launched 09:11:26.013409 run osmo-hlr_10.42.42.2(pid=32180): Launched 09:11:26.132262 run osmo-stp_10.42.42.5: Starting osmo-stp 09:11:26.678645 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32182): Launched 09:11:26.991608 run osmo-stp_10.42.42.5(pid=32183): Launched 09:11:27.109999 run osmo-msc_10.42.42.6: Starting osmo-msc 09:11:27.677524 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32185): Launched 09:11:27.990719 run osmo-msc_10.42.42.6(pid=32186): Launched 09:11:28.165459 run osmo-stp_10.42.42.5(pid=32183): ERR: Terminated: ERROR {rc=1} [trial-2402↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32183)] 09:11:28.298513 run osmo-stp_10.42.42.5(pid=32183): stdout: | (launched: 2022-12-14_09:11:26.933723) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:11:28.432108 run osmo-stp_10.42.42.5(pid=32183): stderr: | 20221214091127122 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214091127122 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214091127122 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214091127122 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214091127123 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214091127123 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214091127123 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:11:28.563972 run osmo-stp_10.42.42.5(pid=32183): stdout: | (launched: 2022-12-14_09:11:26.933723) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:11:28.688285 run osmo-stp_10.42.42.5(pid=32183): stderr: | 20221214091127122 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214091127122 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214091127122 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214091127122 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214091127123 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214091127123 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214091127123 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:11:28.837622 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32183): Process ended prematurely: osmo-stp_10.42.42.5(pid=32183) [trial-2402↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32183)] [trial-2402↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 09:11:28.847303 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 09:11:28.874989 run osmo-hlr_10.42.42.2(pid=32180): ERR: Terminated: ERROR {rc=237} [trial-2402↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32180)] 09:11:28.925205 run osmo-hlr_10.42.42.2(pid=32180): stdout: | (launched: 2022-12-14_09:11:25.955470) 09:11:28.976906 run osmo-hlr_10.42.42.2(pid=32180): stderr: | 20221214091126149 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214091126149 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214091126149 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214091126149 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214091126149 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214091126149 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214091126160 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214091126168 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214091126168 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214091126168 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:11:29.049265 run osmo-msc_10.42.42.6(pid=32186): ERR: Terminated: ERROR {rc=2} [trial-2402↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32186)] 09:11:29.099201 run osmo-msc_10.42.42.6(pid=32186): stdout: | (launched: 2022-12-14_09:11:27.932823) 09:11:29.150813 run osmo-msc_10.42.42.6(pid=32186): stderr: | 20221214091128250 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214091128250 DLGLOBAL DEBUG validating counter group 0x7fc5e2e2ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214091128250 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214091128250 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214091128251 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214091128251 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214091128252 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214091128253 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214091128253 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214091128253 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:11:29.202642 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32179): Terminating (SIGTERM) 09:11:29.244087 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32182): Terminating (SIGTERM) 09:11:29.285724 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32185): Terminating (SIGTERM) 09:11:29.327537 --- ParallelTerminationStrategy: PID 32179 died... 09:11:29.347625 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32179): Terminated: ok {rc=0} 09:11:29.393906 --- ParallelTerminationStrategy: PID 32182 died... 09:11:29.413622 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32182): Terminated: ok {rc=0} 09:11:29.459618 --- ParallelTerminationStrategy: PID 32185 died... 09:11:29.479190 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32185): Terminated: ok {rc=0} 09:11:29.565797 bus /sierra_3: Setting Powered False 09:11:30.663194 bus /sierra_3: Setting Powered False 09:11:31.786376 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2402 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 09:11:33.038765 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:11:33.045257 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 09:11:33.077518 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 09:11:33.104163 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 09:11:33.156472 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 09:11:33.190268 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 09:11:33.217717 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 09:11:33.774971 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2402 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 09:11:33.822524 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:11:33.833732 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 09:11:33.902750 tst mo_mt_call.py: using LAC 39891 09:11:34.019997 tst mo_mt_call.py: using RAC 111 09:11:34.135166 tst mo_mt_call.py: using CellId 39891 09:11:34.252732 tst mo_mt_call.py: using BVCI 39892 09:11:34.359539 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:11:34.370581 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:11:34.381328 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:11:34.392063 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:11:34.403286 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:11:34.414413 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 09:11:34.532683 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 09:11:34.652273 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:11:35.110145 run create_hlr_db(pid=32191): Launched 09:11:35.222492 bus /sierra_2: Setting Powered False 09:11:36.281859 run create_hlr_db(pid=32191): Terminated: ok {rc=0} 09:11:36.692761 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32193): Launched 09:11:36.987903 run osmo-hlr_10.42.42.2(pid=32194): Launched 09:11:37.100666 run osmo-stp_10.42.42.5: Starting osmo-stp 09:11:37.619704 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32196): Launched 09:11:37.913455 run osmo-stp_10.42.42.5(pid=32197): Launched 09:11:38.025780 run osmo-msc_10.42.42.6: Starting osmo-msc 09:11:38.559286 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32199): Launched 09:11:38.853610 run osmo-msc_10.42.42.6(pid=32200): Launched 09:11:39.018010 run osmo-stp_10.42.42.5(pid=32197): ERR: Terminated: ERROR {rc=1} [trial-2402↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32197)] 09:11:39.143517 run osmo-stp_10.42.42.5(pid=32197): stdout: | (launched: 2022-12-14_09:11:37.859232) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:11:39.268485 run osmo-stp_10.42.42.5(pid=32197): stderr: | 20221214091138025 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214091138025 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214091138026 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214091138026 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214091138026 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214091138027 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214091138027 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:11:39.391405 run osmo-stp_10.42.42.5(pid=32197): stdout: | (launched: 2022-12-14_09:11:37.859232) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:11:39.508748 run osmo-stp_10.42.42.5(pid=32197): stderr: | 20221214091138025 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214091138025 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214091138026 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214091138026 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214091138026 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214091138027 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214091138027 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:11:39.648831 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32197): Process ended prematurely: osmo-stp_10.42.42.5(pid=32197) [trial-2402↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32197)] [trial-2402↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 09:11:39.657956 tst mo_mt_call.py:8: Test FAILED (5.9 sec) 09:11:39.683953 run osmo-hlr_10.42.42.2(pid=32194): ERR: Terminated: ERROR {rc=237} [trial-2402↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32194)] 09:11:39.731948 run osmo-hlr_10.42.42.2(pid=32194): stdout: | (launched: 2022-12-14_09:11:36.933845) 09:11:39.780772 run osmo-hlr_10.42.42.2(pid=32194): stderr: | 20221214091137104 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214091137104 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214091137104 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214091137104 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214091137104 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214091137105 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214091137117 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214091137125 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214091137125 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214091137125 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:11:39.849391 run osmo-msc_10.42.42.6(pid=32200): ERR: Terminated: ERROR {rc=2} [trial-2402↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32200)] 09:11:39.896187 run osmo-msc_10.42.42.6(pid=32200): stdout: | (launched: 2022-12-14_09:11:38.799150) 09:11:39.944835 run osmo-msc_10.42.42.6(pid=32200): stderr: | 20221214091139065 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214091139065 DLGLOBAL DEBUG validating counter group 0x7fe40e52bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214091139065 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214091139065 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214091139066 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214091139066 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214091139067 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214091139068 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214091139068 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214091139068 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:11:39.994194 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32193): Terminating (SIGTERM) 09:11:40.033593 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32196): Terminating (SIGTERM) 09:11:40.072936 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32199): Terminating (SIGTERM) 09:11:40.112626 --- ParallelTerminationStrategy: PID 32193 died... 09:11:40.131844 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32193): Terminated: ok {rc=0} 09:11:40.175542 --- ParallelTerminationStrategy: PID 32196 died... 09:11:40.194316 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32196): Terminated: ok {rc=0} 09:11:40.238167 --- ParallelTerminationStrategy: PID 32199 died... 09:11:40.256909 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32199): Terminated: ok {rc=0} 09:11:40.342567 bus /sierra_3: Setting Powered False 09:11:41.437531 bus /sierra_3: Setting Powered False 09:11:42.551780 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2402 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 09:11:43.695349 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:11:43.707021 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 09:11:43.775408 tst mo_mt_call_osmux.py: using LAC 39892 09:11:43.890891 tst mo_mt_call_osmux.py: using RAC 112 09:11:44.008084 tst mo_mt_call_osmux.py: using CellId 39892 09:11:44.123324 tst mo_mt_call_osmux.py: using BVCI 39893 09:11:44.231307 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:11:44.242322 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:11:44.253229 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:11:44.263910 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:11:44.275023 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:11:44.286789 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 09:11:44.404017 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 09:11:44.518768 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:11:44.975248 run create_hlr_db(pid=32202): Launched 09:11:45.086866 bus /sierra_2: Setting Powered False 09:11:46.151524 run create_hlr_db(pid=32202): Terminated: ok {rc=0} 09:11:46.582417 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32204): Launched 09:11:46.888040 run osmo-hlr_10.42.42.2(pid=32205): Launched 09:11:47.141190 run osmo-stp_10.42.42.5: Starting osmo-stp 09:11:47.703355 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32207): Launched 09:11:48.006835 run osmo-stp_10.42.42.5(pid=32208): Launched 09:11:48.120092 run osmo-msc_10.42.42.6: Starting osmo-msc 09:11:48.659103 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32210): Launched 09:11:48.956214 run osmo-msc_10.42.42.6(pid=32211): Launched 09:11:49.123860 run osmo-stp_10.42.42.5(pid=32208): ERR: Terminated: ERROR {rc=1} [trial-2402↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32208)] 09:11:49.249484 run osmo-stp_10.42.42.5(pid=32208): stdout: | (launched: 2022-12-14_09:11:47.951277) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:11:49.375750 run osmo-stp_10.42.42.5(pid=32208): stderr: | 20221214091148118 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214091148118 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214091148118 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214091148119 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214091148119 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214091148119 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214091148119 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:11:49.499679 run osmo-stp_10.42.42.5(pid=32208): stdout: | (launched: 2022-12-14_09:11:47.951277) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:11:49.617735 run osmo-stp_10.42.42.5(pid=32208): stderr: | 20221214091148118 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214091148118 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214091148118 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214091148119 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214091148119 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214091148119 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214091148119 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:11:49.758953 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32208): Process ended prematurely: osmo-stp_10.42.42.5(pid=32208) [trial-2402↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32208)] [trial-2402↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 09:11:49.767741 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 09:11:49.794442 run osmo-hlr_10.42.42.2(pid=32205): ERR: Terminated: ERROR {rc=237} [trial-2402↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32205)] 09:11:49.842499 run osmo-hlr_10.42.42.2(pid=32205): stdout: | (launched: 2022-12-14_09:11:46.833213) 09:11:49.891956 run osmo-hlr_10.42.42.2(pid=32205): stderr: | 20221214091147077 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214091147077 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214091147077 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214091147077 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214091147077 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214091147077 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214091147091 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214091147107 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214091147107 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214091147107 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:11:49.961240 run osmo-msc_10.42.42.6(pid=32211): ERR: Terminated: ERROR {rc=2} [trial-2402↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32211)] 09:11:50.008495 run osmo-msc_10.42.42.6(pid=32211): stdout: | (launched: 2022-12-14_09:11:48.901686) 09:11:50.057738 run osmo-msc_10.42.42.6(pid=32211): stderr: | 20221214091149167 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214091149167 DLGLOBAL DEBUG validating counter group 0x7f816aefdc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214091149167 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214091149168 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214091149168 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214091149168 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214091149170 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214091149170 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214091149170 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214091149170 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:11:50.107291 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32204): Terminating (SIGTERM) 09:11:50.146855 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32207): Terminating (SIGTERM) 09:11:50.186339 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32210): Terminating (SIGTERM) 09:11:50.225977 --- ParallelTerminationStrategy: PID 32204 died... 09:11:50.245390 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32204): Terminated: ok {rc=0} 09:11:50.289409 --- ParallelTerminationStrategy: PID 32207 died... 09:11:50.308076 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32207): Terminated: ok {rc=0} 09:11:50.351889 --- ParallelTerminationStrategy: PID 32210 died... 09:11:50.370677 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32210): Terminated: ok {rc=0} 09:11:50.453982 bus /sierra_3: Setting Powered False 09:11:51.551268 bus /sierra_3: Setting Powered False 09:11:52.668777 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2402 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 09:11:53.914536 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:11:53.921309 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 09:11:53.953655 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 09:11:53.980778 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 09:11:54.031995 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 09:11:54.064773 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 09:11:54.092152 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 09:11:54.646601 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2402 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 09:11:54.696000 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 09:11:54.707224 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 09:11:54.776352 tst mo_mt_call.py: using LAC 39893 09:11:54.891918 tst mo_mt_call.py: using RAC 113 09:11:55.006937 tst mo_mt_call.py: using CellId 39893 09:11:55.122538 tst mo_mt_call.py: using BVCI 39894 09:11:55.233098 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 09:11:55.244140 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 09:11:55.255179 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 09:11:55.266033 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 09:11:55.277856 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 09:11:55.289719 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 09:11:55.406486 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 09:11:55.524711 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:11:56.018218 run create_hlr_db(pid=32216): Launched 09:11:56.146948 bus /sierra_2: Setting Powered False 09:11:57.209697 run create_hlr_db(pid=32216): Terminated: ok {rc=0} 09:11:57.650605 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32218): Launched 09:11:57.968472 run osmo-hlr_10.42.42.2(pid=32219): Launched 09:11:58.090162 run osmo-stp_10.42.42.5: Starting osmo-stp 09:11:58.637256 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32221): Launched 09:11:58.954294 run osmo-stp_10.42.42.5(pid=32222): Launched 09:11:59.074841 run osmo-msc_10.42.42.6: Starting osmo-msc 09:11:59.650100 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32224): Launched 09:11:59.968807 run osmo-msc_10.42.42.6(pid=32225): Launched 09:12:00.145544 run osmo-stp_10.42.42.5(pid=32222): ERR: Terminated: ERROR {rc=1} [trial-2402↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32222)] 09:12:00.279480 run osmo-stp_10.42.42.5(pid=32222): stdout: | (launched: 2022-12-14_09:11:58.895787) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:12:00.415021 run osmo-stp_10.42.42.5(pid=32222): stderr: | 20221214091159083 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214091159083 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214091159083 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214091159084 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214091159084 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214091159084 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214091159084 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:12:00.549170 run osmo-stp_10.42.42.5(pid=32222): stdout: | (launched: 2022-12-14_09:11:58.895787) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:12:00.675510 run osmo-stp_10.42.42.5(pid=32222): stderr: | 20221214091159083 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214091159083 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214091159083 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214091159084 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214091159084 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214091159084 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214091159084 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:12:00.827421 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32222): Process ended prematurely: osmo-stp_10.42.42.5(pid=32222) [trial-2402↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32222)] [trial-2402↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 09:12:00.851683 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 09:12:00.884611 run osmo-hlr_10.42.42.2(pid=32219): ERR: Terminated: ERROR {rc=237} [trial-2402↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32219)] 09:12:00.941166 run osmo-hlr_10.42.42.2(pid=32219): stdout: | (launched: 2022-12-14_09:11:57.910765) 09:12:00.992207 run osmo-hlr_10.42.42.2(pid=32219): stderr: | 20221214091158105 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214091158105 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214091158105 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214091158105 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214091158105 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214091158105 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214091158162 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214091158171 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214091158171 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214091158171 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:12:01.066437 run osmo-msc_10.42.42.6(pid=32225): ERR: Terminated: ERROR {rc=2} [trial-2402↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32225)] 09:12:01.115657 run osmo-msc_10.42.42.6(pid=32225): stdout: | (launched: 2022-12-14_09:11:59.910386) 09:12:01.169462 run osmo-msc_10.42.42.6(pid=32225): stderr: | 20221214091200229 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214091200229 DLGLOBAL DEBUG validating counter group 0x7f84257bfc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214091200229 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214091200229 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214091200229 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214091200230 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214091200231 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214091200232 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214091200232 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214091200232 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:12:01.222407 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32218): Terminating (SIGTERM) 09:12:01.265386 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32221): Terminating (SIGTERM) 09:12:01.309487 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32224): Terminating (SIGTERM) 09:12:01.356000 --- ParallelTerminationStrategy: PID 32218 died... 09:12:01.377208 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32218): Terminated: ok {rc=0} 09:12:01.426073 --- ParallelTerminationStrategy: PID 32221 died... 09:12:01.447081 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32221): Terminated: ok {rc=0} 09:12:01.493720 --- ParallelTerminationStrategy: PID 32224 died... 09:12:01.514816 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32224): Terminated: ok {rc=0} 09:12:01.604896 bus /sierra_3: Setting Powered False 09:12:02.702071 bus /sierra_3: Setting Powered False 09:12:03.815285 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2402 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 09:12:04.961597 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 09:12:04.973916 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 09:12:05.045994 tst mo_mt_call_osmux.py: using LAC 39894 09:12:05.176791 tst mo_mt_call_osmux.py: using RAC 114 09:12:05.302684 tst mo_mt_call_osmux.py: using CellId 39894 09:12:05.427170 tst mo_mt_call_osmux.py: using BVCI 39895 09:12:05.543360 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 09:12:05.555092 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 09:12:05.566533 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 09:12:05.577926 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 09:12:05.589386 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 09:12:05.600686 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 09:12:05.719177 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 09:12:05.835134 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:12:06.299934 run create_hlr_db(pid=32227): Launched 09:12:06.414453 bus /sierra_2: Setting Powered False 09:12:07.474204 run create_hlr_db(pid=32227): Terminated: ok {rc=0} 09:12:07.909266 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32229): Launched 09:12:08.228405 run osmo-hlr_10.42.42.2(pid=32230): Launched 09:12:08.350014 run osmo-stp_10.42.42.5: Starting osmo-stp 09:12:08.899376 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32232): Launched 09:12:09.217720 run osmo-stp_10.42.42.5(pid=32233): Launched 09:12:09.338208 run osmo-msc_10.42.42.6: Starting osmo-msc 09:12:09.916825 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32235): Launched 09:12:10.236548 run osmo-msc_10.42.42.6(pid=32236): Launched 09:12:10.415054 run osmo-stp_10.42.42.5(pid=32233): ERR: Terminated: ERROR {rc=1} [trial-2402↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32233)] 09:12:10.548659 run osmo-stp_10.42.42.5(pid=32233): stdout: | (launched: 2022-12-14_09:12:09.159327) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:12:10.683678 run osmo-stp_10.42.42.5(pid=32233): stderr: | 20221214091209346 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214091209346 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214091209346 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214091209347 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214091209347 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214091209347 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214091209347 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:12:10.817612 run osmo-stp_10.42.42.5(pid=32233): stdout: | (launched: 2022-12-14_09:12:09.159327) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:12:10.944173 run osmo-stp_10.42.42.5(pid=32233): stderr: | 20221214091209346 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214091209346 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214091209346 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214091209347 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214091209347 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214091209347 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214091209347 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:12:11.096578 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32233): Process ended prematurely: osmo-stp_10.42.42.5(pid=32233) [trial-2402↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32233)] [trial-2402↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 09:12:11.106237 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 09:12:11.134023 run osmo-hlr_10.42.42.2(pid=32230): ERR: Terminated: ERROR {rc=237} [trial-2402↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32230)] 09:12:11.184449 run osmo-hlr_10.42.42.2(pid=32230): stdout: | (launched: 2022-12-14_09:12:08.170110) 09:12:11.236695 run osmo-hlr_10.42.42.2(pid=32230): stderr: | 20221214091208363 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214091208363 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214091208363 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214091208363 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214091208363 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214091208363 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214091208421 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214091208431 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214091208431 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214091208431 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:12:11.309603 run osmo-msc_10.42.42.6(pid=32236): ERR: Terminated: ERROR {rc=2} [trial-2402↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32236)] 09:12:11.360078 run osmo-msc_10.42.42.6(pid=32236): stdout: | (launched: 2022-12-14_09:12:10.178044) 09:12:11.412371 run osmo-msc_10.42.42.6(pid=32236): stderr: | 20221214091210495 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214091210495 DLGLOBAL DEBUG validating counter group 0x7f28a9caac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214091210495 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214091210495 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214091210496 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214091210496 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214091210498 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214091210498 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214091210498 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214091210498 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:12:11.464914 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32229): Terminating (SIGTERM) 09:12:11.506783 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32232): Terminating (SIGTERM) 09:12:11.548694 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32235): Terminating (SIGTERM) 09:12:11.591671 --- ParallelTerminationStrategy: PID 32229 died... 09:12:11.611979 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32229): Terminated: ok {rc=0} 09:12:11.658369 --- ParallelTerminationStrategy: PID 32232 died... 09:12:11.678155 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32232): Terminated: ok {rc=0} 09:12:11.724246 --- ParallelTerminationStrategy: PID 32235 died... 09:12:11.744024 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32235): Terminated: ok {rc=0} 09:12:11.831893 bus /sierra_3: Setting Powered False 09:12:12.931011 bus /sierra_3: Setting Powered False 09:12:14.045967 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2402 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 09:12:15.302603 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:12:15.310555 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 09:12:15.343789 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 09:12:15.370556 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 09:12:15.420617 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 09:12:15.453537 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 09:12:15.480368 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 09:12:16.053553 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2402 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 09:12:16.110841 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:12:16.122451 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 09:12:16.193225 tst mo_mt_call.py: using LAC 39895 09:12:16.324044 tst mo_mt_call.py: using RAC 115 09:12:16.453462 tst mo_mt_call.py: using CellId 39895 09:12:16.584454 tst mo_mt_call.py: using BVCI 39896 09:12:16.708338 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:12:16.721040 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:12:16.733526 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:12:16.745905 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:12:16.759006 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:12:16.771824 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 09:12:16.896730 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 09:12:17.028058 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:12:17.499244 run create_hlr_db(pid=32241): Launched 09:12:17.613360 bus /sierra_2: Setting Powered False 09:12:18.672725 run create_hlr_db(pid=32241): Terminated: ok {rc=0} 09:12:19.106508 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32243): Launched 09:12:19.426404 run osmo-hlr_10.42.42.2(pid=32244): Launched 09:12:19.547375 run osmo-stp_10.42.42.5: Starting osmo-stp 09:12:20.096372 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32246): Launched 09:12:20.415438 run osmo-stp_10.42.42.5(pid=32247): Launched 09:12:20.537067 run osmo-msc_10.42.42.6: Starting osmo-msc 09:12:21.114508 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32249): Launched 09:12:21.431848 run osmo-msc_10.42.42.6(pid=32250): Launched 09:12:21.609774 run osmo-stp_10.42.42.5(pid=32247): ERR: Terminated: ERROR {rc=1} [trial-2402↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32247)] 09:12:21.743484 run osmo-stp_10.42.42.5(pid=32247): stdout: | (launched: 2022-12-14_09:12:20.356073) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:12:21.879906 run osmo-stp_10.42.42.5(pid=32247): stderr: | 20221214091220543 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214091220544 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214091220544 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214091220544 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214091220545 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214091220545 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214091220545 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:12:22.013183 run osmo-stp_10.42.42.5(pid=32247): stdout: | (launched: 2022-12-14_09:12:20.356073) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:12:22.139832 run osmo-stp_10.42.42.5(pid=32247): stderr: | 20221214091220543 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214091220544 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214091220544 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214091220544 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214091220545 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214091220545 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214091220545 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:12:22.290713 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32247): Process ended prematurely: osmo-stp_10.42.42.5(pid=32247) [trial-2402↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32247)] [trial-2402↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 09:12:22.300301 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 09:12:22.328095 run osmo-hlr_10.42.42.2(pid=32244): ERR: Terminated: ERROR {rc=237} [trial-2402↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32244)] 09:12:22.378287 run osmo-hlr_10.42.42.2(pid=32244): stdout: | (launched: 2022-12-14_09:12:19.367679) 09:12:22.430183 run osmo-hlr_10.42.42.2(pid=32244): stderr: | 20221214091219561 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214091219561 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214091219562 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214091219562 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214091219562 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214091219562 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214091219577 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214091219585 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214091219585 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214091219585 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:12:22.501956 run osmo-msc_10.42.42.6(pid=32250): ERR: Terminated: ERROR {rc=2} [trial-2402↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32250)] 09:12:22.551801 run osmo-msc_10.42.42.6(pid=32250): stdout: | (launched: 2022-12-14_09:12:21.373143) 09:12:22.603376 run osmo-msc_10.42.42.6(pid=32250): stderr: | 20221214091221690 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214091221690 DLGLOBAL DEBUG validating counter group 0x7f354ee8fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214091221690 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214091221690 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214091221691 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214091221691 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214091221693 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214091221693 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214091221693 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214091221693 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:12:22.655340 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32243): Terminating (SIGTERM) 09:12:22.696757 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32246): Terminating (SIGTERM) 09:12:22.738828 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32249): Terminating (SIGTERM) 09:12:22.780456 --- ParallelTerminationStrategy: PID 32243 died... 09:12:22.800496 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32243): Terminated: ok {rc=0} 09:12:22.846621 --- ParallelTerminationStrategy: PID 32246 died... 09:12:22.866276 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32246): Terminated: ok {rc=0} 09:12:22.912562 --- ParallelTerminationStrategy: PID 32249 died... 09:12:22.932244 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32249): Terminated: ok {rc=0} 09:12:23.019969 bus /sierra_3: Setting Powered False 09:12:24.118724 bus /sierra_3: Setting Powered False 09:12:25.233536 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2402 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 09:12:26.382283 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:12:26.394506 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 09:12:26.465735 tst mo_mt_call_osmux.py: using LAC 39896 09:12:26.592579 tst mo_mt_call_osmux.py: using RAC 116 09:12:26.717626 tst mo_mt_call_osmux.py: using CellId 39896 09:12:26.843614 tst mo_mt_call_osmux.py: using BVCI 39897 09:12:26.961217 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:12:26.972725 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:12:26.984102 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:12:26.995471 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:12:27.006926 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:12:27.018470 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 09:12:27.136327 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 09:12:27.253259 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:12:27.716287 run create_hlr_db(pid=32252): Launched 09:12:27.830116 bus /sierra_2: Setting Powered False 09:12:28.890051 run create_hlr_db(pid=32252): Terminated: ok {rc=0} 09:12:29.304635 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32254): Launched 09:12:29.602769 run osmo-hlr_10.42.42.2(pid=32255): Launched 09:12:29.716646 run osmo-stp_10.42.42.5: Starting osmo-stp 09:12:30.242795 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32257): Launched 09:12:30.539460 run osmo-stp_10.42.42.5(pid=32258): Launched 09:12:30.653449 run osmo-msc_10.42.42.6: Starting osmo-msc 09:12:31.213239 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32260): Launched 09:12:31.529765 run osmo-msc_10.42.42.6(pid=32261): Launched 09:12:32.102442 run osmo-stp_10.42.42.5(pid=32258): ERR: Terminated: ERROR {rc=1} [trial-2402↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32258)] 09:12:32.252136 run osmo-stp_10.42.42.5(pid=32258): stdout: | (launched: 2022-12-14_09:12:30.484813) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:12:32.388622 run osmo-stp_10.42.42.5(pid=32258): stderr: | 20221214091230651 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214091230651 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214091230651 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214091230651 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214091230652 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214091230652 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214091230652 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:12:32.522848 run osmo-stp_10.42.42.5(pid=32258): stdout: | (launched: 2022-12-14_09:12:30.484813) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:12:32.649906 run osmo-stp_10.42.42.5(pid=32258): stderr: | 20221214091230651 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214091230651 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214091230651 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214091230651 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214091230652 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214091230652 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214091230652 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:12:32.801681 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32258): Process ended prematurely: osmo-stp_10.42.42.5(pid=32258) [trial-2402↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32258)] [trial-2402↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 09:12:32.811641 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 09:12:32.839968 run osmo-hlr_10.42.42.2(pid=32255): ERR: Terminated: ERROR {rc=237} [trial-2402↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32255)] 09:12:32.891041 run osmo-hlr_10.42.42.2(pid=32255): stdout: | (launched: 2022-12-14_09:12:29.547870) 09:12:32.944040 run osmo-hlr_10.42.42.2(pid=32255): stderr: | 20221214091229719 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214091229719 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214091229719 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214091229719 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214091229719 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214091229719 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214091229731 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214091229739 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214091229740 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214091229740 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:12:33.018219 run osmo-msc_10.42.42.6(pid=32261): ERR: Terminated: ERROR {rc=2} [trial-2402↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32261)] 09:12:33.069120 run osmo-msc_10.42.42.6(pid=32261): stdout: | (launched: 2022-12-14_09:12:31.472857) 09:12:33.121731 run osmo-msc_10.42.42.6(pid=32261): stderr: | 20221214091231894 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214091231895 DLGLOBAL DEBUG validating counter group 0x7f276a014c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214091231895 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214091231895 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214091231897 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214091231897 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214091231902 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214091231903 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214091231904 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214091231904 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:12:33.174669 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32254): Terminating (SIGTERM) 09:12:33.216986 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32257): Terminating (SIGTERM) 09:12:33.259390 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32260): Terminating (SIGTERM) 09:12:33.301928 --- ParallelTerminationStrategy: PID 32254 died... 09:12:33.322394 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32254): Terminated: ok {rc=0} 09:12:33.369276 --- ParallelTerminationStrategy: PID 32257 died... 09:12:33.389338 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32257): Terminated: ok {rc=0} 09:12:33.436278 --- ParallelTerminationStrategy: PID 32260 died... 09:12:33.456380 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32260): Terminated: ok {rc=0} 09:12:33.545490 bus /sierra_3: Setting Powered False 09:12:34.644566 bus /sierra_3: Setting Powered False 09:12:35.760665 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2402 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 09:12:37.007493 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:12:37.014090 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 09:12:37.046559 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 09:12:37.074870 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 09:12:37.127296 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 09:12:37.161505 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 09:12:37.191081 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 09:12:37.738560 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2402 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 09:12:37.787244 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:12:37.798804 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 09:12:37.868600 tst mo_mt_call.py: using LAC 39897 09:12:37.986248 tst mo_mt_call.py: using RAC 117 09:12:38.106152 tst mo_mt_call.py: using CellId 39897 09:12:38.226180 tst mo_mt_call.py: using BVCI 39898 09:12:38.337130 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:12:38.348316 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:12:38.359298 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:12:38.370432 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:12:38.382190 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:12:38.394106 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 09:12:38.513170 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 09:12:38.628606 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:12:39.093087 run create_hlr_db(pid=32266): Launched 09:12:39.207159 bus /sierra_2: Setting Powered False 09:12:40.265610 run create_hlr_db(pid=32266): Terminated: ok {rc=0} 09:12:40.681714 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32268): Launched 09:12:40.981025 run osmo-hlr_10.42.42.2(pid=32269): Launched 09:12:41.094593 run osmo-stp_10.42.42.5: Starting osmo-stp 09:12:41.621706 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32271): Launched 09:12:41.920233 run osmo-stp_10.42.42.5(pid=32272): Launched 09:12:42.034100 run osmo-msc_10.42.42.6: Starting osmo-msc 09:12:42.574701 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32274): Launched 09:12:42.873165 run osmo-msc_10.42.42.6(pid=32275): Launched 09:12:43.042992 run osmo-stp_10.42.42.5(pid=32272): ERR: Terminated: ERROR {rc=1} [trial-2402↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32272)] 09:12:43.169314 run osmo-stp_10.42.42.5(pid=32272): stdout: | (launched: 2022-12-14_09:12:41.865417) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:12:43.295539 run osmo-stp_10.42.42.5(pid=32272): stderr: | 20221214091242031 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214091242031 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214091242031 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214091242032 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214091242032 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214091242032 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214091242032 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:12:43.419849 run osmo-stp_10.42.42.5(pid=32272): stdout: | (launched: 2022-12-14_09:12:41.865417) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:12:43.538248 run osmo-stp_10.42.42.5(pid=32272): stderr: | 20221214091242031 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214091242031 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214091242031 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214091242032 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214091242032 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214091242032 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214091242032 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:12:43.679570 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32272): Process ended prematurely: osmo-stp_10.42.42.5(pid=32272) [trial-2402↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32272)] [trial-2402↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 09:12:43.688521 tst mo_mt_call.py:8: Test FAILED (5.9 sec) 09:12:43.714888 run osmo-hlr_10.42.42.2(pid=32269): ERR: Terminated: ERROR {rc=237} [trial-2402↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32269)] 09:12:43.762941 run osmo-hlr_10.42.42.2(pid=32269): stdout: | (launched: 2022-12-14_09:12:40.925665) 09:12:43.813061 run osmo-hlr_10.42.42.2(pid=32269): stderr: | 20221214091241098 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214091241098 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214091241098 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214091241098 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214091241098 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214091241098 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214091241110 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214091241119 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214091241119 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214091241119 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:12:43.882685 run osmo-msc_10.42.42.6(pid=32275): ERR: Terminated: ERROR {rc=2} [trial-2402↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32275)] 09:12:43.930114 run osmo-msc_10.42.42.6(pid=32275): stdout: | (launched: 2022-12-14_09:12:42.818077) 09:12:43.979552 run osmo-msc_10.42.42.6(pid=32275): stderr: | 20221214091243085 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214091243085 DLGLOBAL DEBUG validating counter group 0x7fb6f1f9fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214091243085 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214091243085 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214091243085 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214091243085 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214091243087 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214091243087 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214091243088 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214091243088 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:12:44.029258 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32268): Terminating (SIGTERM) 09:12:44.068861 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32271): Terminating (SIGTERM) 09:12:44.108330 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32274): Terminating (SIGTERM) 09:12:44.148115 --- ParallelTerminationStrategy: PID 32268 died... 09:12:44.167128 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32268): Terminated: ok {rc=0} 09:12:44.211147 --- ParallelTerminationStrategy: PID 32271 died... 09:12:44.229901 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32271): Terminated: ok {rc=0} 09:12:44.273345 --- ParallelTerminationStrategy: PID 32274 died... 09:12:44.291999 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32274): Terminated: ok {rc=0} 09:12:44.377850 bus /sierra_3: Setting Powered False 09:12:45.476425 bus /sierra_3: Setting Powered False 09:12:46.595684 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2402 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 09:12:47.747497 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:12:47.759944 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 09:12:47.833516 tst mo_mt_call_osmux.py: using LAC 39898 09:12:47.954039 tst mo_mt_call_osmux.py: using RAC 118 09:12:48.071473 tst mo_mt_call_osmux.py: using CellId 39898 09:12:48.188935 tst mo_mt_call_osmux.py: using BVCI 39899 09:12:48.298321 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:12:48.309642 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:12:48.320769 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:12:48.332026 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:12:48.343291 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:12:48.355044 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 09:12:48.475689 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 09:12:48.590885 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:12:49.056608 run create_hlr_db(pid=32277): Launched 09:12:49.171904 bus /sierra_2: Setting Powered False 09:12:50.230948 run create_hlr_db(pid=32277): Terminated: ok {rc=0} 09:12:50.666776 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32279): Launched 09:12:50.985977 run osmo-hlr_10.42.42.2(pid=32280): Launched 09:12:51.108619 run osmo-stp_10.42.42.5: Starting osmo-stp 09:12:51.663515 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32282): Launched 09:12:51.981299 run osmo-stp_10.42.42.5(pid=32283): Launched 09:12:52.102156 run osmo-msc_10.42.42.6: Starting osmo-msc 09:12:52.685554 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32285): Launched 09:12:53.004455 run osmo-msc_10.42.42.6(pid=32286): Launched 09:12:53.182244 run osmo-stp_10.42.42.5(pid=32283): ERR: Terminated: ERROR {rc=1} [trial-2402↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32283)] 09:12:53.315954 run osmo-stp_10.42.42.5(pid=32283): stdout: | (launched: 2022-12-14_09:12:51.923160) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:12:53.450640 run osmo-stp_10.42.42.5(pid=32283): stderr: | 20221214091252112 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214091252112 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214091252112 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214091252113 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214091252113 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214091252113 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214091252114 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:12:53.583815 run osmo-stp_10.42.42.5(pid=32283): stdout: | (launched: 2022-12-14_09:12:51.923160) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:12:53.710715 run osmo-stp_10.42.42.5(pid=32283): stderr: | 20221214091252112 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214091252112 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214091252112 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214091252113 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214091252113 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214091252113 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214091252114 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:12:53.861958 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32283): Process ended prematurely: osmo-stp_10.42.42.5(pid=32283) [trial-2402↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32283)] [trial-2402↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 09:12:53.871551 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 09:12:53.899226 run osmo-hlr_10.42.42.2(pid=32280): ERR: Terminated: ERROR {rc=237} [trial-2402↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32280)] 09:12:53.948810 run osmo-hlr_10.42.42.2(pid=32280): stdout: | (launched: 2022-12-14_09:12:50.927095) 09:12:54.000234 run osmo-hlr_10.42.42.2(pid=32280): stderr: | 20221214091251120 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214091251120 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214091251120 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214091251120 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214091251120 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214091251120 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214091251133 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214091251141 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214091251142 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214091251142 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:12:54.072044 run osmo-msc_10.42.42.6(pid=32286): ERR: Terminated: ERROR {rc=2} [trial-2402↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32286)] 09:12:54.121705 run osmo-msc_10.42.42.6(pid=32286): stdout: | (launched: 2022-12-14_09:12:52.945954) 09:12:54.173158 run osmo-msc_10.42.42.6(pid=32286): stderr: | 20221214091253265 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214091253265 DLGLOBAL DEBUG validating counter group 0x7f28bc963c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214091253265 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214091253265 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214091253265 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214091253265 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214091253267 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214091253267 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214091253267 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214091253267 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:12:54.224875 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32279): Terminating (SIGTERM) 09:12:54.265936 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32282): Terminating (SIGTERM) 09:12:54.307229 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32285): Terminating (SIGTERM) 09:12:54.348688 --- ParallelTerminationStrategy: PID 32279 died... 09:12:54.368479 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32279): Terminated: ok {rc=0} 09:12:54.414191 --- ParallelTerminationStrategy: PID 32282 died... 09:12:54.433832 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32282): Terminated: ok {rc=0} 09:12:54.479285 --- ParallelTerminationStrategy: PID 32285 died... 09:12:54.498891 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32285): Terminated: ok {rc=0} 09:12:54.586065 bus /sierra_3: Setting Powered False 09:12:55.684399 bus /sierra_3: Setting Powered False 09:12:56.798972 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2402 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 voice:trx-lms+mod-bts0-dynts-osmo --------------------------------------------------------------------- 09:12:58.053857 tst voice:trx-lms+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:12:58.060215 tst voice:trx-lms+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 09:12:58.094106 tst voice:trx-lms+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 09:12:58.121577 tst voice:trx-lms+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 09:12:58.175043 tst voice:trx-lms+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 09:12:58.208738 tst voice:trx-lms+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 09:12:58.235757 tst voice:trx-lms+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 09:12:58.789755 tst voice:trx-lms+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2402 voice:trx-lms+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 09:12:58.842749 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 09:12:58.854319 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 09:12:58.925138 tst mo_mt_call.py: using LAC 39899 09:12:59.049059 tst mo_mt_call.py: using RAC 119 09:12:59.173316 tst mo_mt_call.py: using CellId 39899 09:12:59.296427 tst mo_mt_call.py: using BVCI 39900 09:12:59.413523 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 09:12:59.425339 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 09:12:59.436894 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 09:12:59.448491 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 09:12:59.459896 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 09:12:59.471278 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 09:12:59.588305 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 09:12:59.703902 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:13:00.169471 run create_hlr_db(pid=32291): Launched 09:13:00.284569 bus /sierra_2: Setting Powered False 09:13:01.345825 run create_hlr_db(pid=32291): Terminated: ok {rc=0} 09:13:01.781703 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32293): Launched 09:13:02.100352 run osmo-hlr_10.42.42.2(pid=32294): Launched 09:13:02.257865 run osmo-stp_10.42.42.5: Starting osmo-stp 09:13:02.774432 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32296): Launched 09:13:03.076156 run osmo-stp_10.42.42.5(pid=32297): Launched 09:13:03.189983 run osmo-msc_10.42.42.6: Starting osmo-msc 09:13:03.732164 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32299): Launched 09:13:04.031371 run osmo-msc_10.42.42.6(pid=32300): Launched 09:13:04.200532 run osmo-stp_10.42.42.5(pid=32297): ERR: Terminated: ERROR {rc=1} [trial-2402↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32297)] 09:13:04.327367 run osmo-stp_10.42.42.5(pid=32297): stdout: | (launched: 2022-12-14_09:13:03.020517) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:13:04.455092 run osmo-stp_10.42.42.5(pid=32297): stderr: | 20221214091303187 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214091303187 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214091303187 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214091303188 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214091303188 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214091303188 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214091303188 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:13:04.579586 run osmo-stp_10.42.42.5(pid=32297): stdout: | (launched: 2022-12-14_09:13:03.020517) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:13:04.698303 run osmo-stp_10.42.42.5(pid=32297): stderr: | 20221214091303187 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214091303187 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214091303187 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214091303188 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214091303188 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214091303188 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214091303188 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:13:04.840396 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32297): Process ended prematurely: osmo-stp_10.42.42.5(pid=32297) [trial-2402↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32297)] [trial-2402↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 09:13:04.849512 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 09:13:04.875726 run osmo-hlr_10.42.42.2(pid=32294): ERR: Terminated: ERROR {rc=237} [trial-2402↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32294)] 09:13:04.923548 run osmo-hlr_10.42.42.2(pid=32294): stdout: | (launched: 2022-12-14_09:13:02.037922) 09:13:04.972704 run osmo-hlr_10.42.42.2(pid=32294): stderr: | 20221214091302273 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214091302273 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214091302274 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214091302274 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214091302274 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214091302274 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214091302286 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/voice:trx-lms+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214091302294 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214091302294 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214091302294 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:13:05.042494 run osmo-msc_10.42.42.6(pid=32300): ERR: Terminated: ERROR {rc=2} [trial-2402↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32300)] 09:13:05.089822 run osmo-msc_10.42.42.6(pid=32300): stdout: | (launched: 2022-12-14_09:13:03.976602) 09:13:05.138883 run osmo-msc_10.42.42.6(pid=32300): stderr: | 20221214091304243 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214091304244 DLGLOBAL DEBUG validating counter group 0x7fc802ea0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214091304244 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214091304244 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214091304244 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214091304244 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214091304246 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214091304246 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214091304246 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214091304247 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:13:05.188229 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32293): Terminating (SIGTERM) 09:13:05.227818 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32296): Terminating (SIGTERM) 09:13:05.267529 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32299): Terminating (SIGTERM) 09:13:05.307211 --- ParallelTerminationStrategy: PID 32293 died... 09:13:05.326629 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32293): Terminated: ok {rc=0} 09:13:05.370525 --- ParallelTerminationStrategy: PID 32296 died... 09:13:05.389192 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32296): Terminated: ok {rc=0} 09:13:05.432726 --- ParallelTerminationStrategy: PID 32299 died... 09:13:05.451552 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32299): Terminated: ok {rc=0} 09:13:05.537530 bus /sierra_3: Setting Powered False 09:13:06.635955 bus /sierra_3: Setting Powered False 09:13:07.750019 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2402 voice:trx-lms+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 09:13:08.894226 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 09:13:08.905684 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 09:13:08.976165 tst mo_mt_call_osmux.py: using LAC 39900 09:13:09.104149 tst mo_mt_call_osmux.py: using RAC 120 09:13:09.229429 tst mo_mt_call_osmux.py: using CellId 39900 09:13:09.356354 tst mo_mt_call_osmux.py: using BVCI 39901 09:13:09.472888 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 09:13:09.484366 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 09:13:09.495826 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 09:13:09.507079 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 09:13:09.518442 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 09:13:09.529648 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 09:13:09.643646 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 09:13:09.761492 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:13:10.256631 run create_hlr_db(pid=32302): Launched 09:13:10.386666 bus /sierra_2: Setting Powered False 09:13:11.450680 run create_hlr_db(pid=32302): Terminated: ok {rc=0} 09:13:11.878097 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32304): Launched 09:13:12.179501 run osmo-hlr_10.42.42.2(pid=32305): Launched 09:13:12.293409 run osmo-stp_10.42.42.5: Starting osmo-stp 09:13:12.820386 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32307): Launched 09:13:13.118496 run osmo-stp_10.42.42.5(pid=32308): Launched 09:13:13.232267 run osmo-msc_10.42.42.6: Starting osmo-msc 09:13:13.771385 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32310): Launched 09:13:14.069088 run osmo-msc_10.42.42.6(pid=32311): Launched 09:13:14.235657 run osmo-stp_10.42.42.5(pid=32308): ERR: Terminated: ERROR {rc=1} [trial-2402↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32308)] 09:13:14.361644 run osmo-stp_10.42.42.5(pid=32308): stdout: | (launched: 2022-12-14_09:13:13.063211) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:13:14.487988 run osmo-stp_10.42.42.5(pid=32308): stderr: | 20221214091313230 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214091313230 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214091313231 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214091313231 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214091313231 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214091313232 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214091313232 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:13:14.612570 run osmo-stp_10.42.42.5(pid=32308): stdout: | (launched: 2022-12-14_09:13:13.063211) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:13:14.731283 run osmo-stp_10.42.42.5(pid=32308): stderr: | 20221214091313230 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214091313230 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214091313231 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214091313231 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214091313231 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214091313232 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214091313232 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:13:14.874155 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32308): Process ended prematurely: osmo-stp_10.42.42.5(pid=32308) [trial-2402↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32308)] [trial-2402↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 09:13:14.883077 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 09:13:14.909395 run osmo-hlr_10.42.42.2(pid=32305): ERR: Terminated: ERROR {rc=237} [trial-2402↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32305)] 09:13:14.957573 run osmo-hlr_10.42.42.2(pid=32305): stdout: | (launched: 2022-12-14_09:13:12.124428) 09:13:15.006653 run osmo-hlr_10.42.42.2(pid=32305): stderr: | 20221214091312294 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214091312294 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214091312294 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214091312294 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214091312294 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214091312294 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214091312307 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/voice:trx-lms+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214091312317 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214091312317 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214091312317 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:13:15.075570 run osmo-msc_10.42.42.6(pid=32311): ERR: Terminated: ERROR {rc=2} [trial-2402↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32311)] 09:13:15.124006 run osmo-msc_10.42.42.6(pid=32311): stdout: | (launched: 2022-12-14_09:13:14.014149) 09:13:15.173542 run osmo-msc_10.42.42.6(pid=32311): stderr: | 20221214091314282 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214091314282 DLGLOBAL DEBUG validating counter group 0x7f9152df1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214091314282 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214091314282 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214091314282 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214091314283 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214091314284 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214091314285 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214091314285 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214091314285 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:13:15.223009 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32304): Terminating (SIGTERM) 09:13:15.262803 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32307): Terminating (SIGTERM) 09:13:15.302555 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32310): Terminating (SIGTERM) 09:13:15.342572 --- ParallelTerminationStrategy: PID 32304 died... 09:13:15.362075 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32304): Terminated: ok {rc=0} 09:13:15.406106 --- ParallelTerminationStrategy: PID 32307 died... 09:13:15.424927 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32307): Terminated: ok {rc=0} 09:13:15.469222 --- ParallelTerminationStrategy: PID 32310 died... 09:13:15.488114 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32310): Terminated: ok {rc=0} 09:13:15.574952 bus /sierra_3: Setting Powered False 09:13:16.674449 bus /sierra_3: Setting Powered False 09:13:17.793918 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2402 voice:trx-lms+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 emergency:trx-lms --------------------------------------------------------------------- 09:13:19.047340 tst emergency:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:13:19.052061 tst emergency:trx-lms: Verifying 1 x bts (candidates: 11) 09:13:19.085819 tst emergency:trx-lms: Verifying 6 x ip_address (candidates: 9) 09:13:19.113426 tst emergency:trx-lms: Verifying 4 x modem (candidates: 12) 09:13:19.199802 tst emergency:trx-lms: Reserving 1 x bts (candidates: 11) 09:13:19.233966 tst emergency:trx-lms: Reserving 6 x ip_address (candidates: 9) 09:13:19.261575 tst emergency:trx-lms: Reserving 4 x modem (candidates: 12) 09:13:19.845933 tst emergency:trx-lms: RESERVED RESOURCES for emergency: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2402 emergency:trx-lms emergency_mo_mt_call.py ---------------------------------------------- 09:13:19.852096 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 09:13:19.863712 tst emergency:trx-lms: Using 1 x bts (candidates: 1) 09:13:19.912387 tst emergency_mo_mt_call.py: using LAC 39901 09:13:20.027586 tst emergency_mo_mt_call.py: using RAC 121 09:13:20.142417 tst emergency_mo_mt_call.py: using CellId 39901 09:13:20.256778 tst emergency_mo_mt_call.py: using BVCI 39902 09:13:20.362624 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 09:13:20.373267 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 09:13:20.383578 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 09:13:20.394015 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 09:13:20.404339 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 09:13:20.415903 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 09:13:20.534341 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 09:13:20.654446 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:13:21.138239 run create_hlr_db(pid=32316): Launched 09:13:21.265970 bus /sierra_2: Setting Powered False 09:13:22.327887 run create_hlr_db(pid=32316): Terminated: ok {rc=0} 09:13:22.746061 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32318): Launched 09:13:23.038488 run osmo-hlr_10.42.42.2(pid=32319): Launched 09:13:23.149288 run osmo-stp_10.42.42.5: Starting osmo-stp 09:13:23.658475 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32321): Launched 09:13:23.951333 run osmo-stp_10.42.42.5(pid=32322): Launched 09:13:24.072906 tst emergency_mo_mt_call.py: using MSISDN 8605 09:13:24.222988 run osmo-msc_10.42.42.6: Starting osmo-msc 09:13:24.751546 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32324): Launched 09:13:25.044021 run osmo-msc_10.42.42.6(pid=32325): Launched 09:13:25.208092 run osmo-stp_10.42.42.5(pid=32322): ERR: Terminated: ERROR {rc=1} [trial-2402↪emergency:trx-lms↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32322)] 09:13:25.333101 run osmo-stp_10.42.42.5(pid=32322): stdout: | (launched: 2022-12-14_09:13:23.897489) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:13:25.458330 run osmo-stp_10.42.42.5(pid=32322): stderr: | 20221214091324064 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214091324064 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214091324064 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214091324065 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214091324066 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214091324066 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214091324066 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:13:25.581660 run osmo-stp_10.42.42.5(pid=32322): stdout: | (launched: 2022-12-14_09:13:23.897489) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:13:25.698415 run osmo-stp_10.42.42.5(pid=32322): stderr: | 20221214091324064 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214091324064 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214091324064 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214091324065 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214091324066 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214091324066 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214091324066 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:13:25.838083 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=32322): Process ended prematurely: osmo-stp_10.42.42.5(pid=32322) [trial-2402↪emergency:trx-lms↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32322)] [trial-2402↪emergency:trx-lms↪emergency_mo_mt_call.py:19] 09:13:25.846347 tst emergency_mo_mt_call.py:19: Test FAILED (6.0 sec) 09:13:25.872159 run osmo-hlr_10.42.42.2(pid=32319): ERR: Terminated: ERROR {rc=237} [trial-2402↪emergency:trx-lms↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32319)] 09:13:25.919887 run osmo-hlr_10.42.42.2(pid=32319): stdout: | (launched: 2022-12-14_09:13:22.984227) 09:13:25.968896 run osmo-hlr_10.42.42.2(pid=32319): stderr: | 20221214091323152 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214091323152 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214091323152 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214091323152 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214091323152 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214091323152 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214091323164 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/emergency:trx-lms/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214091323173 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214091323173 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214091323173 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:13:26.037705 run osmo-msc_10.42.42.6(pid=32325): ERR: Terminated: ERROR {rc=2} [trial-2402↪emergency:trx-lms↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32325)] 09:13:26.084731 run osmo-msc_10.42.42.6(pid=32325): stdout: | (launched: 2022-12-14_09:13:24.989700) 09:13:26.133755 run osmo-msc_10.42.42.6(pid=32325): stderr: | 20221214091325257 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214091325257 DLGLOBAL DEBUG validating counter group 0x7f1c28249c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214091325257 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214091325257 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214091325257 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214091325258 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214091325259 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214091325260 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214091325260 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214091325260 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:13:26.182963 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32318): Terminating (SIGTERM) 09:13:26.222208 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32321): Terminating (SIGTERM) 09:13:26.261498 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32324): Terminating (SIGTERM) 09:13:26.301331 --- ParallelTerminationStrategy: PID 32318 died... 09:13:26.320459 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32318): Terminated: ok {rc=0} 09:13:26.364366 --- ParallelTerminationStrategy: PID 32321 died... 09:13:26.383020 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32321): Terminated: ok {rc=0} 09:13:26.426378 --- ParallelTerminationStrategy: PID 32324 died... 09:13:26.445134 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32324): Terminated: ok {rc=0} 09:13:26.530382 bus /sierra_3: Setting Powered False 09:13:27.627599 bus /sierra_3: Setting Powered False 09:13:28.737978 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2402 emergency:trx-lms emergency_preemptive_call.py ---------------------------------------------- 09:13:29.822009 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 09:13:29.833980 tst emergency:trx-lms: Using 1 x bts (candidates: 1) 09:13:29.885488 tst emergency_preemptive_call.py: using LAC 39902 09:13:30.008678 tst emergency_preemptive_call.py: using RAC 122 09:13:30.132529 tst emergency_preemptive_call.py: using CellId 39902 09:13:30.256638 tst emergency_preemptive_call.py: using BVCI 39903 09:13:30.370485 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 09:13:30.381646 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 09:13:30.392511 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 09:13:30.403493 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 09:13:30.414468 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 09:13:30.425769 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 09:13:30.543943 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 09:13:30.659380 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 09:13:30.771918 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 09:13:30.891468 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:13:31.387172 run create_hlr_db(pid=32327): Launched 09:13:31.542302 bus /sierra_2: Setting Powered False 09:13:32.600801 run create_hlr_db(pid=32327): Terminated: ok {rc=0} 09:13:33.029978 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32329): Launched 09:13:33.344851 run osmo-hlr_10.42.42.2(pid=32330): Launched 09:13:33.465217 run osmo-stp_10.42.42.5: Starting osmo-stp 09:13:34.007320 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32332): Launched 09:13:34.319919 run osmo-stp_10.42.42.5(pid=32333): Launched 09:13:34.448624 tst emergency_preemptive_call.py: using MSISDN 8606 09:13:34.609841 run osmo-msc_10.42.42.6: Starting osmo-msc 09:13:35.170348 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32335): Launched 09:13:35.483356 run osmo-msc_10.42.42.6(pid=32336): Launched 09:13:35.657228 run osmo-stp_10.42.42.5(pid=32333): ERR: Terminated: ERROR {rc=1} [trial-2402↪emergency:trx-lms↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32333)] 09:13:35.788626 run osmo-stp_10.42.42.5(pid=32333): stdout: | (launched: 2022-12-14_09:13:34.262663) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:13:35.920424 run osmo-stp_10.42.42.5(pid=32333): stderr: | 20221214091334450 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214091334451 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214091334451 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214091334451 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214091334452 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214091334452 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214091334452 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:13:36.051954 run osmo-stp_10.42.42.5(pid=32333): stdout: | (launched: 2022-12-14_09:13:34.262663) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:13:36.175813 run osmo-stp_10.42.42.5(pid=32333): stderr: | 20221214091334450 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214091334451 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214091334451 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214091334451 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214091334452 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214091334452 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214091334452 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:13:36.324271 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=32333): Process ended prematurely: osmo-stp_10.42.42.5(pid=32333) [trial-2402↪emergency:trx-lms↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32333)] [trial-2402↪emergency:trx-lms↪emergency_preemptive_call.py:32] 09:13:36.333484 tst emergency_preemptive_call.py:32: Test FAILED (6.5 sec) 09:13:36.360887 run osmo-hlr_10.42.42.2(pid=32330): ERR: Terminated: ERROR {rc=237} [trial-2402↪emergency:trx-lms↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32330)] 09:13:36.411204 run osmo-hlr_10.42.42.2(pid=32330): stdout: | (launched: 2022-12-14_09:13:33.287194) 09:13:36.463678 run osmo-hlr_10.42.42.2(pid=32330): stderr: | 20221214091333480 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214091333480 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214091333480 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214091333480 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214091333481 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214091333481 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214091333491 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/emergency:trx-lms/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214091333499 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214091333500 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214091333500 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:13:36.535972 run osmo-msc_10.42.42.6(pid=32336): ERR: Terminated: ERROR {rc=2} [trial-2402↪emergency:trx-lms↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32336)] 09:13:36.585965 run osmo-msc_10.42.42.6(pid=32336): stdout: | (launched: 2022-12-14_09:13:35.425849) 09:13:36.637551 run osmo-msc_10.42.42.6(pid=32336): stderr: | 20221214091335743 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214091335743 DLGLOBAL DEBUG validating counter group 0x7f0aefbc8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214091335744 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214091335744 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214091335744 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214091335744 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214091335746 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214091335746 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214091335746 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214091335746 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:13:36.689636 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32329): Terminating (SIGTERM) 09:13:36.731118 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32332): Terminating (SIGTERM) 09:13:36.772502 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32335): Terminating (SIGTERM) 09:13:36.814263 --- ParallelTerminationStrategy: PID 32329 died... 09:13:36.834176 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32329): Terminated: ok {rc=0} 09:13:36.880342 --- ParallelTerminationStrategy: PID 32332 died... 09:13:36.900032 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32332): Terminated: ok {rc=0} 09:13:36.946071 --- ParallelTerminationStrategy: PID 32335 died... 09:13:36.965714 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32335): Terminated: ok {rc=0} 09:13:37.053338 bus /sierra_9: Setting Powered False 09:13:38.151331 bus /sierra_9: Setting Powered False 09:13:39.269553 bus /sierra_8: Setting Powered False 09:13:40.367670 bus /sierra_8: Setting Powered False 09:13:41.479501 bus /sierra_3: Setting Powered False 09:13:42.577348 bus /sierra_3: Setting Powered False 09:13:43.695109 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2402 emergency:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 gprs:trx-lms --------------------------------------------------------------------- 09:13:44.979003 tst gprs:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:13:44.983844 tst gprs:trx-lms: Verifying 1 x bts (candidates: 11) 09:13:45.017687 tst gprs:trx-lms: Verifying 9 x ip_address (candidates: 9) 09:13:45.057364 tst gprs:trx-lms: Verifying 4 x modem (candidates: 12) 09:13:45.146132 tst gprs:trx-lms: Reserving 1 x bts (candidates: 11) 09:13:45.179728 tst gprs:trx-lms: Reserving 9 x ip_address (candidates: 9) 09:13:45.218992 tst gprs:trx-lms: Reserving 4 x modem (candidates: 12) 09:13:45.809666 tst gprs:trx-lms: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2402 gprs:trx-lms cs_paging_gprs_active.py ---------------------------------------------- 09:13:45.869882 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 09:13:45.881107 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 09:13:45.931515 tst cs_paging_gprs_active.py: using LAC 39903 09:13:46.061306 tst cs_paging_gprs_active.py: using RAC 123 09:13:46.183429 tst cs_paging_gprs_active.py: using CellId 39903 09:13:46.308642 tst cs_paging_gprs_active.py: using BVCI 39904 09:13:46.423318 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 09:13:46.435017 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 09:13:46.446663 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 09:13:46.458098 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 09:13:46.470730 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 09:13:46.483461 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 09:13:46.496200 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 09:13:46.508687 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 09:13:46.521452 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 09:13:46.645153 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 09:13:46.763701 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 09:13:46.973216 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:13:47.318954 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32341): Launched 09:13:47.599233 run iperf3-srv_10.42.42.10(pid=32342): Launched 09:13:47.718847 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 09:13:47.932857 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:13:48.252057 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32343): Launched 09:13:48.529741 run iperf3-srv_10.42.42.10(pid=32344): Launched 09:13:48.648999 tst cs_paging_gprs_active.py:38: start network... 09:13:48.863666 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:13:49.357802 run create_hlr_db(pid=32345): Launched 09:13:49.490185 bus /sierra_2: Setting Powered False 09:13:50.553517 run create_hlr_db(pid=32345): Terminated: ok {rc=0} 09:13:50.994907 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32347): Launched 09:13:51.314896 run osmo-hlr_10.42.42.2(pid=32348): Launched 09:13:51.436411 run osmo-stp_10.42.42.5: Starting osmo-stp 09:13:51.989922 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32350): Launched 09:13:52.310493 run osmo-stp_10.42.42.5(pid=32351): Launched 09:13:52.432571 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:13:52.981673 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32353): Launched 09:13:53.104295 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:13:53.373199 run patchelf(pid=32354): Launched 09:13:53.552544 run osmo-stp_10.42.42.5(pid=32351): ERR: Terminated: ERROR {rc=1} [trial-2402↪gprs:trx-lms↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32351)] 09:13:53.687120 run osmo-stp_10.42.42.5(pid=32351): stdout: | (launched: 2022-12-14_09:13:52.252178) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:13:53.823182 run osmo-stp_10.42.42.5(pid=32351): stderr: | 20221214091352439 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214091352440 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214091352440 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214091352440 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214091352441 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214091352441 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214091352441 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:13:53.959088 run osmo-stp_10.42.42.5(pid=32351): stdout: | (launched: 2022-12-14_09:13:52.252178) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:13:54.090120 run osmo-stp_10.42.42.5(pid=32351): stderr: | 20221214091352439 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214091352440 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214091352440 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214091352440 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214091352441 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214091352441 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214091352441 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:13:54.244856 run patchelf(pid=32354): Terminating (SIGINT) 09:13:54.422364 run patchelf(pid=32354): Terminated: ok {rc=0} 09:13:54.550642 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=32351): Process ended prematurely: osmo-stp_10.42.42.5(pid=32351) [trial-2402↪gprs:trx-lms↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32351)] [trial-2402↪gprs:trx-lms↪cs_paging_gprs_active.py:38] 09:13:54.560778 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 09:13:54.589190 run osmo-hlr_10.42.42.2(pid=32348): ERR: Terminated: ERROR {rc=237} [trial-2402↪gprs:trx-lms↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32348)] 09:13:54.638513 run osmo-hlr_10.42.42.2(pid=32348): stdout: | (launched: 2022-12-14_09:13:51.256230) 09:13:54.689618 run osmo-hlr_10.42.42.2(pid=32348): stderr: | 20221214091351449 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214091351449 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214091351449 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214091351449 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214091351449 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214091351449 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214091351462 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/gprs:trx-lms/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214091351470 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214091351470 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214091351470 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:13:54.741447 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32341): Terminating (SIGTERM) 09:13:54.782586 run iperf3-srv_10.42.42.10(pid=32342): Terminating (SIGTERM) 09:13:54.823804 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32343): Terminating (SIGTERM) 09:13:54.865676 run iperf3-srv_10.42.42.10(pid=32344): Terminating (SIGTERM) 09:13:54.906713 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32347): Terminating (SIGTERM) 09:13:54.947840 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32350): Terminating (SIGTERM) 09:13:54.989040 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32353): Terminating (SIGTERM) 09:13:55.030952 --- ParallelTerminationStrategy: PID 32341 died... 09:13:55.050849 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32341): Terminated: ok {rc=0} 09:13:55.096848 --- ParallelTerminationStrategy: PID 32342 died... 09:13:55.116633 run iperf3-srv_10.42.42.10(pid=32342): Terminated {rc=256} 09:13:55.162138 --- ParallelTerminationStrategy: PID 32343 died... 09:13:55.181658 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32343): Terminated: ok {rc=0} 09:13:55.227316 --- ParallelTerminationStrategy: PID 32344 died... 09:13:55.246715 run iperf3-srv_10.42.42.10(pid=32344): Terminated {rc=256} 09:13:55.292138 --- ParallelTerminationStrategy: PID 32347 died... 09:13:55.311796 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32347): Terminated: ok {rc=0} 09:13:55.357487 --- ParallelTerminationStrategy: PID 32350 died... 09:13:55.376858 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32350): Terminated: ok {rc=0} 09:13:55.422533 --- ParallelTerminationStrategy: PID 32353 died... 09:13:55.442276 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32353): Terminated: ok {rc=0} 09:13:55.530270 bus /gobi_0: Setting Powered False 09:13:56.628707 bus /gobi_0: Setting Powered False 09:13:57.743980 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2402 gprs:trx-lms iperf3.py ---------------------------------------------- 09:13:58.885067 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 09:13:58.896295 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 09:13:58.946426 tst iperf3.py: using LAC 39904 09:13:59.073062 tst iperf3.py: using RAC 124 09:13:59.192157 tst iperf3.py: using CellId 39904 09:13:59.309369 tst iperf3.py: using BVCI 39905 09:13:59.418735 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 09:13:59.429543 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 09:13:59.440126 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 09:13:59.450512 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 09:13:59.460712 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 09:13:59.472149 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 09:13:59.484028 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 09:13:59.494872 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 09:13:59.505916 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 09:13:59.621327 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 09:13:59.821797 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:14:00.122857 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32355): Launched 09:14:00.386400 run iperf3-srv_10.42.42.10(pid=32356): Launched 09:14:00.501407 tst iperf3.py:8: start network... 09:14:00.701438 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:14:01.206456 run create_hlr_db(pid=32357): Launched 09:14:01.357792 bus /gobi_6: Setting Powered False 09:14:02.418125 run create_hlr_db(pid=32357): Terminated: ok {rc=0} 09:14:02.855357 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32359): Launched 09:14:03.177090 run osmo-hlr_10.42.42.2(pid=32360): Launched 09:14:03.299796 run osmo-stp_10.42.42.5: Starting osmo-stp 09:14:03.853861 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32362): Launched 09:14:04.174305 run osmo-stp_10.42.42.5(pid=32363): Launched 09:14:04.297868 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:14:04.848299 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32365): Launched 09:14:04.970178 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:14:05.240120 run patchelf(pid=32366): Launched 09:14:05.417628 run osmo-stp_10.42.42.5(pid=32363): ERR: Terminated: ERROR {rc=1} [trial-2402↪gprs:trx-lms↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32363)] 09:14:05.553681 run osmo-stp_10.42.42.5(pid=32363): stdout: | (launched: 2022-12-14_09:14:04.116045) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:14:05.690197 run osmo-stp_10.42.42.5(pid=32363): stderr: | 20221214091404303 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214091404303 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214091404304 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214091404304 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214091404305 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214091404305 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214091404305 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:14:05.827034 run osmo-stp_10.42.42.5(pid=32363): stdout: | (launched: 2022-12-14_09:14:04.116045) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:14:05.957563 run osmo-stp_10.42.42.5(pid=32363): stderr: | 20221214091404303 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214091404303 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214091404304 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214091404304 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214091404305 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214091404305 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214091404305 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:14:06.112245 run patchelf(pid=32366): Terminating (SIGINT) 09:14:06.290342 run patchelf(pid=32366): Terminated: ok {rc=0} 09:14:06.419043 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32363): Process ended prematurely: osmo-stp_10.42.42.5(pid=32363) [trial-2402↪gprs:trx-lms↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32363)] [trial-2402↪gprs:trx-lms↪iperf3.py:8] 09:14:06.429701 tst iperf3.py:8: Test FAILED (7.6 sec) 09:14:06.458023 run osmo-hlr_10.42.42.2(pid=32360): ERR: Terminated: ERROR {rc=237} [trial-2402↪gprs:trx-lms↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32360)] 09:14:06.508054 run osmo-hlr_10.42.42.2(pid=32360): stdout: | (launched: 2022-12-14_09:14:03.118658) 09:14:06.559673 run osmo-hlr_10.42.42.2(pid=32360): stderr: | 20221214091403313 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214091403313 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214091403313 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214091403313 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214091403313 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214091403313 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214091403326 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/gprs:trx-lms/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214091403334 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214091403334 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214091403334 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:14:06.611475 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32355): Terminating (SIGTERM) 09:14:06.652785 run iperf3-srv_10.42.42.10(pid=32356): Terminating (SIGTERM) 09:14:06.693854 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32359): Terminating (SIGTERM) 09:14:06.735574 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32362): Terminating (SIGTERM) 09:14:06.776852 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32365): Terminating (SIGTERM) 09:14:06.818355 --- ParallelTerminationStrategy: PID 32355 died... 09:14:06.837985 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32355): Terminated: ok {rc=0} 09:14:06.883644 --- ParallelTerminationStrategy: PID 32356 died... 09:14:06.902846 run iperf3-srv_10.42.42.10(pid=32356): Terminated {rc=256} 09:14:06.948214 --- ParallelTerminationStrategy: PID 32359 died... 09:14:06.967554 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32359): Terminated: ok {rc=0} 09:14:07.013089 --- ParallelTerminationStrategy: PID 32362 died... 09:14:07.032355 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32362): Terminated: ok {rc=0} 09:14:07.077829 --- ParallelTerminationStrategy: PID 32365 died... 09:14:07.097286 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32365): Terminated: ok {rc=0} 09:14:07.184146 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2402 gprs:trx-lms iperf3m4.py ---------------------------------------------- 09:14:08.334363 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 09:14:08.346256 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 09:14:08.394426 tst iperf3m4.py: using LAC 39905 09:14:08.522720 tst iperf3m4.py: using RAC 125 09:14:08.650601 tst iperf3m4.py: using CellId 39905 09:14:08.775715 tst iperf3m4.py: using BVCI 39906 09:14:08.892004 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 09:14:08.903170 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 09:14:08.914026 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 09:14:08.924792 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 09:14:08.935558 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 09:14:08.946487 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 09:14:08.957446 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 09:14:08.968569 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 09:14:08.979942 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 09:14:09.095679 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 09:14:09.219498 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 09:14:09.337387 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 09:14:09.456355 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 09:14:09.673212 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:14:09.993148 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32367): Launched 09:14:10.271676 run iperf3-srv_10.42.42.10(pid=32368): Launched 09:14:10.391056 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 09:14:10.606533 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:14:10.926959 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32369): Launched 09:14:11.205324 run iperf3-srv_10.42.42.10(pid=32370): Launched 09:14:11.327064 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 09:14:11.542258 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:14:11.863446 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32371): Launched 09:14:12.140644 run iperf3-srv_10.42.42.10(pid=32372): Launched 09:14:12.262338 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 09:14:12.476870 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:14:12.796260 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32373): Launched 09:14:13.072887 run iperf3-srv_10.42.42.10(pid=32374): Launched 09:14:13.192769 tst iperf3m4.py:8: start network... 09:14:13.407319 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:14:13.905578 run create_hlr_db(pid=32375): Launched 09:14:14.035504 bus /gobi_6: Setting Powered False 09:14:15.098252 run create_hlr_db(pid=32375): Terminated: ok {rc=0} 09:14:15.523221 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32377): Launched 09:14:15.831728 run osmo-hlr_10.42.42.2(pid=32378): Launched 09:14:16.071610 run osmo-stp_10.42.42.5: Starting osmo-stp 09:14:16.721725 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32380): Launched 09:14:17.071186 run osmo-stp_10.42.42.5(pid=32381): Launched 09:14:17.315452 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:14:17.882824 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32383): Launched 09:14:17.997213 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:14:18.249454 run patchelf(pid=32384): Launched 09:14:18.415367 run osmo-stp_10.42.42.5(pid=32381): ERR: Terminated: ERROR {rc=1} [trial-2402↪gprs:trx-lms↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32381)] 09:14:18.542691 run osmo-stp_10.42.42.5(pid=32381): stdout: | (launched: 2022-12-14_09:14:17.012436) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:14:18.671277 run osmo-stp_10.42.42.5(pid=32381): stderr: | 20221214091417302 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214091417302 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214091417303 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214091417303 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214091417304 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214091417304 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214091417304 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:14:18.799871 run osmo-stp_10.42.42.5(pid=32381): stdout: | (launched: 2022-12-14_09:14:17.012436) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:14:18.923144 run osmo-stp_10.42.42.5(pid=32381): stderr: | 20221214091417302 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214091417302 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214091417303 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214091417303 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214091417304 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214091417304 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214091417304 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:14:19.067930 run patchelf(pid=32384): Terminating (SIGINT) 09:14:19.235290 run patchelf(pid=32384): Terminated: ok {rc=0} 09:14:19.356060 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32381): Process ended prematurely: osmo-stp_10.42.42.5(pid=32381) [trial-2402↪gprs:trx-lms↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32381)] [trial-2402↪gprs:trx-lms↪iperf3m4.py:8] 09:14:19.365621 tst iperf3m4.py:8: Test FAILED (11.1 sec) 09:14:19.392415 run osmo-hlr_10.42.42.2(pid=32378): ERR: Terminated: ERROR {rc=237} [trial-2402↪gprs:trx-lms↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32378)] 09:14:19.440374 run osmo-hlr_10.42.42.2(pid=32378): stdout: | (launched: 2022-12-14_09:14:15.770204) 09:14:19.490088 run osmo-hlr_10.42.42.2(pid=32378): stderr: | 20221214091416023 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214091416023 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214091416023 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214091416023 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214091416023 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214091416023 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214091416049 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/gprs:trx-lms/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214091416069 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214091416070 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214091416070 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:14:19.539549 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32367): Terminating (SIGTERM) 09:14:19.579189 run iperf3-srv_10.42.42.10(pid=32368): Terminating (SIGTERM) 09:14:19.618399 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32369): Terminating (SIGTERM) 09:14:19.658560 run iperf3-srv_10.42.42.10(pid=32370): Terminating (SIGTERM) 09:14:19.697876 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32371): Terminating (SIGTERM) 09:14:19.737919 run iperf3-srv_10.42.42.10(pid=32372): Terminating (SIGTERM) 09:14:19.777068 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32373): Terminating (SIGTERM) 09:14:19.816298 run iperf3-srv_10.42.42.10(pid=32374): Terminating (SIGTERM) 09:14:19.855524 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32377): Terminating (SIGTERM) 09:14:19.894720 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32380): Terminating (SIGTERM) 09:14:19.933886 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32383): Terminating (SIGTERM) 09:14:19.973595 --- ParallelTerminationStrategy: PID 32367 died... 09:14:19.992877 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32367): Terminated: ok {rc=0} 09:14:20.036440 --- ParallelTerminationStrategy: PID 32368 died... 09:14:20.055125 run iperf3-srv_10.42.42.10(pid=32368): Terminated {rc=256} 09:14:20.098627 --- ParallelTerminationStrategy: PID 32369 died... 09:14:20.117463 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32369): Terminated: ok {rc=0} 09:14:20.161010 --- ParallelTerminationStrategy: PID 32370 died... 09:14:20.179926 run iperf3-srv_10.42.42.10(pid=32370): Terminated {rc=256} 09:14:20.224139 --- ParallelTerminationStrategy: PID 32371 died... 09:14:20.243104 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32371): Terminated: ok {rc=0} 09:14:20.286671 --- ParallelTerminationStrategy: PID 32372 died... 09:14:20.305594 run iperf3-srv_10.42.42.10(pid=32372): Terminated {rc=256} 09:14:20.349302 --- ParallelTerminationStrategy: PID 32373 died... 09:14:20.368025 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32373): Terminated: ok {rc=0} 09:14:20.411936 --- ParallelTerminationStrategy: PID 32374 died... 09:14:20.430905 run iperf3-srv_10.42.42.10(pid=32374): Terminated {rc=256} 09:14:20.474931 --- ParallelTerminationStrategy: PID 32377 died... 09:14:20.493971 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32377): Terminated: ok {rc=0} 09:14:20.537836 --- ParallelTerminationStrategy: PID 32380 died... 09:14:20.556670 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32380): Terminated: ok {rc=0} 09:14:20.600459 --- ParallelTerminationStrategy: PID 32383 died... 09:14:20.619354 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32383): Terminated: ok {rc=0} 09:14:20.705378 bus /gobi_4: Setting Powered False 09:14:21.803819 bus /gobi_4: Setting Powered False 09:14:22.918622 bus /gobi_1: Setting Powered False 09:14:24.014410 bus /gobi_1: Setting Powered False 09:14:25.129578 bus /gobi_0: Setting Powered False 09:14:26.227567 bus /gobi_0: Setting Powered False 09:14:27.342773 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2402 gprs:trx-lms ping.py ---------------------------------------------- 09:14:28.445673 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 09:14:28.456818 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 09:14:28.505913 tst ping.py: using LAC 39906 09:14:28.629480 tst ping.py: using RAC 126 09:14:28.755373 tst ping.py: using CellId 39906 09:14:28.879769 tst ping.py: using BVCI 39907 09:14:28.993731 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 09:14:29.004741 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 09:14:29.015816 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 09:14:29.026799 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 09:14:29.037725 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 09:14:29.048514 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 09:14:29.059511 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 09:14:29.070524 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 09:14:29.185667 tst ping.py:19: start network... 09:14:29.381446 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:14:29.836499 run create_hlr_db(pid=32385): Launched 09:14:29.949180 bus /gobi_6: Setting Powered False 09:14:31.010374 run create_hlr_db(pid=32385): Terminated: ok {rc=0} 09:14:31.471056 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32387): Launched 09:14:31.802744 run osmo-hlr_10.42.42.2(pid=32388): Launched 09:14:32.034031 run osmo-stp_10.42.42.5: Starting osmo-stp 09:14:32.586102 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32390): Launched 09:14:32.882150 run osmo-stp_10.42.42.5(pid=32391): Launched 09:14:32.993074 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:14:33.499998 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32393): Launched 09:14:33.611897 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:14:33.860877 run patchelf(pid=32394): Launched 09:14:34.027408 run osmo-stp_10.42.42.5(pid=32391): ERR: Terminated: ERROR {rc=1} [trial-2402↪gprs:trx-lms↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32391)] 09:14:34.152631 run osmo-stp_10.42.42.5(pid=32391): stdout: | (launched: 2022-12-14_09:14:32.827131) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:14:34.279556 run osmo-stp_10.42.42.5(pid=32391): stderr: | 20221214091432994 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214091432994 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214091432995 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214091432995 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214091432996 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214091432996 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214091432996 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:14:34.406400 run osmo-stp_10.42.42.5(pid=32391): stdout: | (launched: 2022-12-14_09:14:32.827131) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:14:34.527925 run osmo-stp_10.42.42.5(pid=32391): stderr: | 20221214091432994 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214091432994 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214091432995 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214091432995 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214091432996 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214091432996 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214091432996 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:14:34.671531 run patchelf(pid=32394): Terminating (SIGINT) 09:14:34.836856 run patchelf(pid=32394): Terminated: ok {rc=0} 09:14:34.956228 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=32391): Process ended prematurely: osmo-stp_10.42.42.5(pid=32391) [trial-2402↪gprs:trx-lms↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32391)] [trial-2402↪gprs:trx-lms↪ping.py:22] 09:14:34.965395 tst ping.py:22: Test FAILED (6.5 sec) 09:14:34.992090 run osmo-hlr_10.42.42.2(pid=32388): ERR: Terminated: ERROR {rc=237} [trial-2402↪gprs:trx-lms↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32388)] 09:14:35.040373 run osmo-hlr_10.42.42.2(pid=32388): stdout: | (launched: 2022-12-14_09:14:31.744129) 09:14:35.090449 run osmo-hlr_10.42.42.2(pid=32388): stderr: | 20221214091432044 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214091432044 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214091432044 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214091432044 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214091432044 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214091432044 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214091432063 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/gprs:trx-lms/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214091432075 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214091432075 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214091432075 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:14:35.140793 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32387): Terminating (SIGTERM) 09:14:35.181044 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32390): Terminating (SIGTERM) 09:14:35.221387 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32393): Terminating (SIGTERM) 09:14:35.261610 --- ParallelTerminationStrategy: PID 32387 died... 09:14:35.281454 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32387): Terminated: ok {rc=0} 09:14:35.325660 --- ParallelTerminationStrategy: PID 32390 died... 09:14:35.344562 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32390): Terminated: ok {rc=0} 09:14:35.388830 --- ParallelTerminationStrategy: PID 32393 died... 09:14:35.408404 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32393): Terminated: ok {rc=0} 09:14:35.496039 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2402 gprs:trx-lms ping_idle_ping.py ---------------------------------------------- 09:14:36.583435 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 09:14:36.594780 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 09:14:36.648630 tst ping_idle_ping.py: using LAC 39907 09:14:36.768443 tst ping_idle_ping.py: using RAC 127 09:14:36.885176 tst ping_idle_ping.py: using CellId 39907 09:14:37.000085 tst ping_idle_ping.py: using BVCI 39908 09:14:37.107272 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 09:14:37.117912 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 09:14:37.128326 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 09:14:37.138699 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 09:14:37.148931 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 09:14:37.159664 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 09:14:37.170453 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 09:14:37.180932 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 09:14:37.295875 tst ping_idle_ping.py:24: start network... 09:14:37.492711 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:14:37.953200 run create_hlr_db(pid=32395): Launched 09:14:38.065587 bus /gobi_6: Setting Powered False 09:14:39.125074 run create_hlr_db(pid=32395): Terminated: ok {rc=0} 09:14:39.560018 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32397): Launched 09:14:39.877521 run osmo-hlr_10.42.42.2(pid=32398): Launched 09:14:40.000901 run osmo-stp_10.42.42.5: Starting osmo-stp 09:14:40.544887 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32400): Launched 09:14:40.859327 run osmo-stp_10.42.42.5(pid=32401): Launched 09:14:40.979210 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:14:41.524831 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32403): Launched 09:14:41.645447 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:14:41.912398 run patchelf(pid=32404): Launched 09:14:42.088076 run osmo-stp_10.42.42.5(pid=32401): ERR: Terminated: ERROR {rc=1} [trial-2402↪gprs:trx-lms↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32401)] 09:14:42.221805 run osmo-stp_10.42.42.5(pid=32401): stdout: | (launched: 2022-12-14_09:14:40.801369) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:14:42.357041 run osmo-stp_10.42.42.5(pid=32401): stderr: | 20221214091440989 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214091440989 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214091440989 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214091440990 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214091440990 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214091440990 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214091440990 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:14:42.492166 run osmo-stp_10.42.42.5(pid=32401): stdout: | (launched: 2022-12-14_09:14:40.801369) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:14:42.622070 run osmo-stp_10.42.42.5(pid=32401): stderr: | 20221214091440989 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214091440989 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214091440989 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214091440990 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214091440990 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214091440990 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214091440990 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:14:42.775973 run patchelf(pid=32404): Terminating (SIGINT) 09:14:42.952002 run patchelf(pid=32404): Terminated: ok {rc=0} 09:14:43.079219 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=32401): Process ended prematurely: osmo-stp_10.42.42.5(pid=32401) [trial-2402↪gprs:trx-lms↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32401)] [trial-2402↪gprs:trx-lms↪ping_idle_ping.py:27] 09:14:43.089116 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 09:14:43.117347 run osmo-hlr_10.42.42.2(pid=32398): ERR: Terminated: ERROR {rc=237} [trial-2402↪gprs:trx-lms↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32398)] 09:14:43.167402 run osmo-hlr_10.42.42.2(pid=32398): stdout: | (launched: 2022-12-14_09:14:39.819444) 09:14:43.219207 run osmo-hlr_10.42.42.2(pid=32398): stderr: | 20221214091440012 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214091440012 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214091440012 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214091440012 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214091440012 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214091440012 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214091440040 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/gprs:trx-lms/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214091440050 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214091440050 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214091440050 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:14:43.271430 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32397): Terminating (SIGTERM) 09:14:43.313310 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32400): Terminating (SIGTERM) 09:14:43.355190 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32403): Terminating (SIGTERM) 09:14:43.397271 --- ParallelTerminationStrategy: PID 32397 died... 09:14:43.416791 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32397): Terminated: ok {rc=0} 09:14:43.463390 --- ParallelTerminationStrategy: PID 32400 died... 09:14:43.483139 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32400): Terminated: ok {rc=0} 09:14:43.529465 --- ParallelTerminationStrategy: PID 32403 died... 09:14:43.549238 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32403): Terminated: ok {rc=0} 09:14:43.637603 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2402 gprs:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 gprs:trx-lms+mod-bts0-egprs --------------------------------------------------------------------- 09:14:44.942316 tst gprs:trx-lms+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:14:44.948083 tst gprs:trx-lms+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 09:14:44.981817 tst gprs:trx-lms+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 09:14:45.022602 tst gprs:trx-lms+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 09:14:45.112832 tst gprs:trx-lms+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 09:14:45.146715 tst gprs:trx-lms+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 09:14:45.186653 tst gprs:trx-lms+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 09:14:45.781042 tst gprs:trx-lms+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2402 gprs:trx-lms+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 09:14:45.832291 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:14:45.844567 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 09:14:45.908789 tst cs_paging_gprs_active.py: using LAC 39908 09:14:46.045818 tst cs_paging_gprs_active.py: using RAC 128 09:14:46.173840 tst cs_paging_gprs_active.py: using CellId 39908 09:14:46.298339 tst cs_paging_gprs_active.py: using BVCI 39909 09:14:46.413956 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:14:46.427127 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:14:46.439027 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:14:46.451027 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:14:46.463464 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:14:46.478339 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:14:46.490435 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:14:46.503149 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:14:46.515949 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:14:46.663368 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:14:46.807027 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 09:14:47.099090 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:14:47.435879 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32409): Launched 09:14:47.717320 run iperf3-srv_10.42.42.10(pid=32410): Launched 09:14:47.837985 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 09:14:48.055193 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:14:48.378867 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32411): Launched 09:14:48.659591 run iperf3-srv_10.42.42.10(pid=32412): Launched 09:14:48.780572 tst cs_paging_gprs_active.py:38: start network... 09:14:48.997357 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:14:49.496456 run create_hlr_db(pid=32413): Launched 09:14:49.626724 bus /gobi_6: Setting Powered False 09:14:50.690364 run create_hlr_db(pid=32413): Terminated: ok {rc=0} 09:14:51.116836 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32415): Launched 09:14:51.438698 run osmo-hlr_10.42.42.2(pid=32416): Launched 09:14:51.560459 run osmo-stp_10.42.42.5: Starting osmo-stp 09:14:52.118320 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32418): Launched 09:14:52.440186 run osmo-stp_10.42.42.5(pid=32419): Launched 09:14:52.561773 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:14:53.114190 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32421): Launched 09:14:53.237547 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:14:53.508448 run patchelf(pid=32422): Launched 09:14:53.687773 run osmo-stp_10.42.42.5(pid=32419): ERR: Terminated: ERROR {rc=1} [trial-2402↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32419)] 09:14:53.822703 run osmo-stp_10.42.42.5(pid=32419): stdout: | (launched: 2022-12-14_09:14:52.381371) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:14:53.960110 run osmo-stp_10.42.42.5(pid=32419): stderr: | 20221214091452572 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214091452572 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214091452572 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214091452572 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214091452573 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214091452573 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214091452573 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:14:54.097035 run osmo-stp_10.42.42.5(pid=32419): stdout: | (launched: 2022-12-14_09:14:52.381371) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:14:54.228268 run osmo-stp_10.42.42.5(pid=32419): stderr: | 20221214091452572 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214091452572 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214091452572 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214091452572 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214091452573 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214091452573 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214091452573 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:14:54.383806 run patchelf(pid=32422): Terminating (SIGINT) 09:14:54.563239 run patchelf(pid=32422): Terminated: ok {rc=0} 09:14:54.692277 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=32419): Process ended prematurely: osmo-stp_10.42.42.5(pid=32419) [trial-2402↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32419)] [trial-2402↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 09:14:54.702640 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 09:14:54.731144 run osmo-hlr_10.42.42.2(pid=32416): ERR: Terminated: ERROR {rc=237} [trial-2402↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32416)] 09:14:54.781595 run osmo-hlr_10.42.42.2(pid=32416): stdout: | (launched: 2022-12-14_09:14:51.379810) 09:14:54.833182 run osmo-hlr_10.42.42.2(pid=32416): stderr: | 20221214091451574 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214091451574 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214091451574 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214091451574 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214091451574 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214091451575 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214091451587 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/gprs:trx-lms+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214091451595 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214091451595 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214091451595 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:14:54.885059 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32409): Terminating (SIGTERM) 09:14:54.926529 run iperf3-srv_10.42.42.10(pid=32410): Terminating (SIGTERM) 09:14:54.967949 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32411): Terminating (SIGTERM) 09:14:55.009498 run iperf3-srv_10.42.42.10(pid=32412): Terminating (SIGTERM) 09:14:55.050861 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32415): Terminating (SIGTERM) 09:14:55.092485 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32418): Terminating (SIGTERM) 09:14:55.134228 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32421): Terminating (SIGTERM) 09:14:55.176051 --- ParallelTerminationStrategy: PID 32409 died... 09:14:55.195877 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32409): Terminated: ok {rc=0} 09:14:55.242203 --- ParallelTerminationStrategy: PID 32410 died... 09:14:55.261738 run iperf3-srv_10.42.42.10(pid=32410): Terminated {rc=256} 09:14:55.307581 --- ParallelTerminationStrategy: PID 32411 died... 09:14:55.327222 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32411): Terminated: ok {rc=0} 09:14:55.373259 --- ParallelTerminationStrategy: PID 32412 died... 09:14:55.392602 run iperf3-srv_10.42.42.10(pid=32412): Terminated {rc=256} 09:14:55.440185 --- ParallelTerminationStrategy: PID 32415 died... 09:14:55.459782 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32415): Terminated: ok {rc=0} 09:14:55.506288 --- ParallelTerminationStrategy: PID 32418 died... 09:14:55.525891 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32418): Terminated: ok {rc=0} 09:14:55.572121 --- ParallelTerminationStrategy: PID 32421 died... 09:14:55.591709 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32421): Terminated: ok {rc=0} 09:14:55.679217 bus /gobi_0: Setting Powered False 09:14:56.777238 bus /gobi_0: Setting Powered False 09:14:57.894342 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2402 gprs:trx-lms+mod-bts0-egprs iperf3.py ---------------------------------------------- 09:14:59.036930 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:14:59.048509 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 09:14:59.099348 tst iperf3.py: using LAC 39909 09:14:59.226270 tst iperf3.py: using RAC 129 09:14:59.347060 tst iperf3.py: using CellId 39909 09:14:59.467094 tst iperf3.py: using BVCI 39910 09:14:59.576902 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:14:59.587894 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:14:59.598549 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:14:59.609241 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:14:59.619832 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:14:59.631994 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:14:59.643628 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:14:59.654966 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:14:59.666618 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:14:59.786525 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 09:15:00.002901 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:15:00.325338 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32423): Launched 09:15:00.604796 run iperf3-srv_10.42.42.10(pid=32424): Launched 09:15:00.724856 tst iperf3.py:8: start network... 09:15:00.942204 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:15:01.449651 run create_hlr_db(pid=32425): Launched 09:15:01.601698 bus /gobi_6: Setting Powered False 09:15:02.661439 run create_hlr_db(pid=32425): Terminated: ok {rc=0} 09:15:03.110966 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32430): Launched 09:15:03.432579 run osmo-hlr_10.42.42.2(pid=32431): Launched 09:15:03.555473 run osmo-stp_10.42.42.5: Starting osmo-stp 09:15:04.113437 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32433): Launched 09:15:04.435041 run osmo-stp_10.42.42.5(pid=32434): Launched 09:15:04.558672 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:15:05.111418 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32436): Launched 09:15:05.232921 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:15:05.503723 run patchelf(pid=32437): Launched 09:15:05.681765 run osmo-stp_10.42.42.5(pid=32434): ERR: Terminated: ERROR {rc=1} [trial-2402↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32434)] 09:15:05.816515 run osmo-stp_10.42.42.5(pid=32434): stdout: | (launched: 2022-12-14_09:15:04.376383) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:15:05.953088 run osmo-stp_10.42.42.5(pid=32434): stderr: | 20221214091504564 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214091504564 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214091504565 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214091504565 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214091504566 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214091504566 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214091504566 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:15:06.090709 run osmo-stp_10.42.42.5(pid=32434): stdout: | (launched: 2022-12-14_09:15:04.376383) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:15:06.221192 run osmo-stp_10.42.42.5(pid=32434): stderr: | 20221214091504564 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214091504564 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214091504565 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214091504565 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214091504566 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214091504566 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214091504566 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:15:06.375782 run patchelf(pid=32437): Terminating (SIGINT) 09:15:06.554568 run patchelf(pid=32437): Terminated: ok {rc=0} 09:15:06.683395 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32434): Process ended prematurely: osmo-stp_10.42.42.5(pid=32434) [trial-2402↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32434)] [trial-2402↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8] 09:15:06.693638 tst iperf3.py:8: Test FAILED (7.7 sec) 09:15:06.722229 run osmo-hlr_10.42.42.2(pid=32431): ERR: Terminated: ERROR {rc=237} [trial-2402↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32431)] 09:15:06.772479 run osmo-hlr_10.42.42.2(pid=32431): stdout: | (launched: 2022-12-14_09:15:03.373594) 09:15:06.824557 run osmo-hlr_10.42.42.2(pid=32431): stderr: | 20221214091503569 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214091503569 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214091503569 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214091503569 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214091503569 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214091503569 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214091503582 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/gprs:trx-lms+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214091503590 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214091503590 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214091503590 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:15:06.877251 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32423): Terminating (SIGTERM) 09:15:06.918922 run iperf3-srv_10.42.42.10(pid=32424): Terminating (SIGTERM) 09:15:06.960444 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32430): Terminating (SIGTERM) 09:15:07.002265 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32433): Terminating (SIGTERM) 09:15:07.044189 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32436): Terminating (SIGTERM) 09:15:07.086336 --- ParallelTerminationStrategy: PID 32423 died... 09:15:07.106337 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32423): Terminated: ok {rc=0} 09:15:07.152316 --- ParallelTerminationStrategy: PID 32424 died... 09:15:07.171882 run iperf3-srv_10.42.42.10(pid=32424): Terminated {rc=256} 09:15:07.217711 --- ParallelTerminationStrategy: PID 32430 died... 09:15:07.237341 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32430): Terminated: ok {rc=0} 09:15:07.283204 --- ParallelTerminationStrategy: PID 32433 died... 09:15:07.302730 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32433): Terminated: ok {rc=0} 09:15:07.348599 --- ParallelTerminationStrategy: PID 32436 died... 09:15:07.368148 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32436): Terminated: ok {rc=0} 09:15:07.455519 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2402 gprs:trx-lms+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 09:15:08.599168 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:15:08.610620 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 09:15:08.661077 tst iperf3m4.py: using LAC 39910 09:15:08.778593 tst iperf3m4.py: using RAC 130 09:15:08.898492 tst iperf3m4.py: using CellId 39910 09:15:09.015907 tst iperf3m4.py: using BVCI 39911 09:15:09.126584 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:15:09.137518 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:15:09.148076 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:15:09.158732 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:15:09.169223 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:15:09.179975 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:15:09.191279 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:15:09.202160 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:15:09.213225 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:15:09.328903 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:15:09.450266 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:15:09.570838 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:15:09.688351 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 09:15:09.889198 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:15:10.190762 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32438): Launched 09:15:10.451818 run iperf3-srv_10.42.42.10(pid=32439): Launched 09:15:10.564301 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 09:15:10.764045 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:15:11.064702 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32440): Launched 09:15:11.325486 run iperf3-srv_10.42.42.10(pid=32441): Launched 09:15:11.437638 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 09:15:11.637296 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:15:11.937741 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32442): Launched 09:15:12.199159 run iperf3-srv_10.42.42.10(pid=32443): Launched 09:15:12.311311 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 09:15:12.510885 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:15:12.812026 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32444): Launched 09:15:13.073557 run iperf3-srv_10.42.42.10(pid=32445): Launched 09:15:13.186483 tst iperf3m4.py:8: start network... 09:15:13.386100 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:15:13.851873 run create_hlr_db(pid=32446): Launched 09:15:13.968029 bus /gobi_6: Setting Powered False 09:15:15.028675 run create_hlr_db(pid=32446): Terminated: ok {rc=0} 09:15:15.446290 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32448): Launched 09:15:15.748345 run osmo-hlr_10.42.42.2(pid=32449): Launched 09:15:15.916619 run osmo-stp_10.42.42.5: Starting osmo-stp 09:15:16.533441 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32451): Launched 09:15:16.875852 run osmo-stp_10.42.42.5(pid=32452): Launched 09:15:17.010728 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:15:17.731338 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32454): Launched 09:15:17.853190 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:15:18.124391 run patchelf(pid=32455): Launched 09:15:18.302613 run osmo-stp_10.42.42.5(pid=32452): ERR: Terminated: ERROR {rc=1} [trial-2402↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32452)] 09:15:18.437705 run osmo-stp_10.42.42.5(pid=32452): stdout: | (launched: 2022-12-14_09:15:16.818372) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:15:18.575363 run osmo-stp_10.42.42.5(pid=32452): stderr: | 20221214091517151 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214091517151 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214091517152 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214091517152 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214091517153 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214091517153 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214091517153 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:15:18.712272 run osmo-stp_10.42.42.5(pid=32452): stdout: | (launched: 2022-12-14_09:15:16.818372) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:15:18.843474 run osmo-stp_10.42.42.5(pid=32452): stderr: | 20221214091517151 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214091517151 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214091517152 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214091517152 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214091517153 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214091517153 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214091517153 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:15:18.999097 run patchelf(pid=32455): Terminating (SIGINT) 09:15:19.177674 run patchelf(pid=32455): Terminated: ok {rc=0} 09:15:19.306517 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32452): Process ended prematurely: osmo-stp_10.42.42.5(pid=32452) [trial-2402↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32452)] [trial-2402↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8] 09:15:19.316619 tst iperf3m4.py:8: Test FAILED (10.8 sec) 09:15:19.345687 run osmo-hlr_10.42.42.2(pid=32449): ERR: Terminated: ERROR {rc=237} [trial-2402↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32449)] 09:15:19.396019 run osmo-hlr_10.42.42.2(pid=32449): stdout: | (launched: 2022-12-14_09:15:15.692545) 09:15:19.448169 run osmo-hlr_10.42.42.2(pid=32449): stderr: | 20221214091515899 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214091515899 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214091515899 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214091515899 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214091515899 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214091515899 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214091515923 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/gprs:trx-lms+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214091515942 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214091515942 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214091515942 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:15:19.500541 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32438): Terminating (SIGTERM) 09:15:19.542799 run iperf3-srv_10.42.42.10(pid=32439): Terminating (SIGTERM) 09:15:19.586486 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32440): Terminating (SIGTERM) 09:15:19.628584 run iperf3-srv_10.42.42.10(pid=32441): Terminating (SIGTERM) 09:15:19.670256 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32442): Terminating (SIGTERM) 09:15:19.711874 run iperf3-srv_10.42.42.10(pid=32443): Terminating (SIGTERM) 09:15:19.753484 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32444): Terminating (SIGTERM) 09:15:19.795202 run iperf3-srv_10.42.42.10(pid=32445): Terminating (SIGTERM) 09:15:19.836758 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32448): Terminating (SIGTERM) 09:15:19.878916 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32451): Terminating (SIGTERM) 09:15:19.921124 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32454): Terminating (SIGTERM) 09:15:19.963485 --- ParallelTerminationStrategy: PID 32438 died... 09:15:19.983450 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32438): Terminated: ok {rc=0} 09:15:20.029683 --- ParallelTerminationStrategy: PID 32439 died... 09:15:20.049180 run iperf3-srv_10.42.42.10(pid=32439): Terminated {rc=256} 09:15:20.094944 --- ParallelTerminationStrategy: PID 32440 died... 09:15:20.114548 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32440): Terminated: ok {rc=0} 09:15:20.160568 --- ParallelTerminationStrategy: PID 32441 died... 09:15:20.180121 run iperf3-srv_10.42.42.10(pid=32441): Terminated {rc=256} 09:15:20.226024 --- ParallelTerminationStrategy: PID 32442 died... 09:15:20.245616 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32442): Terminated: ok {rc=0} 09:15:20.291699 --- ParallelTerminationStrategy: PID 32443 died... 09:15:20.311195 run iperf3-srv_10.42.42.10(pid=32443): Terminated {rc=256} 09:15:20.357299 --- ParallelTerminationStrategy: PID 32444 died... 09:15:20.376741 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32444): Terminated: ok {rc=0} 09:15:20.422849 --- ParallelTerminationStrategy: PID 32445 died... 09:15:20.442485 run iperf3-srv_10.42.42.10(pid=32445): Terminated {rc=256} 09:15:20.488184 --- ParallelTerminationStrategy: PID 32448 died... 09:15:20.508115 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32448): Terminated: ok {rc=0} 09:15:20.554173 --- ParallelTerminationStrategy: PID 32451 died... 09:15:20.573920 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32451): Terminated: ok {rc=0} 09:15:20.619992 --- ParallelTerminationStrategy: PID 32454 died... 09:15:20.639643 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32454): Terminated: ok {rc=0} 09:15:20.727279 bus /gobi_4: Setting Powered False 09:15:21.826135 bus /gobi_4: Setting Powered False 09:15:22.941778 bus /gobi_1: Setting Powered False 09:15:24.040671 bus /gobi_1: Setting Powered False 09:15:25.156530 bus /gobi_0: Setting Powered False 09:15:26.254515 bus /gobi_0: Setting Powered False 09:15:27.370873 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2402 gprs:trx-lms+mod-bts0-egprs ping.py ---------------------------------------------- 09:15:28.473957 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:15:28.485900 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 09:15:28.537282 tst ping.py: using LAC 39911 09:15:28.661076 tst ping.py: using RAC 131 09:15:28.785826 tst ping.py: using CellId 39911 09:15:28.904339 tst ping.py: using BVCI 39912 09:15:29.011123 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:15:29.022205 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:15:29.032772 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:15:29.043335 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:15:29.054285 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:15:29.065597 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:15:29.076810 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:15:29.087858 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:15:29.202129 tst ping.py:19: start network... 09:15:29.397268 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:15:29.851046 run create_hlr_db(pid=32456): Launched 09:15:29.964628 bus /gobi_6: Setting Powered False 09:15:31.027886 run create_hlr_db(pid=32456): Terminated: ok {rc=0} 09:15:31.481490 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32458): Launched 09:15:31.813997 run osmo-hlr_10.42.42.2(pid=32459): Launched 09:15:32.011887 run osmo-stp_10.42.42.5: Starting osmo-stp 09:15:32.591191 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32461): Launched 09:15:32.885136 run osmo-stp_10.42.42.5(pid=32462): Launched 09:15:32.998164 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:15:33.503982 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32464): Launched 09:15:33.616588 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:15:33.865745 run patchelf(pid=32465): Launched 09:15:34.030433 run osmo-stp_10.42.42.5(pid=32462): ERR: Terminated: ERROR {rc=1} [trial-2402↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32462)] 09:15:34.155695 run osmo-stp_10.42.42.5(pid=32462): stdout: | (launched: 2022-12-14_09:15:32.830699) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:15:34.282897 run osmo-stp_10.42.42.5(pid=32462): stderr: | 20221214091532997 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214091532998 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214091532998 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214091532998 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214091532999 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214091532999 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214091532999 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:15:34.409654 run osmo-stp_10.42.42.5(pid=32462): stdout: | (launched: 2022-12-14_09:15:32.830699) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:15:34.531671 run osmo-stp_10.42.42.5(pid=32462): stderr: | 20221214091532997 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214091532998 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214091532998 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214091532998 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214091532999 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214091532999 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214091532999 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:15:34.675732 run patchelf(pid=32465): Terminating (SIGINT) 09:15:34.841444 run patchelf(pid=32465): Terminated: ok {rc=0} 09:15:34.960571 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=32462): Process ended prematurely: osmo-stp_10.42.42.5(pid=32462) [trial-2402↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32462)] [trial-2402↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22] 09:15:34.969903 tst ping.py:22: Test FAILED (6.5 sec) 09:15:34.996615 run osmo-hlr_10.42.42.2(pid=32459): ERR: Terminated: ERROR {rc=237} [trial-2402↪gprs:trx-lms+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32459)] 09:15:35.045066 run osmo-hlr_10.42.42.2(pid=32459): stdout: | (launched: 2022-12-14_09:15:31.756198) 09:15:35.094935 run osmo-hlr_10.42.42.2(pid=32459): stderr: | 20221214091532070 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214091532070 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214091532070 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214091532070 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214091532070 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214091532070 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214091532087 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/gprs:trx-lms+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214091532104 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214091532104 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214091532104 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:15:35.145519 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32458): Terminating (SIGTERM) 09:15:35.185638 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32461): Terminating (SIGTERM) 09:15:35.225447 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32464): Terminating (SIGTERM) 09:15:35.266035 --- ParallelTerminationStrategy: PID 32458 died... 09:15:35.285772 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32458): Terminated: ok {rc=0} 09:15:35.330246 --- ParallelTerminationStrategy: PID 32461 died... 09:15:35.349406 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32461): Terminated: ok {rc=0} 09:15:35.393695 --- ParallelTerminationStrategy: PID 32464 died... 09:15:35.412777 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32464): Terminated: ok {rc=0} 09:15:35.498970 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2402 gprs:trx-lms+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 09:15:36.585786 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:15:36.597458 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 09:15:36.648434 tst ping_idle_ping.py: using LAC 39912 09:15:36.775140 tst ping_idle_ping.py: using RAC 132 09:15:36.899352 tst ping_idle_ping.py: using CellId 39912 09:15:37.023943 tst ping_idle_ping.py: using BVCI 39913 09:15:37.140742 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:15:37.152164 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:15:37.163301 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:15:37.174485 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:15:37.186006 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:15:37.197722 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:15:37.209483 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:15:37.221130 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:15:37.336527 tst ping_idle_ping.py:24: start network... 09:15:37.533893 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:15:37.994274 run create_hlr_db(pid=32466): Launched 09:15:38.107191 bus /gobi_6: Setting Powered False 09:15:39.166330 run create_hlr_db(pid=32466): Terminated: ok {rc=0} 09:15:39.600766 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32468): Launched 09:15:39.917367 run osmo-hlr_10.42.42.2(pid=32469): Launched 09:15:40.038058 run osmo-stp_10.42.42.5: Starting osmo-stp 09:15:40.581681 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32471): Launched 09:15:40.898088 run osmo-stp_10.42.42.5(pid=32472): Launched 09:15:41.019040 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:15:41.563170 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32474): Launched 09:15:41.685262 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:15:41.950765 run patchelf(pid=32475): Launched 09:15:42.127202 run osmo-stp_10.42.42.5(pid=32472): ERR: Terminated: ERROR {rc=1} [trial-2402↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32472)] 09:15:42.260186 run osmo-stp_10.42.42.5(pid=32472): stdout: | (launched: 2022-12-14_09:15:40.840004) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:15:42.395095 run osmo-stp_10.42.42.5(pid=32472): stderr: | 20221214091541027 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214091541027 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214091541028 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214091541028 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214091541028 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214091541029 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214091541029 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:15:42.529924 run osmo-stp_10.42.42.5(pid=32472): stdout: | (launched: 2022-12-14_09:15:40.840004) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:15:42.659163 run osmo-stp_10.42.42.5(pid=32472): stderr: | 20221214091541027 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214091541027 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214091541028 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214091541028 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214091541028 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214091541029 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214091541029 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:15:42.812019 run patchelf(pid=32475): Terminating (SIGINT) 09:15:42.987702 run patchelf(pid=32475): Terminated: ok {rc=0} 09:15:43.114119 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=32472): Process ended prematurely: osmo-stp_10.42.42.5(pid=32472) [trial-2402↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32472)] [trial-2402↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27] 09:15:43.123635 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 09:15:43.151532 run osmo-hlr_10.42.42.2(pid=32469): ERR: Terminated: ERROR {rc=237} [trial-2402↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32469)] 09:15:43.201222 run osmo-hlr_10.42.42.2(pid=32469): stdout: | (launched: 2022-12-14_09:15:39.859576) 09:15:43.252634 run osmo-hlr_10.42.42.2(pid=32469): stderr: | 20221214091540055 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214091540055 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214091540055 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214091540055 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214091540055 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214091540055 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214091540066 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/gprs:trx-lms+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214091540074 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214091540075 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214091540075 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:15:43.304572 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32468): Terminating (SIGTERM) 09:15:43.346037 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32471): Terminating (SIGTERM) 09:15:43.387568 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32474): Terminating (SIGTERM) 09:15:43.429395 --- ParallelTerminationStrategy: PID 32468 died... 09:15:43.449378 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32468): Terminated: ok {rc=0} 09:15:43.495470 --- ParallelTerminationStrategy: PID 32471 died... 09:15:43.515135 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32471): Terminated: ok {rc=0} 09:15:43.561760 --- ParallelTerminationStrategy: PID 32474 died... 09:15:43.581575 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32474): Terminated: ok {rc=0} 09:15:43.669772 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2402 gprs:trx-lms+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 gprs:trx-lms+mod-bts0-dynts-ipa --------------------------------------------------------------------- 09:15:44.976557 tst gprs:trx-lms+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:15:44.983871 tst gprs:trx-lms+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 09:15:45.017635 tst gprs:trx-lms+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 09:15:45.057582 tst gprs:trx-lms+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 09:15:45.146654 tst gprs:trx-lms+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 09:15:45.180415 tst gprs:trx-lms+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 09:15:45.219728 tst gprs:trx-lms+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 09:15:45.813937 tst gprs:trx-lms+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2402 gprs:trx-lms+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 09:15:45.866561 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:15:45.877979 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 09:15:45.954633 tst cs_paging_gprs_active.py: using LAC 39913 09:15:46.084858 tst cs_paging_gprs_active.py: using RAC 133 09:15:46.240818 tst cs_paging_gprs_active.py: using CellId 39913 09:15:46.370063 tst cs_paging_gprs_active.py: using BVCI 39914 09:15:46.508326 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:15:46.520431 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:15:46.532490 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:15:46.544051 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:15:46.556088 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:15:46.568597 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:15:46.581460 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:15:46.593733 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:15:46.605784 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:15:46.727494 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:15:46.841716 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 09:15:47.051288 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:15:47.361475 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32481): Launched 09:15:47.638620 run iperf3-srv_10.42.42.10(pid=32482): Launched 09:15:47.751834 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 09:15:47.953031 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:15:48.254576 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32483): Launched 09:15:48.515828 run iperf3-srv_10.42.42.10(pid=32484): Launched 09:15:48.628639 tst cs_paging_gprs_active.py:38: start network... 09:15:48.829220 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:15:49.295008 run create_hlr_db(pid=32485): Launched 09:15:49.410199 bus /gobi_6: Setting Powered False 09:15:50.469527 run create_hlr_db(pid=32485): Terminated: ok {rc=0} 09:15:50.887022 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32487): Launched 09:15:51.185672 run osmo-hlr_10.42.42.2(pid=32488): Launched 09:15:51.299487 run osmo-stp_10.42.42.5: Starting osmo-stp 09:15:51.827357 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32490): Launched 09:15:52.129918 run osmo-stp_10.42.42.5(pid=32493): Launched 09:15:52.242541 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:15:52.758153 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32495): Launched 09:15:52.873943 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:15:53.134689 run patchelf(pid=32496): Launched 09:15:53.302234 run osmo-stp_10.42.42.5(pid=32493): ERR: Terminated: ERROR {rc=1} [trial-2402↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32493)] 09:15:53.429345 run osmo-stp_10.42.42.5(pid=32493): stdout: | (launched: 2022-12-14_09:15:52.074431) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:15:53.558424 run osmo-stp_10.42.42.5(pid=32493): stderr: | 20221214091552243 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214091552243 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214091552243 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214091552244 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214091552244 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214091552244 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214091552245 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:15:53.687360 run osmo-stp_10.42.42.5(pid=32493): stdout: | (launched: 2022-12-14_09:15:52.074431) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:15:53.811034 run osmo-stp_10.42.42.5(pid=32493): stderr: | 20221214091552243 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214091552243 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214091552243 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214091552244 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214091552244 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214091552244 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214091552245 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:15:53.957749 run patchelf(pid=32496): Terminating (SIGINT) 09:15:54.126611 run patchelf(pid=32496): Terminated: ok {rc=0} 09:15:54.248254 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=32493): Process ended prematurely: osmo-stp_10.42.42.5(pid=32493) [trial-2402↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32493)] [trial-2402↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 09:15:54.257940 tst cs_paging_gprs_active.py:38: Test FAILED (8.4 sec) 09:15:54.284927 run osmo-hlr_10.42.42.2(pid=32488): ERR: Terminated: ERROR {rc=237} [trial-2402↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32488)] 09:15:54.332894 run osmo-hlr_10.42.42.2(pid=32488): stdout: | (launched: 2022-12-14_09:15:51.130382) 09:15:54.382411 run osmo-hlr_10.42.42.2(pid=32488): stderr: | 20221214091551301 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214091551301 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214091551301 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214091551301 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214091551301 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214091551301 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214091551313 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/gprs:trx-lms+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214091551321 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214091551321 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214091551321 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:15:54.432162 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32481): Terminating (SIGTERM) 09:15:54.471731 run iperf3-srv_10.42.42.10(pid=32482): Terminating (SIGTERM) 09:15:54.511239 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32483): Terminating (SIGTERM) 09:15:54.550836 run iperf3-srv_10.42.42.10(pid=32484): Terminating (SIGTERM) 09:15:54.590316 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32487): Terminating (SIGTERM) 09:15:54.629860 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32490): Terminating (SIGTERM) 09:15:54.669386 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32495): Terminating (SIGTERM) 09:15:54.709314 --- ParallelTerminationStrategy: PID 32481 died... 09:15:54.728398 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32481): Terminated: ok {rc=0} 09:15:54.772428 --- ParallelTerminationStrategy: PID 32482 died... 09:15:54.791219 run iperf3-srv_10.42.42.10(pid=32482): Terminated {rc=256} 09:15:54.834789 --- ParallelTerminationStrategy: PID 32483 died... 09:15:54.853622 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32483): Terminated: ok {rc=0} 09:15:54.897291 --- ParallelTerminationStrategy: PID 32484 died... 09:15:54.916107 run iperf3-srv_10.42.42.10(pid=32484): Terminated {rc=256} 09:15:54.959695 --- ParallelTerminationStrategy: PID 32487 died... 09:15:54.978574 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32487): Terminated: ok {rc=0} 09:15:55.022070 --- ParallelTerminationStrategy: PID 32490 died... 09:15:55.040840 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32490): Terminated: ok {rc=0} 09:15:55.084445 --- ParallelTerminationStrategy: PID 32495 died... 09:15:55.103362 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32495): Terminated: ok {rc=0} 09:15:55.185976 bus /gobi_0: Setting Powered False 09:15:56.283045 bus /gobi_0: Setting Powered False 09:15:57.398260 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2402 gprs:trx-lms+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 09:15:58.538892 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:15:58.550395 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 09:15:58.620157 tst iperf3.py: using LAC 39914 09:15:58.737737 tst iperf3.py: using RAC 134 09:15:58.855085 tst iperf3.py: using CellId 39914 09:15:58.972029 tst iperf3.py: using BVCI 39915 09:15:59.081095 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:15:59.091956 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:15:59.102555 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:15:59.113511 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:15:59.123952 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:15:59.135860 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:15:59.146854 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:15:59.157690 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:15:59.168686 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:15:59.284552 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 09:15:59.502155 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:15:59.824691 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32498): Launched 09:16:00.103523 run iperf3-srv_10.42.42.10(pid=32499): Launched 09:16:00.223980 tst iperf3.py:8: start network... 09:16:00.440276 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:16:00.963936 run create_hlr_db(pid=32500): Launched 09:16:01.147453 bus /gobi_6: Setting Powered False 09:16:02.206738 run create_hlr_db(pid=32500): Terminated: ok {rc=0} 09:16:02.631232 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32502): Launched 09:16:02.930994 run osmo-hlr_10.42.42.2(pid=32503): Launched 09:16:03.045615 run osmo-stp_10.42.42.5: Starting osmo-stp 09:16:03.574818 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32505): Launched 09:16:03.876346 run osmo-stp_10.42.42.5(pid=32506): Launched 09:16:03.990891 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:16:04.508467 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32508): Launched 09:16:04.623622 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:16:04.877183 run patchelf(pid=32509): Launched 09:16:05.043704 run osmo-stp_10.42.42.5(pid=32506): ERR: Terminated: ERROR {rc=1} [trial-2402↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32506)] 09:16:05.170496 run osmo-stp_10.42.42.5(pid=32506): stdout: | (launched: 2022-12-14_09:16:03.821045) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:16:05.299698 run osmo-stp_10.42.42.5(pid=32506): stderr: | 20221214091603986 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214091603986 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214091603986 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214091603987 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214091603987 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214091603987 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214091603987 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:16:05.428396 run osmo-stp_10.42.42.5(pid=32506): stdout: | (launched: 2022-12-14_09:16:03.821045) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:16:05.551342 run osmo-stp_10.42.42.5(pid=32506): stderr: | 20221214091603986 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214091603986 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214091603986 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214091603987 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214091603987 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214091603987 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214091603987 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:16:05.697070 run patchelf(pid=32509): Terminating (SIGINT) 09:16:05.865346 run patchelf(pid=32509): Terminated: ok {rc=0} 09:16:05.986603 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32506): Process ended prematurely: osmo-stp_10.42.42.5(pid=32506) [trial-2402↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32506)] [trial-2402↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8] 09:16:05.996034 tst iperf3.py:8: Test FAILED (7.5 sec) 09:16:06.023271 run osmo-hlr_10.42.42.2(pid=32503): ERR: Terminated: ERROR {rc=237} [trial-2402↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32503)] 09:16:06.072021 run osmo-hlr_10.42.42.2(pid=32503): stdout: | (launched: 2022-12-14_09:16:02.875563) 09:16:06.121806 run osmo-hlr_10.42.42.2(pid=32503): stderr: | 20221214091603048 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214091603048 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214091603048 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214091603048 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214091603048 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214091603048 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214091603060 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/gprs:trx-lms+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214091603069 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214091603069 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214091603070 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:16:06.171742 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32498): Terminating (SIGTERM) 09:16:06.211777 run iperf3-srv_10.42.42.10(pid=32499): Terminating (SIGTERM) 09:16:06.251821 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32502): Terminating (SIGTERM) 09:16:06.291877 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32505): Terminating (SIGTERM) 09:16:06.331898 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32508): Terminating (SIGTERM) 09:16:06.372078 --- ParallelTerminationStrategy: PID 32498 died... 09:16:06.391665 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32498): Terminated: ok {rc=0} 09:16:06.435865 --- ParallelTerminationStrategy: PID 32499 died... 09:16:06.454726 run iperf3-srv_10.42.42.10(pid=32499): Terminated {rc=256} 09:16:06.498813 --- ParallelTerminationStrategy: PID 32502 died... 09:16:06.517776 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32502): Terminated: ok {rc=0} 09:16:06.561550 --- ParallelTerminationStrategy: PID 32505 died... 09:16:06.580424 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32505): Terminated: ok {rc=0} 09:16:06.624240 --- ParallelTerminationStrategy: PID 32508 died... 09:16:06.643210 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32508): Terminated: ok {rc=0} 09:16:06.729602 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2402 gprs:trx-lms+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 09:16:07.875249 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:16:07.886820 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 09:16:07.954593 tst iperf3m4.py: using LAC 39915 09:16:08.074082 tst iperf3m4.py: using RAC 135 09:16:08.190007 tst iperf3m4.py: using CellId 39915 09:16:08.308582 tst iperf3m4.py: using BVCI 39916 09:16:08.417808 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:16:08.428592 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:16:08.439346 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:16:08.450076 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:16:08.460757 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:16:08.472191 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:16:08.483229 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:16:08.494334 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:16:08.505594 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:16:08.621512 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:16:08.738901 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:16:08.859645 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:16:08.977659 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 09:16:09.178254 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:16:09.479523 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32510): Launched 09:16:09.740293 run iperf3-srv_10.42.42.10(pid=32511): Launched 09:16:09.852568 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 09:16:10.052398 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:16:10.353595 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32512): Launched 09:16:10.614603 run iperf3-srv_10.42.42.10(pid=32513): Launched 09:16:10.728627 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 09:16:10.928414 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:16:11.229359 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32514): Launched 09:16:11.491735 run iperf3-srv_10.42.42.10(pid=32515): Launched 09:16:11.604044 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 09:16:11.803430 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:16:12.104731 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32516): Launched 09:16:12.365591 run iperf3-srv_10.42.42.10(pid=32517): Launched 09:16:12.478130 tst iperf3m4.py:8: start network... 09:16:12.678018 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:16:13.143832 run create_hlr_db(pid=32518): Launched 09:16:13.257944 bus /gobi_6: Setting Powered False 09:16:14.318220 run create_hlr_db(pid=32518): Terminated: ok {rc=0} 09:16:14.757305 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32520): Launched 09:16:15.077442 run osmo-hlr_10.42.42.2(pid=32521): Launched 09:16:15.201267 run osmo-stp_10.42.42.5: Starting osmo-stp 09:16:15.754863 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32523): Launched 09:16:16.130962 run osmo-stp_10.42.42.5(pid=32524): Launched 09:16:16.570531 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:16:17.156421 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32526): Launched 09:16:17.286361 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:16:17.540877 run patchelf(pid=32527): Launched 09:16:17.707282 run osmo-stp_10.42.42.5(pid=32524): ERR: Terminated: ERROR {rc=1} [trial-2402↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32524)] 09:16:17.833559 run osmo-stp_10.42.42.5(pid=32524): stdout: | (launched: 2022-12-14_09:16:16.053237) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:16:17.961311 run osmo-stp_10.42.42.5(pid=32524): stderr: | 20221214091616372 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214091616372 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214091616373 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214091616374 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214091616376 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214091616376 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214091616376 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:16:18.089805 run osmo-stp_10.42.42.5(pid=32524): stdout: | (launched: 2022-12-14_09:16:16.053237) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:16:18.212628 run osmo-stp_10.42.42.5(pid=32524): stderr: | 20221214091616372 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214091616372 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214091616373 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214091616374 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214091616376 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214091616376 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214091616376 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:16:18.357780 run patchelf(pid=32527): Terminating (SIGINT) 09:16:18.524406 run patchelf(pid=32527): Terminated: ok {rc=0} 09:16:18.645172 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32524): Process ended prematurely: osmo-stp_10.42.42.5(pid=32524) [trial-2402↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32524)] [trial-2402↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8] 09:16:18.654671 tst iperf3m4.py:8: Test FAILED (10.8 sec) 09:16:18.681931 run osmo-hlr_10.42.42.2(pid=32521): ERR: Terminated: ERROR {rc=237} [trial-2402↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32521)] 09:16:18.729849 run osmo-hlr_10.42.42.2(pid=32521): stdout: | (launched: 2022-12-14_09:16:15.018508) 09:16:18.778914 run osmo-hlr_10.42.42.2(pid=32521): stderr: | 20221214091615213 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214091615213 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214091615213 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214091615213 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214091615213 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214091615213 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214091615228 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/gprs:trx-lms+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214091615238 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214091615238 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214091615238 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:16:18.829158 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32510): Terminating (SIGTERM) 09:16:18.869375 run iperf3-srv_10.42.42.10(pid=32511): Terminating (SIGTERM) 09:16:18.909295 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32512): Terminating (SIGTERM) 09:16:18.949204 run iperf3-srv_10.42.42.10(pid=32513): Terminating (SIGTERM) 09:16:18.989126 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32514): Terminating (SIGTERM) 09:16:19.029050 run iperf3-srv_10.42.42.10(pid=32515): Terminating (SIGTERM) 09:16:19.068854 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32516): Terminating (SIGTERM) 09:16:19.108469 run iperf3-srv_10.42.42.10(pid=32517): Terminating (SIGTERM) 09:16:19.148320 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32520): Terminating (SIGTERM) 09:16:19.187957 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32523): Terminating (SIGTERM) 09:16:19.227663 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32526): Terminating (SIGTERM) 09:16:19.267390 --- ParallelTerminationStrategy: PID 32510 died... 09:16:19.286404 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32510): Terminated: ok {rc=0} 09:16:19.331011 --- ParallelTerminationStrategy: PID 32511 died... 09:16:19.350203 run iperf3-srv_10.42.42.10(pid=32511): Terminated {rc=256} 09:16:19.394288 --- ParallelTerminationStrategy: PID 32512 died... 09:16:19.413328 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32512): Terminated: ok {rc=0} 09:16:19.457470 --- ParallelTerminationStrategy: PID 32513 died... 09:16:19.476277 run iperf3-srv_10.42.42.10(pid=32513): Terminated {rc=256} 09:16:19.520350 --- ParallelTerminationStrategy: PID 32514 died... 09:16:19.539406 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32514): Terminated: ok {rc=0} 09:16:19.583399 --- ParallelTerminationStrategy: PID 32515 died... 09:16:19.602344 run iperf3-srv_10.42.42.10(pid=32515): Terminated {rc=256} 09:16:19.646414 --- ParallelTerminationStrategy: PID 32516 died... 09:16:19.665420 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32516): Terminated: ok {rc=0} 09:16:19.709342 --- ParallelTerminationStrategy: PID 32517 died... 09:16:19.728377 run iperf3-srv_10.42.42.10(pid=32517): Terminated {rc=256} 09:16:19.772450 --- ParallelTerminationStrategy: PID 32520 died... 09:16:19.791367 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32520): Terminated: ok {rc=0} 09:16:19.835191 --- ParallelTerminationStrategy: PID 32523 died... 09:16:19.854112 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32523): Terminated: ok {rc=0} 09:16:19.897876 --- ParallelTerminationStrategy: PID 32526 died... 09:16:19.916830 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32526): Terminated: ok {rc=0} 09:16:20.002933 bus /gobi_4: Setting Powered False 09:16:21.101689 bus /gobi_4: Setting Powered False 09:16:22.215444 bus /gobi_1: Setting Powered False 09:16:23.313317 bus /gobi_1: Setting Powered False 09:16:24.431252 bus /gobi_0: Setting Powered False 09:16:25.530506 bus /gobi_0: Setting Powered False 09:16:26.645195 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2402 gprs:trx-lms+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 09:16:27.748176 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:16:27.760228 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 09:16:27.832228 tst ping.py: using LAC 39916 09:16:27.956748 tst ping.py: using RAC 136 09:16:28.079228 tst ping.py: using CellId 39916 09:16:28.202400 tst ping.py: using BVCI 39917 09:16:28.317698 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:16:28.329231 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:16:28.340332 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:16:28.351468 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:16:28.362606 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:16:28.373843 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:16:28.385178 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:16:28.396321 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:16:28.513665 tst ping.py:19: start network... 09:16:28.725562 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:16:29.212613 run create_hlr_db(pid=32528): Launched 09:16:29.340475 bus /gobi_6: Setting Powered False 09:16:30.403010 run create_hlr_db(pid=32528): Terminated: ok {rc=0} 09:16:30.825701 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32530): Launched 09:16:31.142090 run osmo-hlr_10.42.42.2(pid=32531): Launched 09:16:31.388832 run osmo-stp_10.42.42.5: Starting osmo-stp 09:16:32.115153 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32533): Launched 09:16:32.445782 run osmo-stp_10.42.42.5(pid=32534): Launched 09:16:32.559180 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:16:33.068220 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32536): Launched 09:16:33.181012 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:16:33.429292 run patchelf(pid=32537): Launched 09:16:33.592739 run osmo-stp_10.42.42.5(pid=32534): ERR: Terminated: ERROR {rc=1} [trial-2402↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32534)] 09:16:33.717422 run osmo-stp_10.42.42.5(pid=32534): stdout: | (launched: 2022-12-14_09:16:32.387679) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:16:33.843250 run osmo-stp_10.42.42.5(pid=32534): stderr: | 20221214091632557 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214091632558 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214091632558 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214091632558 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214091632559 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214091632559 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214091632559 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:16:33.969650 run osmo-stp_10.42.42.5(pid=32534): stdout: | (launched: 2022-12-14_09:16:32.387679) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:16:34.090779 run osmo-stp_10.42.42.5(pid=32534): stderr: | 20221214091632557 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214091632558 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214091632558 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214091632558 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214091632559 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214091632559 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214091632559 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:16:34.233717 run patchelf(pid=32537): Terminating (SIGINT) 09:16:34.398127 run patchelf(pid=32537): Terminated: ok {rc=0} 09:16:34.516410 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=32534): Process ended prematurely: osmo-stp_10.42.42.5(pid=32534) [trial-2402↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32534)] [trial-2402↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22] 09:16:34.525550 tst ping.py:22: Test FAILED (6.8 sec) 09:16:34.552112 run osmo-hlr_10.42.42.2(pid=32531): ERR: Terminated: ERROR {rc=237} [trial-2402↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32531)] 09:16:34.600085 run osmo-hlr_10.42.42.2(pid=32531): stdout: | (launched: 2022-12-14_09:16:31.082338) 09:16:34.649642 run osmo-hlr_10.42.42.2(pid=32531): stderr: | 20221214091631333 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214091631333 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214091631333 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214091631333 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214091631333 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214091631333 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214091631349 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/gprs:trx-lms+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214091631366 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214091631366 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214091631367 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:16:34.699809 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32530): Terminating (SIGTERM) 09:16:34.739961 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32533): Terminating (SIGTERM) 09:16:34.779928 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32536): Terminating (SIGTERM) 09:16:34.820067 --- ParallelTerminationStrategy: PID 32530 died... 09:16:34.839649 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32530): Terminated: ok {rc=0} 09:16:34.883884 --- ParallelTerminationStrategy: PID 32533 died... 09:16:34.902909 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32533): Terminated: ok {rc=0} 09:16:34.946986 --- ParallelTerminationStrategy: PID 32536 died... 09:16:34.966002 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32536): Terminated: ok {rc=0} 09:16:35.051924 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2402 gprs:trx-lms+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 09:16:36.140646 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:16:36.152111 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 09:16:36.223401 tst ping_idle_ping.py: using LAC 39917 09:16:36.341201 tst ping_idle_ping.py: using RAC 137 09:16:36.457627 tst ping_idle_ping.py: using CellId 39917 09:16:36.574643 tst ping_idle_ping.py: using BVCI 39918 09:16:36.684339 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:16:36.695243 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:16:36.706022 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:16:36.716699 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:16:36.728251 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:16:36.739873 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:16:36.751438 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:16:36.762947 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:16:36.882277 tst ping_idle_ping.py:24: start network... 09:16:37.093894 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:16:37.586135 run create_hlr_db(pid=32538): Launched 09:16:37.716295 bus /gobi_6: Setting Powered False 09:16:38.779873 run create_hlr_db(pid=32538): Terminated: ok {rc=0} 09:16:39.202684 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32540): Launched 09:16:39.497389 run osmo-hlr_10.42.42.2(pid=32541): Launched 09:16:39.610172 run osmo-stp_10.42.42.5: Starting osmo-stp 09:16:40.129868 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32543): Launched 09:16:40.424581 run osmo-stp_10.42.42.5(pid=32544): Launched 09:16:40.537778 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:16:41.048196 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32546): Launched 09:16:41.161397 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:16:41.410561 run patchelf(pid=32547): Launched 09:16:41.575233 run osmo-stp_10.42.42.5(pid=32544): ERR: Terminated: ERROR {rc=1} [trial-2402↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32544)] 09:16:41.700759 run osmo-stp_10.42.42.5(pid=32544): stdout: | (launched: 2022-12-14_09:16:40.369915) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:16:41.828413 run osmo-stp_10.42.42.5(pid=32544): stderr: | 20221214091640536 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214091640536 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214091640537 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214091640537 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214091640538 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214091640538 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214091640538 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:16:41.955541 run osmo-stp_10.42.42.5(pid=32544): stdout: | (launched: 2022-12-14_09:16:40.369915) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:16:42.076891 run osmo-stp_10.42.42.5(pid=32544): stderr: | 20221214091640536 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214091640536 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214091640537 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214091640537 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214091640538 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214091640538 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214091640538 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:16:42.220902 run patchelf(pid=32547): Terminating (SIGINT) 09:16:42.386631 run patchelf(pid=32547): Terminated: ok {rc=0} 09:16:42.505868 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=32544): Process ended prematurely: osmo-stp_10.42.42.5(pid=32544) [trial-2402↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32544)] [trial-2402↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 09:16:42.514848 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 09:16:42.541512 run osmo-hlr_10.42.42.2(pid=32541): ERR: Terminated: ERROR {rc=237} [trial-2402↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32541)] 09:16:42.589413 run osmo-hlr_10.42.42.2(pid=32541): stdout: | (launched: 2022-12-14_09:16:39.442654) 09:16:42.638705 run osmo-hlr_10.42.42.2(pid=32541): stderr: | 20221214091639614 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214091639614 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214091639614 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214091639614 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214091639614 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214091639614 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214091639626 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/gprs:trx-lms+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214091639636 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214091639636 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214091639636 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:16:42.688449 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32540): Terminating (SIGTERM) 09:16:42.728214 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32543): Terminating (SIGTERM) 09:16:42.768070 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32546): Terminating (SIGTERM) 09:16:42.808151 --- ParallelTerminationStrategy: PID 32540 died... 09:16:42.827733 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32540): Terminated: ok {rc=0} 09:16:42.871902 --- ParallelTerminationStrategy: PID 32543 died... 09:16:42.890883 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32543): Terminated: ok {rc=0} 09:16:42.934824 --- ParallelTerminationStrategy: PID 32546 died... 09:16:42.953776 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32546): Terminated: ok {rc=0} 09:16:43.037339 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2402 gprs:trx-lms+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 gprs:trx-lms+mod-bts0-dynts-osmo --------------------------------------------------------------------- 09:16:44.345024 tst gprs:trx-lms+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:16:44.351711 tst gprs:trx-lms+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 09:16:44.386083 tst gprs:trx-lms+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 09:16:44.426192 tst gprs:trx-lms+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 09:16:44.515167 tst gprs:trx-lms+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 09:16:44.548997 tst gprs:trx-lms+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 09:16:44.588465 tst gprs:trx-lms+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 09:16:45.182802 tst gprs:trx-lms+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2402 gprs:trx-lms+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 09:16:45.234424 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:16:45.245823 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 09:16:45.317107 tst cs_paging_gprs_active.py: using LAC 39918 09:16:45.446198 tst cs_paging_gprs_active.py: using RAC 138 09:16:45.572803 tst cs_paging_gprs_active.py: using CellId 39918 09:16:45.697851 tst cs_paging_gprs_active.py: using BVCI 39919 09:16:45.814920 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:16:45.826393 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:16:45.838816 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:16:45.850918 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:16:45.862825 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:16:45.874925 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:16:45.888029 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:16:45.899710 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:16:45.911573 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 09:16:46.054557 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 09:16:46.200724 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 09:16:46.409338 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:16:46.723571 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32551): Launched 09:16:47.005642 run iperf3-srv_10.42.42.10(pid=32552): Launched 09:16:47.138932 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 09:16:47.345674 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:16:47.648682 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32553): Launched 09:16:47.910848 run iperf3-srv_10.42.42.10(pid=32554): Launched 09:16:48.025711 tst cs_paging_gprs_active.py:38: start network... 09:16:48.226418 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:16:48.692261 run create_hlr_db(pid=32555): Launched 09:16:48.807564 bus /gobi_6: Setting Powered False 09:16:49.867993 run create_hlr_db(pid=32555): Terminated: ok {rc=0} 09:16:50.285435 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32557): Launched 09:16:50.586067 run osmo-hlr_10.42.42.2(pid=32558): Launched 09:16:50.700754 run osmo-stp_10.42.42.5: Starting osmo-stp 09:16:51.222266 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32560): Launched 09:16:51.523143 run osmo-stp_10.42.42.5(pid=32561): Launched 09:16:51.640098 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:16:52.158807 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32563): Launched 09:16:52.273283 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:16:52.526948 run patchelf(pid=32564): Launched 09:16:52.695082 run osmo-stp_10.42.42.5(pid=32561): ERR: Terminated: ERROR {rc=1} [trial-2402↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32561)] 09:16:52.821979 run osmo-stp_10.42.42.5(pid=32561): stdout: | (launched: 2022-12-14_09:16:51.467365) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:16:52.951149 run osmo-stp_10.42.42.5(pid=32561): stderr: | 20221214091651633 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214091651633 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214091651633 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214091651634 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214091651635 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214091651635 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214091651635 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:16:53.080134 run osmo-stp_10.42.42.5(pid=32561): stdout: | (launched: 2022-12-14_09:16:51.467365) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:16:53.203627 run osmo-stp_10.42.42.5(pid=32561): stderr: | 20221214091651633 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214091651633 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214091651633 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214091651634 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214091651635 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214091651635 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214091651635 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:16:53.349580 run patchelf(pid=32564): Terminating (SIGINT) 09:16:53.517470 run patchelf(pid=32564): Terminated: ok {rc=0} 09:16:53.638502 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=32561): Process ended prematurely: osmo-stp_10.42.42.5(pid=32561) [trial-2402↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32561)] [trial-2402↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 09:16:53.648022 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 09:16:53.675140 run osmo-hlr_10.42.42.2(pid=32558): ERR: Terminated: ERROR {rc=237} [trial-2402↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32558)] 09:16:53.723181 run osmo-hlr_10.42.42.2(pid=32558): stdout: | (launched: 2022-12-14_09:16:50.530127) 09:16:53.772896 run osmo-hlr_10.42.42.2(pid=32558): stderr: | 20221214091650702 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214091650702 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214091650702 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214091650702 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214091650702 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214091650702 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214091650714 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/gprs:trx-lms+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214091650722 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214091650722 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214091650722 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:16:53.822967 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32551): Terminating (SIGTERM) 09:16:53.862870 run iperf3-srv_10.42.42.10(pid=32552): Terminating (SIGTERM) 09:16:53.902486 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32553): Terminating (SIGTERM) 09:16:53.942121 run iperf3-srv_10.42.42.10(pid=32554): Terminating (SIGTERM) 09:16:53.981599 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32557): Terminating (SIGTERM) 09:16:54.021297 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32560): Terminating (SIGTERM) 09:16:54.060889 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32563): Terminating (SIGTERM) 09:16:54.100789 --- ParallelTerminationStrategy: PID 32551 died... 09:16:54.120321 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32551): Terminated: ok {rc=0} 09:16:54.164265 --- ParallelTerminationStrategy: PID 32552 died... 09:16:54.183042 run iperf3-srv_10.42.42.10(pid=32552): Terminated {rc=256} 09:16:54.226755 --- ParallelTerminationStrategy: PID 32553 died... 09:16:54.245732 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32553): Terminated: ok {rc=0} 09:16:54.289524 --- ParallelTerminationStrategy: PID 32554 died... 09:16:54.308316 run iperf3-srv_10.42.42.10(pid=32554): Terminated {rc=256} 09:16:54.352035 --- ParallelTerminationStrategy: PID 32557 died... 09:16:54.370996 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32557): Terminated: ok {rc=0} 09:16:54.414730 --- ParallelTerminationStrategy: PID 32560 died... 09:16:54.433639 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32560): Terminated: ok {rc=0} 09:16:54.477885 --- ParallelTerminationStrategy: PID 32563 died... 09:16:54.496799 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32563): Terminated: ok {rc=0} 09:16:54.580989 bus /gobi_0: Setting Powered False 09:16:55.678837 bus /gobi_0: Setting Powered False 09:16:56.796407 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2402 gprs:trx-lms+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 09:16:57.940157 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:16:57.951708 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 09:16:58.022180 tst iperf3.py: using LAC 39919 09:16:58.142970 tst iperf3.py: using RAC 139 09:16:58.262758 tst iperf3.py: using CellId 39919 09:16:58.387505 tst iperf3.py: using BVCI 39920 09:16:58.498558 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:16:58.509494 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:16:58.520442 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:16:58.531095 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:16:58.541942 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:16:58.553378 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:16:58.564593 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:16:58.575711 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:16:58.586934 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 09:16:58.702247 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 09:16:58.903446 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:16:59.205319 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32565): Launched 09:16:59.466544 run iperf3-srv_10.42.42.10(pid=32566): Launched 09:16:59.581398 tst iperf3.py:8: start network... 09:16:59.781873 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:17:00.249359 run create_hlr_db(pid=32567): Launched 09:17:00.381351 bus /gobi_6: Setting Powered False 09:17:01.450997 run create_hlr_db(pid=32567): Terminated: ok {rc=0} 09:17:01.905287 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32572): Launched 09:17:02.242114 run osmo-hlr_10.42.42.2(pid=32573): Launched 09:17:02.367507 run osmo-stp_10.42.42.5: Starting osmo-stp 09:17:02.926745 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32575): Launched 09:17:03.249595 run osmo-stp_10.42.42.5(pid=32576): Launched 09:17:03.370769 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:17:03.929191 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32578): Launched 09:17:04.051271 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:17:04.323270 run patchelf(pid=32579): Launched 09:17:04.502710 run osmo-stp_10.42.42.5(pid=32576): ERR: Terminated: ERROR {rc=1} [trial-2402↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32576)] 09:17:04.638178 run osmo-stp_10.42.42.5(pid=32576): stdout: | (launched: 2022-12-14_09:17:03.190419) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:17:04.774844 run osmo-stp_10.42.42.5(pid=32576): stderr: | 20221214091703379 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214091703379 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214091703380 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214091703380 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214091703381 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214091703381 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214091703381 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:17:04.911879 run osmo-stp_10.42.42.5(pid=32576): stdout: | (launched: 2022-12-14_09:17:03.190419) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:17:05.043524 run osmo-stp_10.42.42.5(pid=32576): stderr: | 20221214091703379 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214091703379 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214091703380 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214091703380 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214091703381 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214091703381 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214091703381 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:17:05.199284 run patchelf(pid=32579): Terminating (SIGINT) 09:17:05.377768 run patchelf(pid=32579): Terminated: ok {rc=0} 09:17:05.506397 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32576): Process ended prematurely: osmo-stp_10.42.42.5(pid=32576) [trial-2402↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32576)] [trial-2402↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8] 09:17:05.516517 tst iperf3.py:8: Test FAILED (7.6 sec) 09:17:05.545115 run osmo-hlr_10.42.42.2(pid=32573): ERR: Terminated: ERROR {rc=237} [trial-2402↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32573)] 09:17:05.595303 run osmo-hlr_10.42.42.2(pid=32573): stdout: | (launched: 2022-12-14_09:17:02.183299) 09:17:05.647219 run osmo-hlr_10.42.42.2(pid=32573): stderr: | 20221214091702378 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214091702378 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214091702378 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214091702378 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214091702378 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214091702379 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214091702391 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/gprs:trx-lms+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214091702399 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214091702400 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214091702400 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:17:05.699342 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32565): Terminating (SIGTERM) 09:17:05.741086 run iperf3-srv_10.42.42.10(pid=32566): Terminating (SIGTERM) 09:17:05.782568 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32572): Terminating (SIGTERM) 09:17:05.824141 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32575): Terminating (SIGTERM) 09:17:05.865661 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32578): Terminating (SIGTERM) 09:17:05.907373 --- ParallelTerminationStrategy: PID 32565 died... 09:17:05.927350 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32565): Terminated: ok {rc=0} 09:17:05.973546 --- ParallelTerminationStrategy: PID 32566 died... 09:17:05.992731 run iperf3-srv_10.42.42.10(pid=32566): Terminated {rc=256} 09:17:06.038634 --- ParallelTerminationStrategy: PID 32572 died... 09:17:06.058223 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32572): Terminated: ok {rc=0} 09:17:06.104155 --- ParallelTerminationStrategy: PID 32575 died... 09:17:06.123868 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32575): Terminated: ok {rc=0} 09:17:06.169802 --- ParallelTerminationStrategy: PID 32578 died... 09:17:06.189469 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32578): Terminated: ok {rc=0} 09:17:06.276928 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2402 gprs:trx-lms+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 09:17:07.424172 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:17:07.435978 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 09:17:07.506313 tst iperf3m4.py: using LAC 39920 09:17:07.626924 tst iperf3m4.py: using RAC 140 09:17:07.747949 tst iperf3m4.py: using CellId 39920 09:17:07.866300 tst iperf3m4.py: using BVCI 39921 09:17:07.978128 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:17:07.989086 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:17:07.999967 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:17:08.010626 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:17:08.021655 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:17:08.033291 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:17:08.044712 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:17:08.056277 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:17:08.067694 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 09:17:08.183734 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 09:17:08.303920 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 09:17:08.421593 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 09:17:08.539395 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 09:17:08.741324 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:17:09.044485 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32580): Launched 09:17:09.307872 run iperf3-srv_10.42.42.10(pid=32581): Launched 09:17:09.421059 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 09:17:09.622137 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:17:09.924652 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32582): Launched 09:17:10.187564 run iperf3-srv_10.42.42.10(pid=32583): Launched 09:17:10.300208 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 09:17:10.500504 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:17:10.802786 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32584): Launched 09:17:11.067030 run iperf3-srv_10.42.42.10(pid=32585): Launched 09:17:11.179972 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 09:17:11.380554 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:17:11.682840 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32586): Launched 09:17:11.946202 run iperf3-srv_10.42.42.10(pid=32587): Launched 09:17:12.061050 tst iperf3m4.py:8: start network... 09:17:12.261703 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:17:12.727670 run create_hlr_db(pid=32588): Launched 09:17:12.842048 bus /gobi_6: Setting Powered False 09:17:13.902302 run create_hlr_db(pid=32588): Terminated: ok {rc=0} 09:17:14.320605 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32590): Launched 09:17:14.622298 run osmo-hlr_10.42.42.2(pid=32591): Launched 09:17:14.737280 run osmo-stp_10.42.42.5: Starting osmo-stp 09:17:15.270124 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32593): Launched 09:17:15.571830 run osmo-stp_10.42.42.5(pid=32594): Launched 09:17:15.688671 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:17:16.221853 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32596): Launched 09:17:16.350753 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:17:16.632278 run patchelf(pid=32597): Launched 09:17:16.827537 run osmo-stp_10.42.42.5(pid=32594): ERR: Terminated: ERROR {rc=1} [trial-2402↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32594)] 09:17:16.967241 run osmo-stp_10.42.42.5(pid=32594): stdout: | (launched: 2022-12-14_09:17:15.515471) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:17:17.110496 run osmo-stp_10.42.42.5(pid=32594): stderr: | 20221214091715683 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214091715683 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214091715683 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214091715684 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214091715684 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214091715685 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214091715685 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:17:17.249637 run osmo-stp_10.42.42.5(pid=32594): stdout: | (launched: 2022-12-14_09:17:15.515471) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:17:17.381074 run osmo-stp_10.42.42.5(pid=32594): stderr: | 20221214091715683 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214091715683 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214091715683 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214091715684 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214091715684 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214091715685 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214091715685 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:17:17.537187 run patchelf(pid=32597): Terminating (SIGINT) 09:17:17.716383 run patchelf(pid=32597): Terminated: ok {rc=0} 09:17:17.845232 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32594): Process ended prematurely: osmo-stp_10.42.42.5(pid=32594) [trial-2402↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32594)] [trial-2402↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8] 09:17:17.855744 tst iperf3m4.py:8: Test FAILED (10.5 sec) 09:17:17.884918 run osmo-hlr_10.42.42.2(pid=32591): ERR: Terminated: ERROR {rc=237} [trial-2402↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32591)] 09:17:17.934924 run osmo-hlr_10.42.42.2(pid=32591): stdout: | (launched: 2022-12-14_09:17:14.566099) 09:17:17.986724 run osmo-hlr_10.42.42.2(pid=32591): stderr: | 20221214091714738 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214091714738 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214091714738 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214091714738 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214091714738 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214091714738 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214091714751 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/gprs:trx-lms+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214091714761 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214091714762 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214091714762 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:17:18.039103 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32580): Terminating (SIGTERM) 09:17:18.081057 run iperf3-srv_10.42.42.10(pid=32581): Terminating (SIGTERM) 09:17:18.122808 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32582): Terminating (SIGTERM) 09:17:18.164430 run iperf3-srv_10.42.42.10(pid=32583): Terminating (SIGTERM) 09:17:18.206207 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32584): Terminating (SIGTERM) 09:17:18.248081 run iperf3-srv_10.42.42.10(pid=32585): Terminating (SIGTERM) 09:17:18.289757 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32586): Terminating (SIGTERM) 09:17:18.331492 run iperf3-srv_10.42.42.10(pid=32587): Terminating (SIGTERM) 09:17:18.373198 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32590): Terminating (SIGTERM) 09:17:18.414739 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32593): Terminating (SIGTERM) 09:17:18.456344 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32596): Terminating (SIGTERM) 09:17:18.498120 --- ParallelTerminationStrategy: PID 32580 died... 09:17:18.518262 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32580): Terminated: ok {rc=0} 09:17:18.564597 --- ParallelTerminationStrategy: PID 32581 died... 09:17:18.584662 run iperf3-srv_10.42.42.10(pid=32581): Terminated {rc=256} 09:17:18.630834 --- ParallelTerminationStrategy: PID 32582 died... 09:17:18.650691 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32582): Terminated: ok {rc=0} 09:17:18.696729 --- ParallelTerminationStrategy: PID 32583 died... 09:17:18.716465 run iperf3-srv_10.42.42.10(pid=32583): Terminated {rc=256} 09:17:18.762376 --- ParallelTerminationStrategy: PID 32584 died... 09:17:18.783773 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32584): Terminated: ok {rc=0} 09:17:18.829770 --- ParallelTerminationStrategy: PID 32585 died... 09:17:18.849510 run iperf3-srv_10.42.42.10(pid=32585): Terminated {rc=256} 09:17:18.895657 --- ParallelTerminationStrategy: PID 32586 died... 09:17:18.915169 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32586): Terminated: ok {rc=0} 09:17:18.961363 --- ParallelTerminationStrategy: PID 32587 died... 09:17:18.981058 run iperf3-srv_10.42.42.10(pid=32587): Terminated {rc=256} 09:17:19.026994 --- ParallelTerminationStrategy: PID 32590 died... 09:17:19.046857 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32590): Terminated: ok {rc=0} 09:17:19.093649 --- ParallelTerminationStrategy: PID 32593 died... 09:17:19.113491 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32593): Terminated: ok {rc=0} 09:17:19.159882 --- ParallelTerminationStrategy: PID 32596 died... 09:17:19.179791 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32596): Terminated: ok {rc=0} 09:17:19.267841 bus /gobi_4: Setting Powered False 09:17:20.366060 bus /gobi_4: Setting Powered False 09:17:21.481697 bus /gobi_1: Setting Powered False 09:17:22.580647 bus /gobi_1: Setting Powered False 09:17:23.696806 bus /gobi_0: Setting Powered False 09:17:24.795445 bus /gobi_0: Setting Powered False 09:17:25.910729 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2402 gprs:trx-lms+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 09:17:27.013074 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:17:27.025088 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 09:17:27.097269 tst ping.py: using LAC 39921 09:17:27.221669 tst ping.py: using RAC 141 09:17:27.345412 tst ping.py: using CellId 39921 09:17:27.464117 tst ping.py: using BVCI 39922 09:17:27.572288 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:17:27.583600 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:17:27.594599 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:17:27.605561 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:17:27.617240 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:17:27.629006 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:17:27.640681 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:17:27.652449 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 09:17:27.772200 tst ping.py:19: start network... 09:17:27.984365 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:17:28.474392 run create_hlr_db(pid=32598): Launched 09:17:28.604735 bus /gobi_6: Setting Powered False 09:17:29.667980 run create_hlr_db(pid=32598): Terminated: ok {rc=0} 09:17:30.088596 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32600): Launched 09:17:30.384781 run osmo-hlr_10.42.42.2(pid=32601): Launched 09:17:30.497513 run osmo-stp_10.42.42.5: Starting osmo-stp 09:17:31.076827 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32603): Launched 09:17:31.390255 run osmo-stp_10.42.42.5(pid=32604): Launched 09:17:31.562532 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:17:32.287198 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32606): Launched 09:17:32.421056 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:17:32.689076 run patchelf(pid=32607): Launched 09:17:32.864297 run osmo-stp_10.42.42.5(pid=32604): ERR: Terminated: ERROR {rc=1} [trial-2402↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32604)] 09:17:32.998039 run osmo-stp_10.42.42.5(pid=32604): stdout: | (launched: 2022-12-14_09:17:31.334482) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:17:33.133292 run osmo-stp_10.42.42.5(pid=32604): stderr: | 20221214091731709 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214091731710 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214091731712 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214091731714 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214091731716 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214091731717 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214091731718 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:17:33.269169 run osmo-stp_10.42.42.5(pid=32604): stdout: | (launched: 2022-12-14_09:17:31.334482) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:17:33.398773 run osmo-stp_10.42.42.5(pid=32604): stderr: | 20221214091731709 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214091731710 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214091731712 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214091731714 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214091731716 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214091731717 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214091731718 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:17:33.552067 run patchelf(pid=32607): Terminating (SIGINT) 09:17:33.729197 run patchelf(pid=32607): Terminated: ok {rc=0} 09:17:33.856109 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=32604): Process ended prematurely: osmo-stp_10.42.42.5(pid=32604) [trial-2402↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32604)] [trial-2402↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22] 09:17:33.865687 tst ping.py:22: Test FAILED (6.8 sec) 09:17:33.893648 run osmo-hlr_10.42.42.2(pid=32601): ERR: Terminated: ERROR {rc=237} [trial-2402↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32601)] 09:17:33.943132 run osmo-hlr_10.42.42.2(pid=32601): stdout: | (launched: 2022-12-14_09:17:30.329811) 09:17:33.994456 run osmo-hlr_10.42.42.2(pid=32601): stderr: | 20221214091730501 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214091730501 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214091730501 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214091730502 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214091730502 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214091730502 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214091730514 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/gprs:trx-lms+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214091730522 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214091730523 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214091730523 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:17:34.046041 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32600): Terminating (SIGTERM) 09:17:34.087206 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32603): Terminating (SIGTERM) 09:17:34.128893 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32606): Terminating (SIGTERM) 09:17:34.170748 --- ParallelTerminationStrategy: PID 32600 died... 09:17:34.190707 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32600): Terminated: ok {rc=0} 09:17:34.236282 --- ParallelTerminationStrategy: PID 32603 died... 09:17:34.255770 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32603): Terminated: ok {rc=0} 09:17:34.301322 --- ParallelTerminationStrategy: PID 32606 died... 09:17:34.320608 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32606): Terminated: ok {rc=0} 09:17:34.407388 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2402 gprs:trx-lms+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 09:17:35.493448 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:17:35.505752 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 09:17:35.578592 tst ping_idle_ping.py: using LAC 39922 09:17:35.704590 tst ping_idle_ping.py: using RAC 142 09:17:35.829024 tst ping_idle_ping.py: using CellId 39922 09:17:35.952298 tst ping_idle_ping.py: using BVCI 39923 09:17:36.063691 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:17:36.074830 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:17:36.086508 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:17:36.097464 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:17:36.108637 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:17:36.119804 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:17:36.131073 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:17:36.142202 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 09:17:36.259623 tst ping_idle_ping.py:24: start network... 09:17:36.470710 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:17:36.962515 run create_hlr_db(pid=32608): Launched 09:17:37.092675 bus /gobi_6: Setting Powered False 09:17:38.156268 run create_hlr_db(pid=32608): Terminated: ok {rc=0} 09:17:38.581515 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32610): Launched 09:17:38.878172 run osmo-hlr_10.42.42.2(pid=32611): Launched 09:17:38.990895 run osmo-stp_10.42.42.5: Starting osmo-stp 09:17:39.515076 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32613): Launched 09:17:39.810345 run osmo-stp_10.42.42.5(pid=32614): Launched 09:17:39.922223 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:17:40.431212 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32616): Launched 09:17:40.555554 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:17:40.823446 run patchelf(pid=32617): Launched 09:17:41.000586 run osmo-stp_10.42.42.5(pid=32614): ERR: Terminated: ERROR {rc=1} [trial-2402↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32614)] 09:17:41.135097 run osmo-stp_10.42.42.5(pid=32614): stdout: | (launched: 2022-12-14_09:17:39.755433) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:17:41.271154 run osmo-stp_10.42.42.5(pid=32614): stderr: | 20221214091739924 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214091739924 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214091739924 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214091739925 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214091739925 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214091739925 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214091739926 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:17:41.406571 run osmo-stp_10.42.42.5(pid=32614): stdout: | (launched: 2022-12-14_09:17:39.755433) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:17:41.536307 run osmo-stp_10.42.42.5(pid=32614): stderr: | 20221214091739924 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214091739924 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214091739924 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214091739925 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214091739925 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214091739925 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214091739926 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:17:41.690859 run patchelf(pid=32617): Terminating (SIGINT) 09:17:41.867233 run patchelf(pid=32617): Terminated: ok {rc=0} 09:17:41.993922 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=32614): Process ended prematurely: osmo-stp_10.42.42.5(pid=32614) [trial-2402↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32614)] [trial-2402↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 09:17:42.003623 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 09:17:42.031777 run osmo-hlr_10.42.42.2(pid=32611): ERR: Terminated: ERROR {rc=237} [trial-2402↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32611)] 09:17:42.081794 run osmo-hlr_10.42.42.2(pid=32611): stdout: | (launched: 2022-12-14_09:17:38.823261) 09:17:42.133682 run osmo-hlr_10.42.42.2(pid=32611): stderr: | 20221214091738993 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214091738993 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214091738993 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214091738993 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214091738993 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214091738993 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214091739005 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/gprs:trx-lms+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214091739014 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214091739014 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214091739014 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:17:42.185763 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32610): Terminating (SIGTERM) 09:17:42.227559 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32613): Terminating (SIGTERM) 09:17:42.269459 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32616): Terminating (SIGTERM) 09:17:42.311540 --- ParallelTerminationStrategy: PID 32610 died... 09:17:42.331806 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32610): Terminated: ok {rc=0} 09:17:42.378143 --- ParallelTerminationStrategy: PID 32613 died... 09:17:42.397692 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32613): Terminated: ok {rc=0} 09:17:42.443585 --- ParallelTerminationStrategy: PID 32616 died... 09:17:42.463377 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32616): Terminated: ok {rc=0} 09:17:42.550747 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2402 gprs:trx-lms+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 09:17:43.858209 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:17:43.865549 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 09:17:43.899206 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 09:17:43.935855 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 09:17:43.994089 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 09:17:44.028265 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 09:17:44.064192 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 09:17:44.618445 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2402 dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 09:17:44.624086 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 09:17:44.636207 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 09:17:44.708148 tst switch_tch_pdch.py: using LAC 39923 09:17:44.825636 tst switch_tch_pdch.py: using RAC 143 09:17:44.950854 tst switch_tch_pdch.py: using CellId 39923 09:17:45.073286 tst switch_tch_pdch.py: using BVCI 39924 09:17:45.188592 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 09:17:45.200449 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 09:17:45.212164 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 09:17:45.223778 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 09:17:45.235717 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 09:17:45.247580 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 09:17:45.259920 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 09:17:45.271892 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 09:17:45.388065 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 09:17:45.508573 tst switch_tch_pdch.py:51: start network... 09:17:45.705930 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:17:46.171232 run create_hlr_db(pid=32621): Launched 09:17:46.333781 bus /gobi_6: Setting Powered False 09:17:47.392588 run create_hlr_db(pid=32621): Terminated: ok {rc=0} 09:17:47.842194 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32623): Launched 09:17:48.160364 run osmo-hlr_10.42.42.2(pid=32624): Launched 09:17:48.280510 run osmo-stp_10.42.42.5: Starting osmo-stp 09:17:48.826862 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32626): Launched 09:17:49.143036 run osmo-stp_10.42.42.5(pid=32627): Launched 09:17:49.261834 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:17:49.807196 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32629): Launched 09:17:49.926767 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:17:50.193030 run patchelf(pid=32630): Launched 09:17:50.368259 run osmo-stp_10.42.42.5(pid=32627): ERR: Terminated: ERROR {rc=1} [trial-2402↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32627)] 09:17:50.501494 run osmo-stp_10.42.42.5(pid=32627): stdout: | (launched: 2022-12-14_09:17:49.084799) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:17:50.636867 run osmo-stp_10.42.42.5(pid=32627): stderr: | 20221214091749274 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214091749274 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214091749274 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214091749275 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214091749275 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214091749275 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214091749275 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:17:50.771812 run osmo-stp_10.42.42.5(pid=32627): stdout: | (launched: 2022-12-14_09:17:49.084799) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:17:50.900930 run osmo-stp_10.42.42.5(pid=32627): stderr: | 20221214091749274 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214091749274 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214091749274 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214091749275 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214091749275 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214091749275 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214091749275 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:17:51.054007 run patchelf(pid=32630): Terminating (SIGINT) 09:17:51.230034 run patchelf(pid=32630): Terminated: ok {rc=0} 09:17:51.356934 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=32627): Process ended prematurely: osmo-stp_10.42.42.5(pid=32627) [trial-2402↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32627)] [trial-2402↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 09:17:51.366434 tst switch_tch_pdch.py:54: Test FAILED (6.7 sec) 09:17:51.394469 run osmo-hlr_10.42.42.2(pid=32624): ERR: Terminated: ERROR {rc=237} [trial-2402↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32624)] 09:17:51.444256 run osmo-hlr_10.42.42.2(pid=32624): stdout: | (launched: 2022-12-14_09:17:48.102068) 09:17:51.496013 run osmo-hlr_10.42.42.2(pid=32624): stderr: | 20221214091748296 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214091748296 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214091748297 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214091748297 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214091748297 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214091748297 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214091748308 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214091748317 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214091748317 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214091748317 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:17:51.548071 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32623): Terminating (SIGTERM) 09:17:51.589913 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32626): Terminating (SIGTERM) 09:17:51.631494 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32629): Terminating (SIGTERM) 09:17:51.673087 --- ParallelTerminationStrategy: PID 32623 died... 09:17:51.693073 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32623): Terminated: ok {rc=0} 09:17:51.738689 --- ParallelTerminationStrategy: PID 32626 died... 09:17:51.758082 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32626): Terminated: ok {rc=0} 09:17:51.803535 --- ParallelTerminationStrategy: PID 32629 died... 09:17:51.822872 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32629): Terminated: ok {rc=0} 09:17:51.909473 bus /gobi_0: Setting Powered False 09:17:53.006392 bus /gobi_0: Setting Powered False 09:17:54.120856 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2402 dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 dynts:trx-lms+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 09:17:55.375989 tst dynts:trx-lms+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:17:55.382486 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 09:17:55.416198 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 09:17:55.453663 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 09:17:55.506983 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 09:17:55.540765 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 09:17:55.575254 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 09:17:56.126973 tst dynts:trx-lms+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2402 dynts:trx-lms+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 09:17:56.132191 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 09:17:56.143103 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 09:17:56.213815 tst switch_tch_pdch.py: using LAC 39924 09:17:56.330849 tst switch_tch_pdch.py: using RAC 144 09:17:56.447169 tst switch_tch_pdch.py: using CellId 39924 09:17:56.566632 tst switch_tch_pdch.py: using BVCI 39925 09:17:56.676033 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 09:17:56.687151 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 09:17:56.698014 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 09:17:56.708774 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 09:17:56.720290 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 09:17:56.731996 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 09:17:56.743569 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 09:17:56.755140 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 09:17:56.875302 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 09:17:56.992333 tst switch_tch_pdch.py:51: start network... 09:17:57.189454 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:17:57.622087 run create_hlr_db(pid=32634): Launched 09:17:57.734242 bus /gobi_6: Setting Powered False 09:17:58.793363 run create_hlr_db(pid=32634): Terminated: ok {rc=0} 09:17:59.198828 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32636): Launched 09:17:59.516369 run osmo-hlr_10.42.42.2(pid=32637): Launched 09:17:59.638594 run osmo-stp_10.42.42.5: Starting osmo-stp 09:18:00.155238 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32639): Launched 09:18:00.472139 run osmo-stp_10.42.42.5(pid=32640): Launched 09:18:00.592806 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:18:01.139119 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32642): Launched 09:18:01.265676 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:18:01.525484 run patchelf(pid=32643): Launched 09:18:01.716539 run osmo-stp_10.42.42.5(pid=32640): ERR: Terminated: ERROR {rc=1} [trial-2402↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32640)] 09:18:01.847673 run osmo-stp_10.42.42.5(pid=32640): stdout: | (launched: 2022-12-14_09:18:00.414021) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:18:01.979322 run osmo-stp_10.42.42.5(pid=32640): stderr: | 20221214091800602 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214091800603 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214091800603 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214091800603 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214091800604 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214091800604 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214091800604 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:18:02.111673 run osmo-stp_10.42.42.5(pid=32640): stdout: | (launched: 2022-12-14_09:18:00.414021) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:18:02.236772 run osmo-stp_10.42.42.5(pid=32640): stderr: | 20221214091800602 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214091800603 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214091800603 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214091800603 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214091800604 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214091800604 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214091800604 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:18:02.382076 run patchelf(pid=32643): Terminating (SIGINT) 09:18:02.549487 run patchelf(pid=32643): Terminated: ok {rc=0} 09:18:02.669363 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=32640): Process ended prematurely: osmo-stp_10.42.42.5(pid=32640) [trial-2402↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32640)] [trial-2402↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 09:18:02.678629 tst switch_tch_pdch.py:54: Test FAILED (6.5 sec) 09:18:02.705489 run osmo-hlr_10.42.42.2(pid=32637): ERR: Terminated: ERROR {rc=237} [trial-2402↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32637)] 09:18:02.753671 run osmo-hlr_10.42.42.2(pid=32637): stdout: | (launched: 2022-12-14_09:17:59.458547) 09:18:02.803216 run osmo-hlr_10.42.42.2(pid=32637): stderr: | 20221214091759653 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214091759653 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214091759653 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214091759653 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214091759653 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214091759653 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214091759666 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/dynts:trx-lms+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214091759676 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214091759676 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214091759676 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:18:02.853244 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32636): Terminating (SIGTERM) 09:18:02.892875 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32639): Terminating (SIGTERM) 09:18:02.932924 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32642): Terminating (SIGTERM) 09:18:02.972855 --- ParallelTerminationStrategy: PID 32636 died... 09:18:02.992549 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32636): Terminated: ok {rc=0} 09:18:03.036894 --- ParallelTerminationStrategy: PID 32639 died... 09:18:03.056004 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32639): Terminated: ok {rc=0} 09:18:03.100463 --- ParallelTerminationStrategy: PID 32642 died... 09:18:03.119653 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32642): Terminated: ok {rc=0} 09:18:03.204300 bus /gobi_0: Setting Powered False 09:18:04.301713 bus /gobi_0: Setting Powered False 09:18:05.420233 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2402 dynts:trx-lms+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 nitb_sms:trx-lms-limenet-micro --------------------------------------------------------------------- 09:18:06.680333 tst nitb_sms:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:18:06.685265 tst nitb_sms:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 09:18:06.713845 tst nitb_sms:trx-lms-limenet-micro: Verifying 1 x ip_address (candidates: 9) 09:18:06.721577 tst nitb_sms:trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 09:18:06.773394 tst nitb_sms:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 09:18:06.803588 tst nitb_sms:trx-lms-limenet-micro: Reserving 1 x ip_address (candidates: 9) 09:18:06.810629 tst nitb_sms:trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 09:18:07.350714 tst nitb_sms:trx-lms-limenet-micro: RESERVED RESOURCES for nitb_sms: bts LimeNET-Micro ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2402 nitb_sms:trx-lms-limenet-micro mo_mt_sms.py ---------------------------------------------- 09:18:07.356090 tst nitb_sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 1) 09:18:07.367689 tst nitb_sms:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 09:18:07.415383 tst mo_mt_sms.py: using LAC 39925 09:18:07.540401 tst mo_mt_sms.py: using RAC 145 09:18:07.665689 tst mo_mt_sms.py: using CellId 39925 09:18:07.789410 tst mo_mt_sms.py: using BVCI 39926 09:18:07.903233 tst nitb_sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 09:18:08.022027 tst nitb_sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 09:18:08.138396 tst mo_mt_sms.py:9: start nitb and bts... 09:18:08.350989 run osmo-nitb_10.42.42.2: Starting osmo-nitb 09:18:08.992590 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=32648): Launched 09:18:09.307804 run osmo-nitb_10.42.42.2(pid=32649): Launched 09:18:09.484001 run osmo-nitb_10.42.42.2(pid=32649): ERR: Terminated: ERROR {rc=2} [trial-2402↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=32649)] 09:18:09.625865 run osmo-nitb_10.42.42.2(pid=32649): stdout: | (launched: 2022-12-14_09:18:09.250039) 09:18:09.768611 run osmo-nitb_10.42.42.2(pid=32649): stderr: | (launched: 2022-12-14_09:18:09.296862) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 09:18:09.911091 run osmo-nitb_10.42.42.2(pid=32649): stdout: | (launched: 2022-12-14_09:18:09.250039) 09:18:10.048272 run osmo-nitb_10.42.42.2(pid=32649): stderr: | (launched: 2022-12-14_09:18:09.296862) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fe4ae4b0268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=32649): Process ended prematurely: osmo-nitb_10.42.42.2(pid=32649) [trial-2402↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=32649)] 09:18:10.427864 tst osmo-nitb_10.42.42.2(pid=32649): stdout: | (launched: 2022-12-14_09:18:09.250039) 09:18:10.554587 tst osmo-nitb_10.42.42.2(pid=32649): stderr: | (launched: 2022-12-14_09:18:09.296862) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 09:18:10.704643 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=32649): Process ended prematurely: osmo-nitb_10.42.42.2(pid=32649) [trial-2402↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=32649)] [trial-2402↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11] 09:18:10.713739 tst mo_mt_sms.py:11: Test FAILED (3.4 sec) 09:18:10.720683 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=32648): Terminating (SIGTERM) 09:18:10.930990 --- ParallelTerminationStrategy: PID 32648 died... 09:18:10.952761 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=32648): Terminated: ok {rc=0} 09:18:11.040827 bus /sierra_3: Setting Powered False 09:18:12.139799 bus /sierra_3: Setting Powered False 09:18:13.258843 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2402 nitb_sms:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 sms:trx-lms-limenet-micro --------------------------------------------------------------------- 09:18:14.456043 tst sms:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:18:14.460459 tst sms:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 09:18:14.490469 tst sms:trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 09:18:14.517919 tst sms:trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 09:18:14.571545 tst sms:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 09:18:14.600799 tst sms:trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 09:18:14.628178 tst sms:trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 09:18:15.173608 tst sms:trx-lms-limenet-micro: RESERVED RESOURCES for sms: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2402 sms:trx-lms-limenet-micro mo_mt_sms.py ---------------------------------------------- 09:18:15.178735 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 09:18:15.189871 tst sms:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 09:18:15.233656 tst mo_mt_sms.py: using LAC 39926 09:18:15.358427 tst mo_mt_sms.py: using RAC 146 09:18:15.482127 tst mo_mt_sms.py: using CellId 39926 09:18:15.606754 tst mo_mt_sms.py: using BVCI 39927 09:18:15.721697 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 09:18:15.733182 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 09:18:15.744395 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 09:18:15.755683 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 09:18:15.767001 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 09:18:15.778316 tst sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 09:18:15.901348 tst sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 09:18:16.015713 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:18:16.496798 run create_hlr_db(pid=32653): Launched 09:18:16.656131 bus /sierra_2: Setting Powered False 09:18:17.719542 run create_hlr_db(pid=32653): Terminated: ok {rc=0} 09:18:18.141555 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32655): Launched 09:18:18.436626 run osmo-hlr_10.42.42.2(pid=32656): Launched 09:18:18.548340 run osmo-stp_10.42.42.5: Starting osmo-stp 09:18:19.058074 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32658): Launched 09:18:19.351790 run osmo-stp_10.42.42.5(pid=32659): Launched 09:18:19.462845 run osmo-msc_10.42.42.6: Starting osmo-msc 09:18:19.998780 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32661): Launched 09:18:20.294047 run osmo-msc_10.42.42.6(pid=32662): Launched 09:18:20.459494 run osmo-stp_10.42.42.5(pid=32659): ERR: Terminated: ERROR {rc=1} [trial-2402↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32659)] 09:18:20.585647 run osmo-stp_10.42.42.5(pid=32659): stdout: | (launched: 2022-12-14_09:18:19.297242) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:18:20.711240 run osmo-stp_10.42.42.5(pid=32659): stderr: | 20221214091819463 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214091819463 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214091819463 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214091819464 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214091819464 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214091819464 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214091819465 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:18:20.834648 run osmo-stp_10.42.42.5(pid=32659): stdout: | (launched: 2022-12-14_09:18:19.297242) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:18:20.951549 run osmo-stp_10.42.42.5(pid=32659): stderr: | 20221214091819463 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214091819463 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214091819463 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214091819464 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214091819464 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214091819464 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214091819465 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:18:21.091820 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=32659): Process ended prematurely: osmo-stp_10.42.42.5(pid=32659) [trial-2402↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32659)] [trial-2402↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16] 09:18:21.100114 tst mo_mt_sms.py:16: Test FAILED (5.9 sec) 09:18:21.126273 run osmo-hlr_10.42.42.2(pid=32656): ERR: Terminated: ERROR {rc=237} [trial-2402↪sms:trx-lms-limenet-micro↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32656)] 09:18:21.174882 run osmo-hlr_10.42.42.2(pid=32656): stdout: | (launched: 2022-12-14_09:18:18.382022) 09:18:21.224232 run osmo-hlr_10.42.42.2(pid=32656): stderr: | 20221214091818553 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214091818553 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214091818553 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214091818553 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214091818553 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214091818553 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214091818564 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/sms:trx-lms-limenet-micro/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214091818572 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214091818573 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214091818573 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:18:21.293499 run osmo-msc_10.42.42.6(pid=32662): ERR: Terminated: ERROR {rc=2} [trial-2402↪sms:trx-lms-limenet-micro↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32662)] 09:18:21.341221 run osmo-msc_10.42.42.6(pid=32662): stdout: | (launched: 2022-12-14_09:18:20.239385) 09:18:21.390918 run osmo-msc_10.42.42.6(pid=32662): stderr: | 20221214091820505 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214091820505 DLGLOBAL DEBUG validating counter group 0x7fed209c9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214091820505 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214091820505 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214091820505 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214091820506 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214091820507 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214091820508 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214091820508 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214091820508 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:18:21.440848 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32655): Terminating (SIGTERM) 09:18:21.480740 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32658): Terminating (SIGTERM) 09:18:21.520548 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32661): Terminating (SIGTERM) 09:18:21.561106 --- ParallelTerminationStrategy: PID 32655 died... 09:18:21.580594 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32655): Terminated: ok {rc=0} 09:18:21.624764 --- ParallelTerminationStrategy: PID 32658 died... 09:18:21.643787 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32658): Terminated: ok {rc=0} 09:18:21.687805 --- ParallelTerminationStrategy: PID 32661 died... 09:18:21.706730 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32661): Terminated: ok {rc=0} 09:18:21.792795 bus /sierra_3: Setting Powered False 09:18:22.891866 bus /sierra_3: Setting Powered False 09:18:24.007435 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2402 sms:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 nitb_ussd:trx-lms-limenet-micro --------------------------------------------------------------------- 09:18:25.233309 tst nitb_ussd:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:18:25.237194 tst nitb_ussd:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 09:18:25.265763 tst nitb_ussd:trx-lms-limenet-micro: Verifying 1 x ip_address (candidates: 9) 09:18:25.272689 tst nitb_ussd:trx-lms-limenet-micro: Verifying 1 x modem (candidates: 12) 09:18:25.308995 tst nitb_ussd:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 09:18:25.338078 tst nitb_ussd:trx-lms-limenet-micro: Reserving 1 x ip_address (candidates: 9) 09:18:25.344740 tst nitb_ussd:trx-lms-limenet-micro: Reserving 1 x modem (candidates: 12) 09:18:25.864589 tst nitb_ussd:trx-lms-limenet-micro: RESERVED RESOURCES for nitb_ussd: bts LimeNET-Micro ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2402 nitb_ussd:trx-lms-limenet-micro assert_extension.py ---------------------------------------------- 09:18:25.869580 tst nitb_ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 1) 09:18:25.880349 tst nitb_ussd:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 09:18:25.925631 tst assert_extension.py: using LAC 39927 09:18:26.039997 tst assert_extension.py: using RAC 147 09:18:26.154640 tst assert_extension.py: using CellId 39927 09:18:26.269207 tst assert_extension.py: using BVCI 39928 09:18:26.378051 tst nitb_ussd:trx-lms-limenet-micro: Using 1 x modem (candidates: 1) 09:18:26.494497 tst assert_extension.py:10: start nitb and bts... 09:18:26.707584 run osmo-nitb_10.42.42.2: Starting osmo-nitb 09:18:27.353590 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=32667): Launched 09:18:27.673447 run osmo-nitb_10.42.42.2(pid=32668): Launched 09:18:27.848246 run osmo-nitb_10.42.42.2(pid=32668): ERR: Terminated: ERROR {rc=2} [trial-2402↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=32668)] 09:18:27.989882 run osmo-nitb_10.42.42.2(pid=32668): stdout: | (launched: 2022-12-14_09:18:27.614829) 09:18:28.133067 run osmo-nitb_10.42.42.2(pid=32668): stderr: | (launched: 2022-12-14_09:18:27.662254) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 09:18:28.276017 run osmo-nitb_10.42.42.2(pid=32668): stdout: | (launched: 2022-12-14_09:18:27.614829) 09:18:28.413448 run osmo-nitb_10.42.42.2(pid=32668): stderr: | (launched: 2022-12-14_09:18:27.662254) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fe4ae4b0268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=32668): Process ended prematurely: osmo-nitb_10.42.42.2(pid=32668) [trial-2402↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=32668)] 09:18:28.793144 tst osmo-nitb_10.42.42.2(pid=32668): stdout: | (launched: 2022-12-14_09:18:27.614829) 09:18:28.919756 tst osmo-nitb_10.42.42.2(pid=32668): stderr: | (launched: 2022-12-14_09:18:27.662254) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 09:18:29.069483 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=32668): Process ended prematurely: osmo-nitb_10.42.42.2(pid=32668) [trial-2402↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=32668)] [trial-2402↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12] 09:18:29.078469 tst assert_extension.py:12: Test FAILED (3.2 sec) 09:18:29.085662 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=32667): Terminating (SIGTERM) 09:18:29.296006 --- ParallelTerminationStrategy: PID 32667 died... 09:18:29.317523 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=32667): Terminated: ok {rc=0} 09:18:29.406320 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2402 nitb_ussd:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 ussd:trx-lms-limenet-micro --------------------------------------------------------------------- 09:18:30.577632 tst ussd:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:18:30.582151 tst ussd:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 09:18:30.611343 tst ussd:trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 09:18:30.639747 tst ussd:trx-lms-limenet-micro: Verifying 1 x modem (candidates: 12) 09:18:30.673347 tst ussd:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 09:18:30.702937 tst ussd:trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 09:18:30.729674 tst ussd:trx-lms-limenet-micro: Reserving 1 x modem (candidates: 12) 09:18:31.303458 tst ussd:trx-lms-limenet-micro: RESERVED RESOURCES for ussd: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2402 ussd:trx-lms-limenet-micro assert_extension.py ---------------------------------------------- 09:18:31.312566 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 09:18:31.328086 tst ussd:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 09:18:31.375551 tst assert_extension.py: using LAC 39928 09:18:31.503293 tst assert_extension.py: using RAC 148 09:18:31.627316 tst assert_extension.py: using CellId 39928 09:18:31.785360 tst assert_extension.py: using BVCI 39929 09:18:31.908790 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 09:18:31.920578 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 09:18:31.931939 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 09:18:31.943292 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 09:18:31.955490 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 09:18:31.967700 tst ussd:trx-lms-limenet-micro: Using 1 x modem (candidates: 1) 09:18:32.086776 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:18:32.554201 run create_hlr_db(pid=32672): Launched 09:18:32.666856 bus /sierra_2: Setting Powered False 09:18:33.725549 run create_hlr_db(pid=32672): Terminated: ok {rc=0} 09:18:34.137752 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32674): Launched 09:18:34.434317 run osmo-hlr_10.42.42.2(pid=32675): Launched 09:18:34.546188 run osmo-stp_10.42.42.5: Starting osmo-stp 09:18:35.069745 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32677): Launched 09:18:35.365886 run osmo-stp_10.42.42.5(pid=32678): Launched 09:18:35.478202 run osmo-msc_10.42.42.6: Starting osmo-msc 09:18:36.011239 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32680): Launched 09:18:36.305427 run osmo-msc_10.42.42.6(pid=32681): Launched 09:18:36.470192 run osmo-stp_10.42.42.5(pid=32678): ERR: Terminated: ERROR {rc=1} [trial-2402↪ussd:trx-lms-limenet-micro↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32678)] 09:18:36.595566 run osmo-stp_10.42.42.5(pid=32678): stdout: | (launched: 2022-12-14_09:18:35.310349) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:18:36.721150 run osmo-stp_10.42.42.5(pid=32678): stderr: | 20221214091835476 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214091835476 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214091835476 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214091835477 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214091835477 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214091835477 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214091835477 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:18:36.844087 run osmo-stp_10.42.42.5(pid=32678): stdout: | (launched: 2022-12-14_09:18:35.310349) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:18:36.961387 run osmo-stp_10.42.42.5(pid=32678): stderr: | 20221214091835476 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214091835476 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214091835476 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214091835477 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214091835477 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214091835477 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214091835477 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:18:37.101212 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=32678): Process ended prematurely: osmo-stp_10.42.42.5(pid=32678) [trial-2402↪ussd:trx-lms-limenet-micro↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32678)] [trial-2402↪ussd:trx-lms-limenet-micro↪assert_extension.py:17] 09:18:37.109643 tst assert_extension.py:17: Test FAILED (5.8 sec) 09:18:37.135710 run osmo-hlr_10.42.42.2(pid=32675): ERR: Terminated: ERROR {rc=237} [trial-2402↪ussd:trx-lms-limenet-micro↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32675)] 09:18:37.183873 run osmo-hlr_10.42.42.2(pid=32675): stdout: | (launched: 2022-12-14_09:18:34.379650) 09:18:37.232785 run osmo-hlr_10.42.42.2(pid=32675): stderr: | 20221214091834550 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214091834550 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214091834550 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214091834550 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214091834550 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214091834550 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214091834561 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/ussd:trx-lms-limenet-micro/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214091834570 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214091834570 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214091834570 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:18:37.301619 run osmo-msc_10.42.42.6(pid=32681): ERR: Terminated: ERROR {rc=2} [trial-2402↪ussd:trx-lms-limenet-micro↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32681)] 09:18:37.348489 run osmo-msc_10.42.42.6(pid=32681): stdout: | (launched: 2022-12-14_09:18:36.250628) 09:18:37.397550 run osmo-msc_10.42.42.6(pid=32681): stderr: | 20221214091836519 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214091836519 DLGLOBAL DEBUG validating counter group 0x7fa682cc1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214091836519 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214091836519 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214091836519 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214091836520 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214091836522 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214091836522 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214091836522 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214091836522 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:18:37.447060 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32674): Terminating (SIGTERM) 09:18:37.486364 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32677): Terminating (SIGTERM) 09:18:37.525884 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32680): Terminating (SIGTERM) 09:18:37.565601 --- ParallelTerminationStrategy: PID 32674 died... 09:18:37.584842 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32674): Terminated: ok {rc=0} 09:18:37.628925 --- ParallelTerminationStrategy: PID 32677 died... 09:18:37.647798 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32677): Terminated: ok {rc=0} 09:18:37.691761 --- ParallelTerminationStrategy: PID 32680 died... 09:18:37.710735 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32680): Terminated: ok {rc=0} 09:18:37.793665 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2402 ussd:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 09:18:38.999779 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:18:39.007328 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 09:18:39.037428 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 09:18:39.065447 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 09:18:39.117519 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 09:18:39.147398 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 09:18:39.174683 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 09:18:39.730124 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2402 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 09:18:39.783532 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:18:39.795437 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 09:18:39.862521 tst mo_mt_call.py: using LAC 39929 09:18:39.991702 tst mo_mt_call.py: using RAC 149 09:18:40.112828 tst mo_mt_call.py: using CellId 39929 09:18:40.231951 tst mo_mt_call.py: using BVCI 39930 09:18:40.343390 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:18:40.354993 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:18:40.366261 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:18:40.377420 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:18:40.388799 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:18:40.400236 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 09:18:40.516202 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 09:18:40.634820 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:18:41.137032 run create_hlr_db(pid=32687): Launched 09:18:41.269804 bus /sierra_2: Setting Powered False 09:18:42.330005 run create_hlr_db(pid=32687): Terminated: ok {rc=0} 09:18:42.777626 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32689): Launched 09:18:43.101724 run osmo-hlr_10.42.42.2(pid=32690): Launched 09:18:43.226348 run osmo-stp_10.42.42.5: Starting osmo-stp 09:18:43.781427 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32692): Launched 09:18:44.105077 run osmo-stp_10.42.42.5(pid=32693): Launched 09:18:44.229501 run osmo-msc_10.42.42.6: Starting osmo-msc 09:18:44.811604 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32695): Launched 09:18:45.134951 run osmo-msc_10.42.42.6(pid=32696): Launched 09:18:45.315458 run osmo-stp_10.42.42.5(pid=32693): ERR: Terminated: ERROR {rc=1} [trial-2402↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32693)] 09:18:45.450931 run osmo-stp_10.42.42.5(pid=32693): stdout: | (launched: 2022-12-14_09:18:44.045697) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:18:45.586399 run osmo-stp_10.42.42.5(pid=32693): stderr: | 20221214091844234 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214091844234 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214091844234 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214091844235 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214091844235 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214091844235 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214091844235 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:18:45.721421 run osmo-stp_10.42.42.5(pid=32693): stdout: | (launched: 2022-12-14_09:18:44.045697) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:18:45.854770 run osmo-stp_10.42.42.5(pid=32693): stderr: | 20221214091844234 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214091844234 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214091844234 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214091844235 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214091844235 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214091844235 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214091844235 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:18:46.007592 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32693): Process ended prematurely: osmo-stp_10.42.42.5(pid=32693) [trial-2402↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32693)] [trial-2402↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 09:18:46.017694 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 09:18:46.045244 run osmo-hlr_10.42.42.2(pid=32690): ERR: Terminated: ERROR {rc=237} [trial-2402↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32690)] 09:18:46.097323 run osmo-hlr_10.42.42.2(pid=32690): stdout: | (launched: 2022-12-14_09:18:43.042481) 09:18:46.149485 run osmo-hlr_10.42.42.2(pid=32690): stderr: | 20221214091843237 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214091843237 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214091843237 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214091843237 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214091843237 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214091843237 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214091843251 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214091843259 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214091843260 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214091843260 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:18:46.221620 run osmo-msc_10.42.42.6(pid=32696): ERR: Terminated: ERROR {rc=2} [trial-2402↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32696)] 09:18:46.270876 run osmo-msc_10.42.42.6(pid=32696): stdout: | (launched: 2022-12-14_09:18:45.075546) 09:18:46.322470 run osmo-msc_10.42.42.6(pid=32696): stderr: | 20221214091845394 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214091845394 DLGLOBAL DEBUG validating counter group 0x7f8a7382ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214091845394 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214091845394 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214091845394 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214091845394 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214091845396 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214091845397 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214091845397 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214091845397 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:18:46.374447 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32689): Terminating (SIGTERM) 09:18:46.416581 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32692): Terminating (SIGTERM) 09:18:46.461065 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32695): Terminating (SIGTERM) 09:18:46.505279 --- ParallelTerminationStrategy: PID 32689 died... 09:18:46.526394 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32689): Terminated: ok {rc=0} 09:18:46.573926 --- ParallelTerminationStrategy: PID 32692 died... 09:18:46.594912 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32692): Terminated: ok {rc=0} 09:18:46.641580 --- ParallelTerminationStrategy: PID 32695 died... 09:18:46.663564 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32695): Terminated: ok {rc=0} 09:18:46.752060 bus /sierra_3: Setting Powered False 09:18:47.846515 bus /sierra_3: Setting Powered False 09:18:48.961604 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2402 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 09:18:50.106023 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:18:50.118048 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 09:18:50.184728 tst mo_mt_call_osmux.py: using LAC 39930 09:18:50.312889 tst mo_mt_call_osmux.py: using RAC 150 09:18:50.434607 tst mo_mt_call_osmux.py: using CellId 39930 09:18:50.552648 tst mo_mt_call_osmux.py: using BVCI 39931 09:18:50.662086 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:18:50.673580 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:18:50.684476 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:18:50.696020 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:18:50.707575 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:18:50.718968 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 09:18:50.838190 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 09:18:50.954747 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:18:51.423097 run create_hlr_db(pid=32698): Launched 09:18:51.537562 bus /sierra_2: Setting Powered False 09:18:52.598126 run create_hlr_db(pid=32698): Terminated: ok {rc=0} 09:18:53.036695 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32700): Launched 09:18:53.360449 run osmo-hlr_10.42.42.2(pid=32701): Launched 09:18:53.482732 run osmo-stp_10.42.42.5: Starting osmo-stp 09:18:54.043252 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32703): Launched 09:18:54.366153 run osmo-stp_10.42.42.5(pid=32704): Launched 09:18:54.489587 run osmo-msc_10.42.42.6: Starting osmo-msc 09:18:55.078638 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32706): Launched 09:18:55.402305 run osmo-msc_10.42.42.6(pid=32707): Launched 09:18:55.585338 run osmo-stp_10.42.42.5(pid=32704): ERR: Terminated: ERROR {rc=1} [trial-2402↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32704)] 09:18:55.721587 run osmo-stp_10.42.42.5(pid=32704): stdout: | (launched: 2022-12-14_09:18:54.306851) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:18:55.858668 run osmo-stp_10.42.42.5(pid=32704): stderr: | 20221214091854495 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214091854496 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214091854496 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214091854496 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214091854497 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214091854497 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214091854497 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:18:55.993516 run osmo-stp_10.42.42.5(pid=32704): stdout: | (launched: 2022-12-14_09:18:54.306851) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:18:56.123007 run osmo-stp_10.42.42.5(pid=32704): stderr: | 20221214091854495 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214091854496 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214091854496 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214091854496 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214091854497 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214091854497 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214091854497 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:18:56.276631 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32704): Process ended prematurely: osmo-stp_10.42.42.5(pid=32704) [trial-2402↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32704)] [trial-2402↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 09:18:56.286401 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 09:18:56.314514 run osmo-hlr_10.42.42.2(pid=32701): ERR: Terminated: ERROR {rc=237} [trial-2402↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32701)] 09:18:56.364760 run osmo-hlr_10.42.42.2(pid=32701): stdout: | (launched: 2022-12-14_09:18:53.301251) 09:18:56.416632 run osmo-hlr_10.42.42.2(pid=32701): stderr: | 20221214091853496 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214091853496 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214091853497 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214091853497 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214091853497 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214091853497 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214091853510 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214091853518 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214091853518 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214091853518 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:18:56.489404 run osmo-msc_10.42.42.6(pid=32707): ERR: Terminated: ERROR {rc=2} [trial-2402↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32707)] 09:18:56.539669 run osmo-msc_10.42.42.6(pid=32707): stdout: | (launched: 2022-12-14_09:18:55.342679) 09:18:56.591550 run osmo-msc_10.42.42.6(pid=32707): stderr: | 20221214091855661 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214091855661 DLGLOBAL DEBUG validating counter group 0x7f35d654ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214091855661 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214091855661 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214091855661 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214091855662 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214091855663 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214091855664 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214091855664 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214091855664 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:18:56.644182 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32700): Terminating (SIGTERM) 09:18:56.685840 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32703): Terminating (SIGTERM) 09:18:56.727505 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32706): Terminating (SIGTERM) 09:18:56.769580 --- ParallelTerminationStrategy: PID 32700 died... 09:18:56.789625 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32700): Terminated: ok {rc=0} 09:18:56.836179 --- ParallelTerminationStrategy: PID 32703 died... 09:18:56.856052 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32703): Terminated: ok {rc=0} 09:18:56.902157 --- ParallelTerminationStrategy: PID 32706 died... 09:18:56.921856 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32706): Terminated: ok {rc=0} 09:18:57.009100 bus /sierra_3: Setting Powered False 09:18:58.107737 bus /sierra_3: Setting Powered False 09:18:59.222707 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2402 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 09:19:00.470867 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:19:00.477986 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 09:19:00.507711 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 09:19:00.535339 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 09:19:00.588708 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 09:19:00.618952 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 09:19:00.646859 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 09:19:01.224804 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2402 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 09:19:01.283135 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:19:01.295687 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 09:19:01.364202 tst mo_mt_call.py: using LAC 39931 09:19:01.521229 tst mo_mt_call.py: using RAC 151 09:19:01.644712 tst mo_mt_call.py: using CellId 39931 09:19:01.785010 tst mo_mt_call.py: using BVCI 39932 09:19:01.900503 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:19:01.912896 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:19:01.925206 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:19:01.937551 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:19:01.951049 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:19:01.964429 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 09:19:02.112901 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 09:19:02.241876 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:19:02.712229 run create_hlr_db(pid=32712): Launched 09:19:02.827269 bus /sierra_2: Setting Powered False 09:19:03.887489 run create_hlr_db(pid=32712): Terminated: ok {rc=0} 09:19:04.306585 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32714): Launched 09:19:04.607575 run osmo-hlr_10.42.42.2(pid=32715): Launched 09:19:04.721798 run osmo-stp_10.42.42.5: Starting osmo-stp 09:19:05.243730 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32717): Launched 09:19:05.545074 run osmo-stp_10.42.42.5(pid=32718): Launched 09:19:05.660055 run osmo-msc_10.42.42.6: Starting osmo-msc 09:19:06.207156 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32720): Launched 09:19:06.508205 run osmo-msc_10.42.42.6(pid=32721): Launched 09:19:06.676484 run osmo-stp_10.42.42.5(pid=32718): ERR: Terminated: ERROR {rc=1} [trial-2402↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32718)] 09:19:06.804285 run osmo-stp_10.42.42.5(pid=32718): stdout: | (launched: 2022-12-14_09:19:05.489075) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:19:06.932051 run osmo-stp_10.42.42.5(pid=32718): stderr: | 20221214091905657 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214091905657 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214091905657 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214091905658 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214091905658 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214091905658 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214091905658 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:19:07.057249 run osmo-stp_10.42.42.5(pid=32718): stdout: | (launched: 2022-12-14_09:19:05.489075) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:19:07.176702 run osmo-stp_10.42.42.5(pid=32718): stderr: | 20221214091905657 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214091905657 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214091905657 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214091905658 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214091905658 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214091905658 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214091905658 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:19:07.319996 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32718): Process ended prematurely: osmo-stp_10.42.42.5(pid=32718) [trial-2402↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32718)] [trial-2402↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 09:19:07.328898 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 09:19:07.355362 run osmo-hlr_10.42.42.2(pid=32715): ERR: Terminated: ERROR {rc=237} [trial-2402↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32715)] 09:19:07.403927 run osmo-hlr_10.42.42.2(pid=32715): stdout: | (launched: 2022-12-14_09:19:04.551370) 09:19:07.453517 run osmo-hlr_10.42.42.2(pid=32715): stderr: | 20221214091904725 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214091904725 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214091904725 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214091904725 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214091904725 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214091904725 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214091904737 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214091904746 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214091904746 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214091904746 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:19:07.522644 run osmo-msc_10.42.42.6(pid=32721): ERR: Terminated: ERROR {rc=2} [trial-2402↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32721)] 09:19:07.569852 run osmo-msc_10.42.42.6(pid=32721): stdout: | (launched: 2022-12-14_09:19:06.452283) 09:19:07.619215 run osmo-msc_10.42.42.6(pid=32721): stderr: | 20221214091906724 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214091906724 DLGLOBAL DEBUG validating counter group 0x7fa5d1dd4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214091906725 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214091906725 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214091906725 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214091906725 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214091906727 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214091906727 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214091906727 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214091906727 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:19:07.668909 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32714): Terminating (SIGTERM) 09:19:07.708755 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32717): Terminating (SIGTERM) 09:19:07.748572 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32720): Terminating (SIGTERM) 09:19:07.788649 --- ParallelTerminationStrategy: PID 32714 died... 09:19:07.808219 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32714): Terminated: ok {rc=0} 09:19:07.852417 --- ParallelTerminationStrategy: PID 32717 died... 09:19:07.871378 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32717): Terminated: ok {rc=0} 09:19:07.915533 --- ParallelTerminationStrategy: PID 32720 died... 09:19:07.934656 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32720): Terminated: ok {rc=0} 09:19:08.017988 bus /sierra_3: Setting Powered False 09:19:09.115379 bus /sierra_3: Setting Powered False 09:19:10.230419 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2402 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 09:19:11.379084 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:19:11.391862 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 09:19:11.458990 tst mo_mt_call_osmux.py: using LAC 39932 09:19:11.585765 tst mo_mt_call_osmux.py: using RAC 152 09:19:11.713127 tst mo_mt_call_osmux.py: using CellId 39932 09:19:11.840306 tst mo_mt_call_osmux.py: using BVCI 39933 09:19:11.958174 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:19:11.970302 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:19:11.981955 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:19:11.993622 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:19:12.005336 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:19:12.016923 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 09:19:12.136926 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 09:19:12.254206 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:19:12.724425 run create_hlr_db(pid=32723): Launched 09:19:12.839861 bus /sierra_2: Setting Powered False 09:19:13.900722 run create_hlr_db(pid=32723): Terminated: ok {rc=0} 09:19:14.341813 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32725): Launched 09:19:14.667178 run osmo-hlr_10.42.42.2(pid=32726): Launched 09:19:14.792823 run osmo-stp_10.42.42.5: Starting osmo-stp 09:19:15.356877 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32728): Launched 09:19:15.678742 run osmo-stp_10.42.42.5(pid=32729): Launched 09:19:15.802398 run osmo-msc_10.42.42.6: Starting osmo-msc 09:19:16.487802 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32731): Launched 09:19:16.827412 run osmo-msc_10.42.42.6(pid=32732): Launched 09:19:17.103108 run osmo-stp_10.42.42.5(pid=32729): ERR: Terminated: ERROR {rc=1} [trial-2402↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32729)] 09:19:17.369105 run osmo-stp_10.42.42.5(pid=32729): stdout: | (launched: 2022-12-14_09:19:15.618984) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:19:17.506653 run osmo-stp_10.42.42.5(pid=32729): stderr: | 20221214091915807 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214091915807 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214091915807 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214091915808 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214091915808 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214091915808 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214091915808 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:19:17.636639 run osmo-stp_10.42.42.5(pid=32729): stdout: | (launched: 2022-12-14_09:19:15.618984) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:19:17.757797 run osmo-stp_10.42.42.5(pid=32729): stderr: | 20221214091915807 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214091915807 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214091915807 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214091915808 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214091915808 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214091915808 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214091915808 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:19:17.901664 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32729): Process ended prematurely: osmo-stp_10.42.42.5(pid=32729) [trial-2402↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32729)] [trial-2402↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 09:19:17.910601 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 09:19:17.937090 run osmo-hlr_10.42.42.2(pid=32726): ERR: Terminated: ERROR {rc=237} [trial-2402↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32726)] 09:19:17.985329 run osmo-hlr_10.42.42.2(pid=32726): stdout: | (launched: 2022-12-14_09:19:14.607600) 09:19:18.035419 run osmo-hlr_10.42.42.2(pid=32726): stderr: | 20221214091914801 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214091914801 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214091914801 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214091914801 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214091914801 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214091914802 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214091914814 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214091914823 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214091914823 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214091914823 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:19:18.105371 run osmo-msc_10.42.42.6(pid=32732): ERR: Terminated: ERROR {rc=2} [trial-2402↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32732)] 09:19:18.152831 run osmo-msc_10.42.42.6(pid=32732): stdout: | (launched: 2022-12-14_09:19:16.766467) 09:19:18.202214 run osmo-msc_10.42.42.6(pid=32732): stderr: | 20221214091917339 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214091917339 DLGLOBAL DEBUG validating counter group 0x7fa44c445c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214091917339 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214091917339 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214091917339 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214091917339 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214091917341 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214091917341 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214091917342 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214091917342 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:19:18.251894 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32725): Terminating (SIGTERM) 09:19:18.291721 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32728): Terminating (SIGTERM) 09:19:18.331660 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32731): Terminating (SIGTERM) 09:19:18.371765 --- ParallelTerminationStrategy: PID 32725 died... 09:19:18.391258 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32725): Terminated: ok {rc=0} 09:19:18.435404 --- ParallelTerminationStrategy: PID 32728 died... 09:19:18.454327 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32728): Terminated: ok {rc=0} 09:19:18.498659 --- ParallelTerminationStrategy: PID 32731 died... 09:19:18.517774 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32731): Terminated: ok {rc=0} 09:19:18.603933 bus /sierra_3: Setting Powered False 09:19:19.703942 bus /sierra_3: Setting Powered False 09:19:20.819864 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2402 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 09:19:22.065829 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:19:22.073454 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 09:19:22.103424 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 09:19:22.131031 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 09:19:22.183484 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 09:19:22.213686 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 09:19:22.241377 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 09:19:22.793990 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2402 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 09:19:22.844621 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:19:22.856126 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 09:19:22.921345 tst mo_mt_call.py: using LAC 39933 09:19:23.041212 tst mo_mt_call.py: using RAC 153 09:19:23.159993 tst mo_mt_call.py: using CellId 39933 09:19:23.279782 tst mo_mt_call.py: using BVCI 39934 09:19:23.390860 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:19:23.402258 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:19:23.413280 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:19:23.424213 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:19:23.435684 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:19:23.447040 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 09:19:23.567675 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 09:19:23.683875 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:19:24.154800 run create_hlr_db(pid=32737): Launched 09:19:24.270247 bus /sierra_2: Setting Powered False 09:19:25.330709 run create_hlr_db(pid=32737): Terminated: ok {rc=0} 09:19:25.751927 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32739): Launched 09:19:26.056049 run osmo-hlr_10.42.42.2(pid=32740): Launched 09:19:26.173349 run osmo-stp_10.42.42.5: Starting osmo-stp 09:19:26.697334 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32742): Launched 09:19:26.999371 run osmo-stp_10.42.42.5(pid=32743): Launched 09:19:27.116446 run osmo-msc_10.42.42.6: Starting osmo-msc 09:19:27.667165 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32745): Launched 09:19:27.994653 run osmo-msc_10.42.42.6(pid=32746): Launched 09:19:28.175090 run osmo-stp_10.42.42.5(pid=32743): ERR: Terminated: ERROR {rc=1} [trial-2402↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32743)] 09:19:28.312295 run osmo-stp_10.42.42.5(pid=32743): stdout: | (launched: 2022-12-14_09:19:26.943126) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:19:28.448633 run osmo-stp_10.42.42.5(pid=32743): stderr: | 20221214091927109 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214091927110 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214091927110 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214091927110 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214091927111 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214091927111 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214091927111 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:19:28.583597 run osmo-stp_10.42.42.5(pid=32743): stdout: | (launched: 2022-12-14_09:19:26.943126) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:19:28.712182 run osmo-stp_10.42.42.5(pid=32743): stderr: | 20221214091927109 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214091927110 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214091927110 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214091927110 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214091927111 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214091927111 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214091927111 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:19:28.865376 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32743): Process ended prematurely: osmo-stp_10.42.42.5(pid=32743) [trial-2402↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32743)] [trial-2402↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 09:19:28.874961 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 09:19:28.902871 run osmo-hlr_10.42.42.2(pid=32740): ERR: Terminated: ERROR {rc=237} [trial-2402↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32740)] 09:19:28.952858 run osmo-hlr_10.42.42.2(pid=32740): stdout: | (launched: 2022-12-14_09:19:25.999581) 09:19:29.004734 run osmo-hlr_10.42.42.2(pid=32740): stderr: | 20221214091926169 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214091926169 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214091926169 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214091926169 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214091926169 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214091926169 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214091926182 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214091926190 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214091926190 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214091926190 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:19:29.077303 run osmo-msc_10.42.42.6(pid=32746): ERR: Terminated: ERROR {rc=2} [trial-2402↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32746)] 09:19:29.127396 run osmo-msc_10.42.42.6(pid=32746): stdout: | (launched: 2022-12-14_09:19:27.935008) 09:19:29.178958 run osmo-msc_10.42.42.6(pid=32746): stderr: | 20221214091928254 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214091928254 DLGLOBAL DEBUG validating counter group 0x7f082d474c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214091928254 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214091928255 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214091928255 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214091928255 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214091928257 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214091928257 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214091928257 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214091928257 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:19:29.230948 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32739): Terminating (SIGTERM) 09:19:29.272685 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32742): Terminating (SIGTERM) 09:19:29.314515 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32745): Terminating (SIGTERM) 09:19:29.356739 --- ParallelTerminationStrategy: PID 32739 died... 09:19:29.376848 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32739): Terminated: ok {rc=0} 09:19:29.423039 --- ParallelTerminationStrategy: PID 32742 died... 09:19:29.442680 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32742): Terminated: ok {rc=0} 09:19:29.488412 --- ParallelTerminationStrategy: PID 32745 died... 09:19:29.508066 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32745): Terminated: ok {rc=0} 09:19:29.594942 bus /sierra_3: Setting Powered False 09:19:30.692190 bus /sierra_3: Setting Powered False 09:19:31.811092 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2402 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 09:19:32.961615 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:19:32.974309 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 09:19:33.046284 tst mo_mt_call_osmux.py: using LAC 39934 09:19:33.172133 tst mo_mt_call_osmux.py: using RAC 154 09:19:33.291935 tst mo_mt_call_osmux.py: using CellId 39934 09:19:33.409747 tst mo_mt_call_osmux.py: using BVCI 39935 09:19:33.522017 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:19:33.533577 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:19:33.544743 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:19:33.555924 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:19:33.567810 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:19:33.579751 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 09:19:33.699927 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 09:19:33.819811 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:19:34.321544 run create_hlr_db(pid=32748): Launched 09:19:34.454154 bus /sierra_2: Setting Powered False 09:19:35.518342 run create_hlr_db(pid=32748): Terminated: ok {rc=0} 09:19:35.948458 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32750): Launched 09:19:36.251096 run osmo-hlr_10.42.42.2(pid=32751): Launched 09:19:36.366412 run osmo-stp_10.42.42.5: Starting osmo-stp 09:19:36.899122 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32753): Launched 09:19:37.199850 run osmo-stp_10.42.42.5(pid=32754): Launched 09:19:37.323992 run osmo-msc_10.42.42.6: Starting osmo-msc 09:19:37.911643 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32756): Launched 09:19:38.235187 run osmo-msc_10.42.42.6(pid=32757): Launched 09:19:38.414541 run osmo-stp_10.42.42.5(pid=32754): ERR: Terminated: ERROR {rc=1} [trial-2402↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32754)] 09:19:38.549193 run osmo-stp_10.42.42.5(pid=32754): stdout: | (launched: 2022-12-14_09:19:37.144138) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:19:38.684775 run osmo-stp_10.42.42.5(pid=32754): stderr: | 20221214091937328 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214091937329 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214091937329 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214091937329 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214091937330 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214091937330 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214091937330 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:19:38.819302 run osmo-stp_10.42.42.5(pid=32754): stdout: | (launched: 2022-12-14_09:19:37.144138) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:19:38.947079 run osmo-stp_10.42.42.5(pid=32754): stderr: | 20221214091937328 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214091937329 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214091937329 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214091937329 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214091937330 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214091937330 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214091937330 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:19:39.099766 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32754): Process ended prematurely: osmo-stp_10.42.42.5(pid=32754) [trial-2402↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32754)] [trial-2402↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 09:19:39.109647 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 09:19:39.137844 run osmo-hlr_10.42.42.2(pid=32751): ERR: Terminated: ERROR {rc=237} [trial-2402↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32751)] 09:19:39.188201 run osmo-hlr_10.42.42.2(pid=32751): stdout: | (launched: 2022-12-14_09:19:36.194589) 09:19:39.240280 run osmo-hlr_10.42.42.2(pid=32751): stderr: | 20221214091936365 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214091936365 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214091936365 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214091936365 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214091936365 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214091936365 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214091936377 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214091936385 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214091936386 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214091936386 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:19:39.313041 run osmo-msc_10.42.42.6(pid=32757): ERR: Terminated: ERROR {rc=2} [trial-2402↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32757)] 09:19:39.363259 run osmo-msc_10.42.42.6(pid=32757): stdout: | (launched: 2022-12-14_09:19:38.175414) 09:19:39.415432 run osmo-msc_10.42.42.6(pid=32757): stderr: | 20221214091938495 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214091938495 DLGLOBAL DEBUG validating counter group 0x7f81339c2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214091938495 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214091938495 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214091938495 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214091938495 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214091938497 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214091938498 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214091938498 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214091938498 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:19:39.467925 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32750): Terminating (SIGTERM) 09:19:39.509555 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32753): Terminating (SIGTERM) 09:19:39.551662 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32756): Terminating (SIGTERM) 09:19:39.594230 --- ParallelTerminationStrategy: PID 32750 died... 09:19:39.614321 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32750): Terminated: ok {rc=0} 09:19:39.660834 --- ParallelTerminationStrategy: PID 32753 died... 09:19:39.680925 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32753): Terminated: ok {rc=0} 09:19:39.726942 --- ParallelTerminationStrategy: PID 32756 died... 09:19:39.746702 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32756): Terminated: ok {rc=0} 09:19:39.833884 bus /sierra_3: Setting Powered False 09:19:40.931382 bus /sierra_3: Setting Powered False 09:19:42.046210 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2402 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 09:19:43.295551 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:19:43.303525 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 09:19:43.332630 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 09:19:43.360070 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 09:19:43.412292 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 09:19:43.441886 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 09:19:43.469312 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 09:19:44.022696 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2402 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 09:19:44.071119 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 09:19:44.082424 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 09:19:44.145692 tst mo_mt_call.py: using LAC 39935 09:19:44.264586 tst mo_mt_call.py: using RAC 155 09:19:44.383312 tst mo_mt_call.py: using CellId 39935 09:19:44.509420 tst mo_mt_call.py: using BVCI 39936 09:19:44.626042 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 09:19:44.637974 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 09:19:44.650163 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 09:19:44.661946 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 09:19:44.673554 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 09:19:44.684935 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 09:19:44.803903 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 09:19:44.920062 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:19:45.386765 run create_hlr_db(pid=32762): Launched 09:19:45.501925 bus /sierra_2: Setting Powered False 09:19:46.559955 run create_hlr_db(pid=32762): Terminated: ok {rc=0} 09:19:46.990123 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32764): Launched 09:19:47.310328 run osmo-hlr_10.42.42.2(pid=32765): Launched 09:19:47.428589 run osmo-stp_10.42.42.5: Starting osmo-stp 09:19:47.948294 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32767): Launched 09:19:48.249948 run osmo-stp_10.42.42.5(pid=300): Launched 09:19:48.367751 run osmo-msc_10.42.42.6: Starting osmo-msc 09:19:48.910994 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=302): Launched 09:19:49.211808 run osmo-msc_10.42.42.6(pid=303): Launched 09:19:49.380099 run osmo-stp_10.42.42.5(pid=300): ERR: Terminated: ERROR {rc=1} [trial-2402↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=300)] 09:19:49.507420 run osmo-stp_10.42.42.5(pid=300): stdout: | (launched: 2022-12-14_09:19:48.193280) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:19:49.634543 run osmo-stp_10.42.42.5(pid=300): stderr: | 20221214091948359 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214091948359 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214091948359 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214091948360 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214091948360 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214091948360 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214091948360 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:19:49.760076 run osmo-stp_10.42.42.5(pid=300): stdout: | (launched: 2022-12-14_09:19:48.193280) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:19:49.879450 run osmo-stp_10.42.42.5(pid=300): stderr: | 20221214091948359 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214091948359 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214091948359 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214091948360 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214091948360 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214091948360 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214091948360 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:19:50.022799 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=300): Process ended prematurely: osmo-stp_10.42.42.5(pid=300) [trial-2402↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=300)] [trial-2402↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 09:19:50.031813 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 09:19:50.058148 run osmo-hlr_10.42.42.2(pid=32765): ERR: Terminated: ERROR {rc=237} [trial-2402↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32765)] 09:19:50.105557 run osmo-hlr_10.42.42.2(pid=32765): stdout: | (launched: 2022-12-14_09:19:47.254172) 09:19:50.154355 run osmo-hlr_10.42.42.2(pid=32765): stderr: | 20221214091947425 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214091947425 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214091947425 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214091947425 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214091947425 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214091947425 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214091947437 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214091947445 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214091947445 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214091947445 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:19:50.222983 run osmo-msc_10.42.42.6(pid=303): ERR: Terminated: ERROR {rc=2} [trial-2402↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=303)] 09:19:50.269974 run osmo-msc_10.42.42.6(pid=303): stdout: | (launched: 2022-12-14_09:19:49.155992) 09:19:50.318660 run osmo-msc_10.42.42.6(pid=303): stderr: | 20221214091949423 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214091949423 DLGLOBAL DEBUG validating counter group 0x7f46ac0d5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214091949424 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214091949424 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214091949424 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214091949424 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214091949426 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214091949426 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214091949426 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214091949426 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:19:50.367416 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32764): Terminating (SIGTERM) 09:19:50.406483 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32767): Terminating (SIGTERM) 09:19:50.445517 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=302): Terminating (SIGTERM) 09:19:50.484842 --- ParallelTerminationStrategy: PID 32764 died... 09:19:50.503778 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32764): Terminated: ok {rc=0} 09:19:50.547675 --- ParallelTerminationStrategy: PID 32767 died... 09:19:50.566476 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32767): Terminated: ok {rc=0} 09:19:50.609916 --- ParallelTerminationStrategy: PID 302 died... 09:19:50.628342 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=302): Terminated: ok {rc=0} 09:19:50.713679 bus /sierra_3: Setting Powered False 09:19:51.811743 bus /sierra_3: Setting Powered False 09:19:52.926504 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2402 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 09:19:54.070791 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 09:19:54.082811 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 09:19:54.148784 tst mo_mt_call_osmux.py: using LAC 39936 09:19:54.269439 tst mo_mt_call_osmux.py: using RAC 156 09:19:54.399554 tst mo_mt_call_osmux.py: using CellId 39936 09:19:54.525959 tst mo_mt_call_osmux.py: using BVCI 39937 09:19:54.643599 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 09:19:54.655813 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 09:19:54.667634 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 09:19:54.679404 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 09:19:54.691227 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 09:19:54.702996 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 09:19:54.819069 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 09:19:54.939618 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:19:55.441619 run create_hlr_db(pid=305): Launched 09:19:55.573889 bus /sierra_2: Setting Powered False 09:19:56.637960 run create_hlr_db(pid=305): Terminated: ok {rc=0} 09:19:57.085719 run pcap-recorder_any(filters='host 10.42.42.2')(pid=307): Launched 09:19:57.407418 run osmo-hlr_10.42.42.2(pid=308): Launched 09:19:57.533107 run osmo-stp_10.42.42.5: Starting osmo-stp 09:19:58.092705 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=310): Launched 09:19:58.415979 run osmo-stp_10.42.42.5(pid=311): Launched 09:19:58.539698 run osmo-msc_10.42.42.6: Starting osmo-msc 09:19:59.123460 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=313): Launched 09:19:59.446297 run osmo-msc_10.42.42.6(pid=314): Launched 09:19:59.621884 run osmo-stp_10.42.42.5(pid=311): ERR: Terminated: ERROR {rc=1} [trial-2402↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=311)] 09:19:59.753251 run osmo-stp_10.42.42.5(pid=311): stdout: | (launched: 2022-12-14_09:19:58.356400) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:19:59.881359 run osmo-stp_10.42.42.5(pid=311): stderr: | 20221214091958546 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214091958546 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214091958546 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214091958547 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214091958547 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214091958547 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214091958547 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:20:00.007436 run osmo-stp_10.42.42.5(pid=311): stdout: | (launched: 2022-12-14_09:19:58.356400) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:20:00.127526 run osmo-stp_10.42.42.5(pid=311): stderr: | 20221214091958546 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214091958546 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214091958546 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214091958547 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214091958547 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214091958547 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214091958547 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:20:00.271187 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=311): Process ended prematurely: osmo-stp_10.42.42.5(pid=311) [trial-2402↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=311)] [trial-2402↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 09:20:00.280151 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 09:20:00.306475 run osmo-hlr_10.42.42.2(pid=308): ERR: Terminated: ERROR {rc=237} [trial-2402↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=308)] 09:20:00.354839 run osmo-hlr_10.42.42.2(pid=308): stdout: | (launched: 2022-12-14_09:19:57.348184) 09:20:00.403648 run osmo-hlr_10.42.42.2(pid=308): stderr: | 20221214091957545 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214091957545 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214091957545 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214091957545 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214091957545 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214091957545 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214091957559 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214091957569 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214091957569 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214091957569 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:20:00.472027 run osmo-msc_10.42.42.6(pid=314): ERR: Terminated: ERROR {rc=2} [trial-2402↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=314)] 09:20:00.518837 run osmo-msc_10.42.42.6(pid=314): stdout: | (launched: 2022-12-14_09:19:59.386856) 09:20:00.567752 run osmo-msc_10.42.42.6(pid=314): stderr: | 20221214091959658 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214091959658 DLGLOBAL DEBUG validating counter group 0x7f0180c05c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214091959658 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214091959658 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214091959658 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214091959658 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214091959660 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214091959661 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214091959661 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214091959661 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:20:00.617590 run pcap-recorder_any(filters='host 10.42.42.2')(pid=307): Terminating (SIGTERM) 09:20:00.656669 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=310): Terminating (SIGTERM) 09:20:00.695769 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=313): Terminating (SIGTERM) 09:20:00.735181 --- ParallelTerminationStrategy: PID 307 died... 09:20:00.754508 run pcap-recorder_any(filters='host 10.42.42.2')(pid=307): Terminated: ok {rc=0} 09:20:00.798176 --- ParallelTerminationStrategy: PID 310 died... 09:20:00.817317 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=310): Terminated: ok {rc=0} 09:20:00.862247 --- ParallelTerminationStrategy: PID 313 died... 09:20:00.886270 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=313): Terminated: ok {rc=0} 09:20:00.981711 bus /sierra_3: Setting Powered False 09:20:02.083875 bus /sierra_3: Setting Powered False 09:20:03.201158 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2402 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 09:20:04.444112 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:20:04.450927 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 09:20:04.479381 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 09:20:04.506815 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 09:20:04.563874 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 09:20:04.593605 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 09:20:04.620683 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 09:20:05.174980 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2402 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 09:20:05.227015 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:20:05.238932 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 09:20:05.304489 tst mo_mt_call.py: using LAC 39937 09:20:05.430249 tst mo_mt_call.py: using RAC 157 09:20:05.555623 tst mo_mt_call.py: using CellId 39937 09:20:05.681702 tst mo_mt_call.py: using BVCI 39938 09:20:05.799152 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:20:05.811054 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:20:05.822608 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:20:05.834154 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:20:05.846008 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:20:05.857673 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 09:20:05.973464 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 09:20:06.090576 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:20:06.559170 run create_hlr_db(pid=322): Launched 09:20:06.676406 bus /sierra_2: Setting Powered False 09:20:07.735818 run create_hlr_db(pid=322): Terminated: ok {rc=0} 09:20:08.154723 run pcap-recorder_any(filters='host 10.42.42.2')(pid=324): Launched 09:20:08.455718 run osmo-hlr_10.42.42.2(pid=325): Launched 09:20:08.572626 run osmo-stp_10.42.42.5: Starting osmo-stp 09:20:09.104248 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=327): Launched 09:20:09.404122 run osmo-stp_10.42.42.5(pid=328): Launched 09:20:09.518765 run osmo-msc_10.42.42.6: Starting osmo-msc 09:20:10.062696 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=330): Launched 09:20:10.363453 run osmo-msc_10.42.42.6(pid=331): Launched 09:20:10.532371 run osmo-stp_10.42.42.5(pid=328): ERR: Terminated: ERROR {rc=1} [trial-2402↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=328)] 09:20:10.659822 run osmo-stp_10.42.42.5(pid=328): stdout: | (launched: 2022-12-14_09:20:09.348512) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:20:10.786930 run osmo-stp_10.42.42.5(pid=328): stderr: | 20221214092009514 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214092009514 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214092009515 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214092009515 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214092009516 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214092009516 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214092009516 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:20:10.912239 run osmo-stp_10.42.42.5(pid=328): stdout: | (launched: 2022-12-14_09:20:09.348512) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:20:11.031538 run osmo-stp_10.42.42.5(pid=328): stderr: | 20221214092009514 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214092009514 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214092009515 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214092009515 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214092009516 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214092009516 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214092009516 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:20:11.175152 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=328): Process ended prematurely: osmo-stp_10.42.42.5(pid=328) [trial-2402↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=328)] [trial-2402↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 09:20:11.184148 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 09:20:11.210362 run osmo-hlr_10.42.42.2(pid=325): ERR: Terminated: ERROR {rc=237} [trial-2402↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=325)] 09:20:11.257886 run osmo-hlr_10.42.42.2(pid=325): stdout: | (launched: 2022-12-14_09:20:08.398990) 09:20:11.306788 run osmo-hlr_10.42.42.2(pid=325): stderr: | 20221214092008570 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214092008570 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214092008571 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214092008571 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214092008571 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214092008571 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214092008582 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214092008590 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214092008590 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214092008590 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:20:11.375781 run osmo-msc_10.42.42.6(pid=331): ERR: Terminated: ERROR {rc=2} [trial-2402↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=331)] 09:20:11.422656 run osmo-msc_10.42.42.6(pid=331): stdout: | (launched: 2022-12-14_09:20:10.307577) 09:20:11.471672 run osmo-msc_10.42.42.6(pid=331): stderr: | 20221214092010577 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214092010577 DLGLOBAL DEBUG validating counter group 0x7f84ea220c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214092010577 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214092010577 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214092010578 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214092010578 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214092010580 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214092010580 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214092010581 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214092010581 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:20:11.520841 run pcap-recorder_any(filters='host 10.42.42.2')(pid=324): Terminating (SIGTERM) 09:20:11.560262 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=327): Terminating (SIGTERM) 09:20:11.599450 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=330): Terminating (SIGTERM) 09:20:11.639146 --- ParallelTerminationStrategy: PID 324 died... 09:20:11.658443 run pcap-recorder_any(filters='host 10.42.42.2')(pid=324): Terminated: ok {rc=0} 09:20:11.702005 --- ParallelTerminationStrategy: PID 327 died... 09:20:11.720496 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=327): Terminated: ok {rc=0} 09:20:11.763973 --- ParallelTerminationStrategy: PID 330 died... 09:20:11.782721 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=330): Terminated: ok {rc=0} 09:20:11.867308 bus /sierra_3: Setting Powered False 09:20:12.964863 bus /sierra_3: Setting Powered False 09:20:14.079181 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2402 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 09:20:15.222639 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:20:15.234732 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 09:20:15.300222 tst mo_mt_call_osmux.py: using LAC 39938 09:20:15.418399 tst mo_mt_call_osmux.py: using RAC 158 09:20:15.538933 tst mo_mt_call_osmux.py: using CellId 39938 09:20:15.656928 tst mo_mt_call_osmux.py: using BVCI 39939 09:20:15.766318 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:20:15.777698 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:20:15.788810 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:20:15.799850 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:20:15.811351 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:20:15.822880 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 09:20:15.981683 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 09:20:16.131741 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:20:16.670449 run create_hlr_db(pid=333): Launched 09:20:16.799039 bus /sierra_2: Setting Powered False 09:20:17.858158 run create_hlr_db(pid=333): Terminated: ok {rc=0} 09:20:18.318538 run pcap-recorder_any(filters='host 10.42.42.2')(pid=335): Launched 09:20:18.642528 run osmo-hlr_10.42.42.2(pid=336): Launched 09:20:18.767211 run osmo-stp_10.42.42.5: Starting osmo-stp 09:20:19.321415 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=338): Launched 09:20:19.643182 run osmo-stp_10.42.42.5(pid=339): Launched 09:20:19.766379 run osmo-msc_10.42.42.6: Starting osmo-msc 09:20:20.353735 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=341): Launched 09:20:20.676688 run osmo-msc_10.42.42.6(pid=342): Launched 09:20:20.857867 run osmo-stp_10.42.42.5(pid=339): ERR: Terminated: ERROR {rc=1} [trial-2402↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=339)] 09:20:20.993313 run osmo-stp_10.42.42.5(pid=339): stdout: | (launched: 2022-12-14_09:20:19.583357) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:20:21.129110 run osmo-stp_10.42.42.5(pid=339): stderr: | 20221214092019772 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214092019772 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214092019773 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214092019773 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214092019774 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214092019774 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214092019774 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:20:21.263809 run osmo-stp_10.42.42.5(pid=339): stdout: | (launched: 2022-12-14_09:20:19.583357) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:20:21.391655 run osmo-stp_10.42.42.5(pid=339): stderr: | 20221214092019772 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214092019772 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214092019773 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214092019773 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214092019774 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214092019774 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214092019774 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:20:21.544662 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=339): Process ended prematurely: osmo-stp_10.42.42.5(pid=339) [trial-2402↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=339)] [trial-2402↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 09:20:21.554489 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 09:20:21.582360 run osmo-hlr_10.42.42.2(pid=336): ERR: Terminated: ERROR {rc=237} [trial-2402↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=336)] 09:20:21.632327 run osmo-hlr_10.42.42.2(pid=336): stdout: | (launched: 2022-12-14_09:20:18.583422) 09:20:21.684142 run osmo-hlr_10.42.42.2(pid=336): stderr: | 20221214092018776 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214092018776 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214092018776 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214092018776 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214092018777 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214092018777 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214092018789 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214092018798 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214092018799 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214092018799 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:20:21.756003 run osmo-msc_10.42.42.6(pid=342): ERR: Terminated: ERROR {rc=2} [trial-2402↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=342)] 09:20:21.805305 run osmo-msc_10.42.42.6(pid=342): stdout: | (launched: 2022-12-14_09:20:20.616928) 09:20:21.856542 run osmo-msc_10.42.42.6(pid=342): stderr: | 20221214092020936 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214092020936 DLGLOBAL DEBUG validating counter group 0x7f5df89eac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214092020937 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214092020937 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214092020937 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214092020937 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214092020939 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214092020939 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214092020939 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214092020939 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:20:21.908224 run pcap-recorder_any(filters='host 10.42.42.2')(pid=335): Terminating (SIGTERM) 09:20:21.949249 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=338): Terminating (SIGTERM) 09:20:21.990544 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=341): Terminating (SIGTERM) 09:20:22.032125 --- ParallelTerminationStrategy: PID 335 died... 09:20:22.052231 run pcap-recorder_any(filters='host 10.42.42.2')(pid=335): Terminated: ok {rc=0} 09:20:22.098408 --- ParallelTerminationStrategy: PID 338 died... 09:20:22.118155 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=338): Terminated: ok {rc=0} 09:20:22.163844 --- ParallelTerminationStrategy: PID 341 died... 09:20:22.183591 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=341): Terminated: ok {rc=0} 09:20:22.270250 bus /sierra_3: Setting Powered False 09:20:23.367777 bus /sierra_3: Setting Powered False 09:20:24.480196 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2402 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 09:20:25.723639 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:20:25.730449 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 09:20:25.759256 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 09:20:25.786319 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 09:20:25.837456 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 09:20:25.866392 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 09:20:25.892815 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 09:20:26.446018 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2402 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 09:20:26.494507 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:20:26.506073 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 09:20:26.575435 tst mo_mt_call.py: using LAC 39939 09:20:26.693143 tst mo_mt_call.py: using RAC 159 09:20:26.810393 tst mo_mt_call.py: using CellId 39939 09:20:26.929212 tst mo_mt_call.py: using BVCI 39940 09:20:27.038831 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:20:27.050483 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:20:27.061854 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:20:27.073214 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:20:27.085035 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:20:27.096695 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 09:20:27.215859 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 09:20:27.332922 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:20:27.802810 run create_hlr_db(pid=349): Launched 09:20:27.917449 bus /sierra_2: Setting Powered False 09:20:28.977828 run create_hlr_db(pid=349): Terminated: ok {rc=0} 09:20:29.417723 run pcap-recorder_any(filters='host 10.42.42.2')(pid=356): Launched 09:20:29.743209 run osmo-hlr_10.42.42.2(pid=358): Launched 09:20:29.866093 run osmo-stp_10.42.42.5: Starting osmo-stp 09:20:30.420584 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=360): Launched 09:20:30.744131 run osmo-stp_10.42.42.5(pid=361): Launched 09:20:30.930494 run osmo-msc_10.42.42.6: Starting osmo-msc 09:20:31.614921 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=368): Launched 09:20:31.944318 run osmo-msc_10.42.42.6(pid=369): Launched 09:20:32.321032 run osmo-stp_10.42.42.5(pid=361): ERR: Terminated: ERROR {rc=1} [trial-2402↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=361)] 09:20:32.452902 run osmo-stp_10.42.42.5(pid=361): stdout: | (launched: 2022-12-14_09:20:30.684272) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:20:32.579825 run osmo-stp_10.42.42.5(pid=361): stderr: | 20221214092030876 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214092030877 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214092030877 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214092030877 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214092030878 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214092030878 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214092030878 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:20:32.707189 run osmo-stp_10.42.42.5(pid=361): stdout: | (launched: 2022-12-14_09:20:30.684272) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:20:32.827574 run osmo-stp_10.42.42.5(pid=361): stderr: | 20221214092030876 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214092030877 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214092030877 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214092030877 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214092030878 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214092030878 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214092030878 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:20:32.971659 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=361): Process ended prematurely: osmo-stp_10.42.42.5(pid=361) [trial-2402↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=361)] [trial-2402↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 09:20:32.980774 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 09:20:33.007783 run osmo-hlr_10.42.42.2(pid=358): ERR: Terminated: ERROR {rc=237} [trial-2402↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=358)] 09:20:33.056312 run osmo-hlr_10.42.42.2(pid=358): stdout: | (launched: 2022-12-14_09:20:29.683309) 09:20:33.106106 run osmo-hlr_10.42.42.2(pid=358): stderr: | 20221214092029877 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214092029877 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214092029877 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214092029877 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214092029877 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214092029877 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214092029890 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214092029898 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214092029899 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214092029899 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:20:33.176490 run osmo-msc_10.42.42.6(pid=369): ERR: Terminated: ERROR {rc=2} [trial-2402↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=369)] 09:20:33.224375 run osmo-msc_10.42.42.6(pid=369): stdout: | (launched: 2022-12-14_09:20:31.886448) 09:20:33.274420 run osmo-msc_10.42.42.6(pid=369): stderr: | 20221214092032320 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214092032320 DLGLOBAL DEBUG validating counter group 0x7fbf6e9b3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214092032320 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214092032320 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214092032320 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214092032321 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214092032322 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214092032323 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214092032323 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214092032323 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:20:33.324657 run pcap-recorder_any(filters='host 10.42.42.2')(pid=356): Terminating (SIGTERM) 09:20:33.364858 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=360): Terminating (SIGTERM) 09:20:33.405920 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=368): Terminating (SIGTERM) 09:20:33.446505 --- ParallelTerminationStrategy: PID 356 died... 09:20:33.466228 run pcap-recorder_any(filters='host 10.42.42.2')(pid=356): Terminated: ok {rc=0} 09:20:33.510825 --- ParallelTerminationStrategy: PID 360 died... 09:20:33.530137 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=360): Terminated: ok {rc=0} 09:20:33.574556 --- ParallelTerminationStrategy: PID 368 died... 09:20:33.593609 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=368): Terminated: ok {rc=0} 09:20:33.680176 bus /sierra_3: Setting Powered False 09:20:34.779304 bus /sierra_3: Setting Powered False 09:20:35.895257 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2402 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 09:20:37.040701 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:20:37.052844 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 09:20:37.119017 tst mo_mt_call_osmux.py: using LAC 39940 09:20:37.236794 tst mo_mt_call_osmux.py: using RAC 160 09:20:37.355431 tst mo_mt_call_osmux.py: using CellId 39940 09:20:37.475414 tst mo_mt_call_osmux.py: using BVCI 39941 09:20:37.586549 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:20:37.597937 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:20:37.609178 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:20:37.620261 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:20:37.631815 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:20:37.643255 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 09:20:37.759427 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 09:20:37.879131 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:20:38.381921 run create_hlr_db(pid=371): Launched 09:20:38.514068 bus /sierra_2: Setting Powered False 09:20:39.578428 run create_hlr_db(pid=371): Terminated: ok {rc=0} 09:20:40.009914 run pcap-recorder_any(filters='host 10.42.42.2')(pid=373): Launched 09:20:40.311721 run osmo-hlr_10.42.42.2(pid=374): Launched 09:20:40.427330 run osmo-stp_10.42.42.5: Starting osmo-stp 09:20:40.960679 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=376): Launched 09:20:41.261112 run osmo-stp_10.42.42.5(pid=377): Launched 09:20:41.376088 run osmo-msc_10.42.42.6: Starting osmo-msc 09:20:41.929897 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=379): Launched 09:20:42.254649 run osmo-msc_10.42.42.6(pid=380): Launched 09:20:42.425514 run osmo-stp_10.42.42.5(pid=377): ERR: Terminated: ERROR {rc=1} [trial-2402↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=377)] 09:20:42.554787 run osmo-stp_10.42.42.5(pid=377): stdout: | (launched: 2022-12-14_09:20:41.205530) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:20:42.682934 run osmo-stp_10.42.42.5(pid=377): stderr: | 20221214092041370 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214092041370 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214092041370 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214092041371 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214092041371 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214092041371 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214092041371 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:20:42.809295 run osmo-stp_10.42.42.5(pid=377): stdout: | (launched: 2022-12-14_09:20:41.205530) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:20:42.929261 run osmo-stp_10.42.42.5(pid=377): stderr: | 20221214092041370 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214092041370 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214092041370 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214092041371 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214092041371 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214092041371 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214092041371 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:20:43.072375 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=377): Process ended prematurely: osmo-stp_10.42.42.5(pid=377) [trial-2402↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=377)] [trial-2402↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 09:20:43.081503 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 09:20:43.108243 run osmo-hlr_10.42.42.2(pid=374): ERR: Terminated: ERROR {rc=237} [trial-2402↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=374)] 09:20:43.156428 run osmo-hlr_10.42.42.2(pid=374): stdout: | (launched: 2022-12-14_09:20:40.255385) 09:20:43.205778 run osmo-hlr_10.42.42.2(pid=374): stderr: | 20221214092040425 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214092040425 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214092040425 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214092040425 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214092040425 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214092040425 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214092040438 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214092040448 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214092040448 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214092040448 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:20:43.275502 run osmo-msc_10.42.42.6(pid=380): ERR: Terminated: ERROR {rc=2} [trial-2402↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=380)] 09:20:43.322942 run osmo-msc_10.42.42.6(pid=380): stdout: | (launched: 2022-12-14_09:20:42.195164) 09:20:43.372586 run osmo-msc_10.42.42.6(pid=380): stderr: | 20221214092042463 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214092042463 DLGLOBAL DEBUG validating counter group 0x7f947f82dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214092042463 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214092042463 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214092042463 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214092042463 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214092042465 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214092042466 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214092042466 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214092042466 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:20:43.422373 run pcap-recorder_any(filters='host 10.42.42.2')(pid=373): Terminating (SIGTERM) 09:20:43.462308 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=376): Terminating (SIGTERM) 09:20:43.502370 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=379): Terminating (SIGTERM) 09:20:43.542842 --- ParallelTerminationStrategy: PID 373 died... 09:20:43.562421 run pcap-recorder_any(filters='host 10.42.42.2')(pid=373): Terminated: ok {rc=0} 09:20:43.606883 --- ParallelTerminationStrategy: PID 376 died... 09:20:43.626127 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=376): Terminated: ok {rc=0} 09:20:43.670062 --- ParallelTerminationStrategy: PID 379 died... 09:20:43.689176 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=379): Terminated: ok {rc=0} 09:20:43.774977 bus /sierra_3: Setting Powered False 09:20:44.872787 bus /sierra_3: Setting Powered False 09:20:46.002806 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2402 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo --------------------------------------------------------------------- 09:20:47.270171 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:20:47.277637 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 09:20:47.307413 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 09:20:47.335110 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 09:20:47.392155 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 09:20:47.421782 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 09:20:47.448904 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 09:20:47.994435 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2402 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 09:20:48.043217 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 09:20:48.054515 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 09:20:48.119725 tst mo_mt_call.py: using LAC 39941 09:20:48.240373 tst mo_mt_call.py: using RAC 161 09:20:48.358140 tst mo_mt_call.py: using CellId 39941 09:20:48.482832 tst mo_mt_call.py: using BVCI 39942 09:20:48.593935 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 09:20:48.604835 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 09:20:48.615760 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 09:20:48.626605 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 09:20:48.638008 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 09:20:48.649190 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 09:20:48.766524 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 09:20:48.885548 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:20:49.387391 run create_hlr_db(pid=385): Launched 09:20:49.519412 bus /sierra_2: Setting Powered False 09:20:50.583439 run create_hlr_db(pid=385): Terminated: ok {rc=0} 09:20:51.012823 run pcap-recorder_any(filters='host 10.42.42.2')(pid=387): Launched 09:20:51.315286 run osmo-hlr_10.42.42.2(pid=388): Launched 09:20:51.430761 run osmo-stp_10.42.42.5: Starting osmo-stp 09:20:51.961952 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=390): Launched 09:20:52.268584 run osmo-stp_10.42.42.5(pid=392): Launched 09:20:52.383676 run osmo-msc_10.42.42.6: Starting osmo-msc 09:20:52.928622 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=394): Launched 09:20:53.230516 run osmo-msc_10.42.42.6(pid=395): Launched 09:20:53.401977 run osmo-stp_10.42.42.5(pid=392): ERR: Terminated: ERROR {rc=1} [trial-2402↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=392)] 09:20:53.529649 run osmo-stp_10.42.42.5(pid=392): stdout: | (launched: 2022-12-14_09:20:52.212772) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:20:53.657086 run osmo-stp_10.42.42.5(pid=392): stderr: | 20221214092052378 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214092052378 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214092052378 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214092052379 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214092052379 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214092052379 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214092052379 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:20:53.782608 run osmo-stp_10.42.42.5(pid=392): stdout: | (launched: 2022-12-14_09:20:52.212772) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:20:53.902758 run osmo-stp_10.42.42.5(pid=392): stderr: | 20221214092052378 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214092052378 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214092052378 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214092052379 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214092052379 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214092052379 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214092052379 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:20:54.046052 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=392): Process ended prematurely: osmo-stp_10.42.42.5(pid=392) [trial-2402↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=392)] [trial-2402↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 09:20:54.054939 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 09:20:54.081785 run osmo-hlr_10.42.42.2(pid=388): ERR: Terminated: ERROR {rc=237} [trial-2402↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=388)] 09:20:54.129604 run osmo-hlr_10.42.42.2(pid=388): stdout: | (launched: 2022-12-14_09:20:51.258839) 09:20:54.178721 run osmo-hlr_10.42.42.2(pid=388): stderr: | 20221214092051430 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214092051430 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214092051430 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214092051430 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214092051430 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214092051430 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214092051446 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214092051455 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214092051455 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214092051455 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:20:54.247623 run osmo-msc_10.42.42.6(pid=395): ERR: Terminated: ERROR {rc=2} [trial-2402↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=395)] 09:20:54.294739 run osmo-msc_10.42.42.6(pid=395): stdout: | (launched: 2022-12-14_09:20:53.174393) 09:20:54.343730 run osmo-msc_10.42.42.6(pid=395): stderr: | 20221214092053441 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214092053441 DLGLOBAL DEBUG validating counter group 0x7f60b8acec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214092053441 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214092053441 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214092053441 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214092053441 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214092053443 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214092053443 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214092053444 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214092053444 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:20:54.393173 run pcap-recorder_any(filters='host 10.42.42.2')(pid=387): Terminating (SIGTERM) 09:20:54.432578 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=390): Terminating (SIGTERM) 09:20:54.472006 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=394): Terminating (SIGTERM) 09:20:54.511791 --- ParallelTerminationStrategy: PID 387 died... 09:20:54.531074 run pcap-recorder_any(filters='host 10.42.42.2')(pid=387): Terminated: ok {rc=0} 09:20:54.574863 --- ParallelTerminationStrategy: PID 390 died... 09:20:54.593798 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=390): Terminated: ok {rc=0} 09:20:54.637381 --- ParallelTerminationStrategy: PID 394 died... 09:20:54.656094 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=394): Terminated: ok {rc=0} 09:20:54.741861 bus /sierra_3: Setting Powered False 09:20:55.840440 bus /sierra_3: Setting Powered False 09:20:56.955154 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2402 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 09:20:58.100705 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 09:20:58.112592 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 09:20:58.179378 tst mo_mt_call_osmux.py: using LAC 39942 09:20:58.298354 tst mo_mt_call_osmux.py: using RAC 162 09:20:58.417088 tst mo_mt_call_osmux.py: using CellId 39942 09:20:58.537299 tst mo_mt_call_osmux.py: using BVCI 39943 09:20:58.649088 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 09:20:58.660369 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 09:20:58.671440 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 09:20:58.682511 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 09:20:58.693974 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 09:20:58.705359 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 09:20:58.820890 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 09:20:58.935878 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:20:59.403451 run create_hlr_db(pid=397): Launched 09:20:59.517330 bus /sierra_2: Setting Powered False 09:21:00.577824 run create_hlr_db(pid=397): Terminated: ok {rc=0} 09:21:01.068277 run pcap-recorder_any(filters='host 10.42.42.2')(pid=399): Launched 09:21:01.424198 run osmo-hlr_10.42.42.2(pid=400): Launched 09:21:01.657937 run osmo-stp_10.42.42.5: Starting osmo-stp 09:21:02.278813 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=402): Launched 09:21:02.608438 run osmo-stp_10.42.42.5(pid=403): Launched 09:21:02.734291 run osmo-msc_10.42.42.6: Starting osmo-msc 09:21:03.319425 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=405): Launched 09:21:03.642695 run osmo-msc_10.42.42.6(pid=406): Launched 09:21:03.825859 run osmo-stp_10.42.42.5(pid=403): ERR: Terminated: ERROR {rc=1} [trial-2402↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=403)] 09:21:03.961342 run osmo-stp_10.42.42.5(pid=403): stdout: | (launched: 2022-12-14_09:21:02.548793) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:21:04.099770 run osmo-stp_10.42.42.5(pid=403): stderr: | 20221214092102737 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214092102737 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214092102737 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214092102738 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214092102738 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214092102738 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214092102738 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:21:04.235134 run osmo-stp_10.42.42.5(pid=403): stdout: | (launched: 2022-12-14_09:21:02.548793) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:21:04.364196 run osmo-stp_10.42.42.5(pid=403): stderr: | 20221214092102737 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214092102737 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214092102737 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214092102738 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214092102738 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214092102738 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214092102738 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:21:04.518409 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=403): Process ended prematurely: osmo-stp_10.42.42.5(pid=403) [trial-2402↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=403)] [trial-2402↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 09:21:04.527889 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 09:21:04.555781 run osmo-hlr_10.42.42.2(pid=400): ERR: Terminated: ERROR {rc=237} [trial-2402↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=400)] 09:21:04.605238 run osmo-hlr_10.42.42.2(pid=400): stdout: | (launched: 2022-12-14_09:21:01.361195) 09:21:04.656744 run osmo-hlr_10.42.42.2(pid=400): stderr: | 20221214092101608 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214092101608 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214092101608 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214092101608 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214092101608 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214092101608 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214092101626 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214092101650 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214092101651 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214092101651 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:21:04.728939 run osmo-msc_10.42.42.6(pid=406): ERR: Terminated: ERROR {rc=2} [trial-2402↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=406)] 09:21:04.778533 run osmo-msc_10.42.42.6(pid=406): stdout: | (launched: 2022-12-14_09:21:03.582776) 09:21:04.829791 run osmo-msc_10.42.42.6(pid=406): stderr: | 20221214092103901 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214092103901 DLGLOBAL DEBUG validating counter group 0x7ff3d5d97c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214092103902 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214092103902 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214092103902 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214092103902 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214092103904 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214092103904 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214092103904 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214092103904 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:21:04.881718 run pcap-recorder_any(filters='host 10.42.42.2')(pid=399): Terminating (SIGTERM) 09:21:04.922881 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=402): Terminating (SIGTERM) 09:21:04.964212 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=405): Terminating (SIGTERM) 09:21:05.005783 --- ParallelTerminationStrategy: PID 399 died... 09:21:05.025954 run pcap-recorder_any(filters='host 10.42.42.2')(pid=399): Terminated: ok {rc=0} 09:21:05.071841 --- ParallelTerminationStrategy: PID 402 died... 09:21:05.091132 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=402): Terminated: ok {rc=0} 09:21:05.137168 --- ParallelTerminationStrategy: PID 405 died... 09:21:05.156688 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=405): Terminated: ok {rc=0} 09:21:05.243232 bus /sierra_3: Setting Powered False 09:21:06.344589 bus /sierra_3: Setting Powered False 09:21:07.459203 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2402 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 emergency:trx-lms-limenet-micro --------------------------------------------------------------------- 09:21:08.704710 tst emergency:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:21:08.709501 tst emergency:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 09:21:08.739145 tst emergency:trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 09:21:08.766622 tst emergency:trx-lms-limenet-micro: Verifying 4 x modem (candidates: 12) 09:21:08.852422 tst emergency:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 09:21:08.882372 tst emergency:trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 09:21:08.909814 tst emergency:trx-lms-limenet-micro: Reserving 4 x modem (candidates: 12) 09:21:09.497676 tst emergency:trx-lms-limenet-micro: RESERVED RESOURCES for emergency: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2402 emergency:trx-lms-limenet-micro emergency_mo_mt_call.py ---------------------------------------------- 09:21:09.502809 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 09:21:09.514223 tst emergency:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 09:21:09.559665 tst emergency_mo_mt_call.py: using LAC 39943 09:21:09.677617 tst emergency_mo_mt_call.py: using RAC 163 09:21:09.803815 tst emergency_mo_mt_call.py: using CellId 39943 09:21:09.928208 tst emergency_mo_mt_call.py: using BVCI 39944 09:21:10.043578 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 09:21:10.055207 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 09:21:10.066635 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 09:21:10.077956 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 09:21:10.089127 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 09:21:10.100172 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 09:21:10.215560 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 09:21:10.335149 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:21:10.830025 run create_hlr_db(pid=412): Launched 09:21:10.961063 bus /sierra_2: Setting Powered False 09:21:12.024576 run create_hlr_db(pid=412): Terminated: ok {rc=0} 09:21:12.450145 run pcap-recorder_any(filters='host 10.42.42.2')(pid=414): Launched 09:21:12.747136 run osmo-hlr_10.42.42.2(pid=415): Launched 09:21:12.861283 run osmo-stp_10.42.42.5: Starting osmo-stp 09:21:13.374574 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=417): Launched 09:21:13.669884 run osmo-stp_10.42.42.5(pid=418): Launched 09:21:13.792657 tst emergency_mo_mt_call.py: using MSISDN 8607 09:21:13.942971 run osmo-msc_10.42.42.6: Starting osmo-msc 09:21:14.495082 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=420): Launched 09:21:14.814131 run osmo-msc_10.42.42.6(pid=421): Launched 09:21:14.993184 run osmo-stp_10.42.42.5(pid=418): ERR: Terminated: ERROR {rc=1} [trial-2402↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=418)] 09:21:15.127305 run osmo-stp_10.42.42.5(pid=418): stdout: | (launched: 2022-12-14_09:21:13.614683) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:21:15.261569 run osmo-stp_10.42.42.5(pid=418): stderr: | 20221214092113780 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214092113780 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214092113780 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214092113781 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214092113781 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214092113781 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214092113782 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:21:15.394840 run osmo-stp_10.42.42.5(pid=418): stdout: | (launched: 2022-12-14_09:21:13.614683) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:21:15.520533 run osmo-stp_10.42.42.5(pid=418): stderr: | 20221214092113780 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214092113780 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214092113780 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214092113781 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214092113781 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214092113781 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214092113782 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:21:15.670886 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=418): Process ended prematurely: osmo-stp_10.42.42.5(pid=418) [trial-2402↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=418)] [trial-2402↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19] 09:21:15.679738 tst emergency_mo_mt_call.py:19: Test FAILED (6.2 sec) 09:21:15.707328 run osmo-hlr_10.42.42.2(pid=415): ERR: Terminated: ERROR {rc=237} [trial-2402↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=415)] 09:21:15.757075 run osmo-hlr_10.42.42.2(pid=415): stdout: | (launched: 2022-12-14_09:21:12.691844) 09:21:15.808169 run osmo-hlr_10.42.42.2(pid=415): stderr: | 20221214092112862 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214092112862 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214092112862 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214092112862 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214092112862 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214092112862 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214092112874 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/emergency:trx-lms-limenet-micro/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214092112882 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214092112882 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214092112883 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:21:15.882509 run osmo-msc_10.42.42.6(pid=421): ERR: Terminated: ERROR {rc=2} [trial-2402↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=421)] 09:21:15.932910 run osmo-msc_10.42.42.6(pid=421): stdout: | (launched: 2022-12-14_09:21:14.755639) 09:21:15.984726 run osmo-msc_10.42.42.6(pid=421): stderr: | 20221214092115073 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214092115073 DLGLOBAL DEBUG validating counter group 0x7fc5d45bbc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214092115073 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214092115073 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214092115074 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214092115074 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214092115075 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214092115076 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214092115076 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214092115076 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:21:16.036831 run pcap-recorder_any(filters='host 10.42.42.2')(pid=414): Terminating (SIGTERM) 09:21:16.079253 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=417): Terminating (SIGTERM) 09:21:16.123742 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=420): Terminating (SIGTERM) 09:21:16.168151 --- ParallelTerminationStrategy: PID 414 died... 09:21:16.188526 run pcap-recorder_any(filters='host 10.42.42.2')(pid=414): Terminated: ok {rc=0} 09:21:16.236182 --- ParallelTerminationStrategy: PID 417 died... 09:21:16.256176 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=417): Terminated: ok {rc=0} 09:21:16.302570 --- ParallelTerminationStrategy: PID 420 died... 09:21:16.322522 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=420): Terminated: ok {rc=0} 09:21:16.410256 bus /sierra_3: Setting Powered False 09:21:17.508465 bus /sierra_3: Setting Powered False 09:21:18.622395 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2402 emergency:trx-lms-limenet-micro emergency_preemptive_call.py ---------------------------------------------- 09:21:19.709825 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 09:21:19.722208 tst emergency:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 09:21:19.769616 tst emergency_preemptive_call.py: using LAC 39944 09:21:19.892548 tst emergency_preemptive_call.py: using RAC 164 09:21:20.015936 tst emergency_preemptive_call.py: using CellId 39944 09:21:20.138662 tst emergency_preemptive_call.py: using BVCI 39945 09:21:20.253621 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 09:21:20.265041 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 09:21:20.276227 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 09:21:20.287502 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 09:21:20.298708 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 09:21:20.310044 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 09:21:20.427854 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 09:21:20.542137 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 09:21:20.661430 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 09:21:20.778310 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:21:21.271048 run create_hlr_db(pid=423): Launched 09:21:21.399433 bus /sierra_2: Setting Powered False 09:21:22.462303 run create_hlr_db(pid=423): Terminated: ok {rc=0} 09:21:22.886225 run pcap-recorder_any(filters='host 10.42.42.2')(pid=425): Launched 09:21:23.183519 run osmo-hlr_10.42.42.2(pid=426): Launched 09:21:23.295185 run osmo-stp_10.42.42.5: Starting osmo-stp 09:21:23.812030 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=428): Launched 09:21:24.107176 run osmo-stp_10.42.42.5(pid=429): Launched 09:21:24.226508 tst emergency_preemptive_call.py: using MSISDN 8608 09:21:24.376491 run osmo-msc_10.42.42.6: Starting osmo-msc 09:21:24.905976 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=431): Launched 09:21:25.201677 run osmo-msc_10.42.42.6(pid=432): Launched 09:21:25.366859 run osmo-stp_10.42.42.5(pid=429): ERR: Terminated: ERROR {rc=1} [trial-2402↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=429)] 09:21:25.492487 run osmo-stp_10.42.42.5(pid=429): stdout: | (launched: 2022-12-14_09:21:24.052108) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:21:25.617913 run osmo-stp_10.42.42.5(pid=429): stderr: | 20221214092124217 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214092124217 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214092124218 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214092124218 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214092124219 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214092124219 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214092124219 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:21:25.741475 run osmo-stp_10.42.42.5(pid=429): stdout: | (launched: 2022-12-14_09:21:24.052108) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:21:25.858654 run osmo-stp_10.42.42.5(pid=429): stderr: | 20221214092124217 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214092124217 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214092124218 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214092124218 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214092124219 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214092124219 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214092124219 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:21:25.999190 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=429): Process ended prematurely: osmo-stp_10.42.42.5(pid=429) [trial-2402↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=429)] [trial-2402↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32] 09:21:26.007536 tst emergency_preemptive_call.py:32: Test FAILED (6.3 sec) 09:21:26.033615 run osmo-hlr_10.42.42.2(pid=426): ERR: Terminated: ERROR {rc=237} [trial-2402↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=426)] 09:21:26.081982 run osmo-hlr_10.42.42.2(pid=426): stdout: | (launched: 2022-12-14_09:21:23.128207) 09:21:26.131358 run osmo-hlr_10.42.42.2(pid=426): stderr: | 20221214092123301 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214092123301 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214092123301 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214092123301 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214092123301 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214092123301 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214092123318 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/emergency:trx-lms-limenet-micro/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214092123327 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214092123327 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214092123327 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:21:26.200249 run osmo-msc_10.42.42.6(pid=432): ERR: Terminated: ERROR {rc=2} [trial-2402↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=432)] 09:21:26.247224 run osmo-msc_10.42.42.6(pid=432): stdout: | (launched: 2022-12-14_09:21:25.146621) 09:21:26.296200 run osmo-msc_10.42.42.6(pid=432): stderr: | 20221214092125413 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214092125414 DLGLOBAL DEBUG validating counter group 0x7f1cdead7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214092125414 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214092125414 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214092125414 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214092125414 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214092125416 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214092125416 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214092125416 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214092125417 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:21:26.345574 run pcap-recorder_any(filters='host 10.42.42.2')(pid=425): Terminating (SIGTERM) 09:21:26.384859 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=428): Terminating (SIGTERM) 09:21:26.424095 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=431): Terminating (SIGTERM) 09:21:26.463702 --- ParallelTerminationStrategy: PID 425 died... 09:21:26.483016 run pcap-recorder_any(filters='host 10.42.42.2')(pid=425): Terminated: ok {rc=0} 09:21:26.526931 --- ParallelTerminationStrategy: PID 428 died... 09:21:26.545832 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=428): Terminated: ok {rc=0} 09:21:26.589474 --- ParallelTerminationStrategy: PID 431 died... 09:21:26.608193 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=431): Terminated: ok {rc=0} 09:21:26.694104 bus /sierra_9: Setting Powered False 09:21:27.792419 bus /sierra_9: Setting Powered False 09:21:28.904066 bus /sierra_8: Setting Powered False 09:21:30.000195 bus /sierra_8: Setting Powered False 09:21:31.118694 bus /sierra_3: Setting Powered False 09:21:32.217322 bus /sierra_3: Setting Powered False 09:21:33.332659 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2402 emergency:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 gprs:trx-lms-limenet-micro --------------------------------------------------------------------- 09:21:34.607531 tst gprs:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:21:34.612611 tst gprs:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 09:21:34.641389 tst gprs:trx-lms-limenet-micro: Verifying 9 x ip_address (candidates: 9) 09:21:34.680594 tst gprs:trx-lms-limenet-micro: Verifying 4 x modem (candidates: 12) 09:21:34.766655 tst gprs:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 09:21:34.795319 tst gprs:trx-lms-limenet-micro: Reserving 9 x ip_address (candidates: 9) 09:21:34.833642 tst gprs:trx-lms-limenet-micro: Reserving 4 x modem (candidates: 12) 09:21:35.425187 tst gprs:trx-lms-limenet-micro: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2402 gprs:trx-lms-limenet-micro cs_paging_gprs_active.py ---------------------------------------------- 09:21:35.474537 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 09:21:35.485397 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 09:21:35.528292 tst cs_paging_gprs_active.py: using LAC 39945 09:21:35.644622 tst cs_paging_gprs_active.py: using RAC 165 09:21:35.761064 tst cs_paging_gprs_active.py: using CellId 39945 09:21:35.877146 tst cs_paging_gprs_active.py: using BVCI 39946 09:21:35.986175 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 09:21:35.996919 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 09:21:36.007575 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 09:21:36.018305 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 09:21:36.029149 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 09:21:36.040327 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 09:21:36.051595 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 09:21:36.062822 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 09:21:36.074160 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 09:21:36.194119 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 09:21:36.310239 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 09:21:36.513639 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:21:36.817263 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=437): Launched 09:21:37.080439 run iperf3-srv_10.42.42.10(pid=438): Launched 09:21:37.193691 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 09:21:37.394756 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:21:37.697596 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=439): Launched 09:21:37.980139 run iperf3-srv_10.42.42.10(pid=440): Launched 09:21:38.102426 tst cs_paging_gprs_active.py:38: start network... 09:21:38.319783 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:21:38.821962 run create_hlr_db(pid=441): Launched 09:21:38.954934 bus /sierra_2: Setting Powered False 09:21:40.019268 run create_hlr_db(pid=441): Terminated: ok {rc=0} 09:21:40.468110 run pcap-recorder_any(filters='host 10.42.42.2')(pid=443): Launched 09:21:40.793522 run osmo-hlr_10.42.42.2(pid=444): Launched 09:21:40.917098 run osmo-stp_10.42.42.5: Starting osmo-stp 09:21:41.471150 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=446): Launched 09:21:41.795393 run osmo-stp_10.42.42.5(pid=447): Launched 09:21:41.918960 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:21:42.474312 run pcap-recorder_any(filters='host 10.42.42.6')(pid=449): Launched 09:21:42.597234 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:21:42.871326 run patchelf(pid=450): Launched 09:21:43.051719 run osmo-stp_10.42.42.5(pid=447): ERR: Terminated: ERROR {rc=1} [trial-2402↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=447)] 09:21:43.188781 run osmo-stp_10.42.42.5(pid=447): stdout: | (launched: 2022-12-14_09:21:41.735904) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:21:43.326860 run osmo-stp_10.42.42.5(pid=447): stderr: | 20221214092141925 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214092141925 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214092141925 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214092141926 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214092141926 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214092141926 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214092141926 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:21:43.465203 run osmo-stp_10.42.42.5(pid=447): stdout: | (launched: 2022-12-14_09:21:41.735904) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:21:43.598079 run osmo-stp_10.42.42.5(pid=447): stderr: | 20221214092141925 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214092141925 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214092141925 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214092141926 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214092141926 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214092141926 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214092141926 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:21:43.755298 run patchelf(pid=450): Terminating (SIGINT) 09:21:43.935872 run patchelf(pid=450): Terminated: ok {rc=0} 09:21:44.065807 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=447): Process ended prematurely: osmo-stp_10.42.42.5(pid=447) [trial-2402↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=447)] [trial-2402↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38] 09:21:44.076149 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 09:21:44.104562 run osmo-hlr_10.42.42.2(pid=444): ERR: Terminated: ERROR {rc=237} [trial-2402↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=444)] 09:21:44.154162 run osmo-hlr_10.42.42.2(pid=444): stdout: | (launched: 2022-12-14_09:21:40.733905) 09:21:44.205720 run osmo-hlr_10.42.42.2(pid=444): stderr: | 20221214092140928 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214092140928 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214092140928 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214092140928 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214092140928 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214092140928 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214092140939 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/gprs:trx-lms-limenet-micro/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214092140948 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214092140948 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214092140948 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:21:44.257582 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=437): Terminating (SIGTERM) 09:21:44.299058 run iperf3-srv_10.42.42.10(pid=438): Terminating (SIGTERM) 09:21:44.341942 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=439): Terminating (SIGTERM) 09:21:44.384540 run iperf3-srv_10.42.42.10(pid=440): Terminating (SIGTERM) 09:21:44.424800 run pcap-recorder_any(filters='host 10.42.42.2')(pid=443): Terminating (SIGTERM) 09:21:44.464846 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=446): Terminating (SIGTERM) 09:21:44.504870 run pcap-recorder_any(filters='host 10.42.42.6')(pid=449): Terminating (SIGTERM) 09:21:44.545366 --- ParallelTerminationStrategy: PID 437 died... 09:21:44.565405 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=437): Terminated: ok {rc=0} 09:21:44.609799 --- ParallelTerminationStrategy: PID 438 died... 09:21:44.629269 run iperf3-srv_10.42.42.10(pid=438): Terminated {rc=256} 09:21:44.673440 --- ParallelTerminationStrategy: PID 439 died... 09:21:44.692764 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=439): Terminated: ok {rc=0} 09:21:44.737242 --- ParallelTerminationStrategy: PID 440 died... 09:21:44.756567 run iperf3-srv_10.42.42.10(pid=440): Terminated {rc=256} 09:21:44.800902 --- ParallelTerminationStrategy: PID 443 died... 09:21:44.820430 run pcap-recorder_any(filters='host 10.42.42.2')(pid=443): Terminated: ok {rc=0} 09:21:44.864622 --- ParallelTerminationStrategy: PID 446 died... 09:21:44.884207 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=446): Terminated: ok {rc=0} 09:21:44.928346 --- ParallelTerminationStrategy: PID 449 died... 09:21:44.947946 run pcap-recorder_any(filters='host 10.42.42.6')(pid=449): Terminated: ok {rc=0} 09:21:45.034616 bus /gobi_0: Setting Powered False 09:21:46.138648 bus /gobi_0: Setting Powered False 09:21:47.255493 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2402 gprs:trx-lms-limenet-micro iperf3.py ---------------------------------------------- 09:21:48.400551 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 09:21:48.412377 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 09:21:48.459194 tst iperf3.py: using LAC 39946 09:21:48.577165 tst iperf3.py: using RAC 166 09:21:48.695459 tst iperf3.py: using CellId 39946 09:21:48.814664 tst iperf3.py: using BVCI 39947 09:21:48.924628 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 09:21:48.935625 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 09:21:48.946476 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 09:21:48.956937 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 09:21:48.967357 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 09:21:48.979198 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 09:21:48.990346 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 09:21:49.001334 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 09:21:49.012392 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 09:21:49.131189 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 09:21:49.348921 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:21:49.674144 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=451): Launched 09:21:49.957092 run iperf3-srv_10.42.42.10(pid=452): Launched 09:21:50.078110 tst iperf3.py:8: start network... 09:21:50.296456 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:21:50.798294 run create_hlr_db(pid=453): Launched 09:21:50.930299 bus /gobi_6: Setting Powered False 09:21:51.994317 run create_hlr_db(pid=453): Terminated: ok {rc=0} 09:21:52.424072 run pcap-recorder_any(filters='host 10.42.42.2')(pid=455): Launched 09:21:52.726036 run osmo-hlr_10.42.42.2(pid=456): Launched 09:21:52.840937 run osmo-stp_10.42.42.5: Starting osmo-stp 09:21:53.361112 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=458): Launched 09:21:53.686701 run osmo-stp_10.42.42.5(pid=459): Launched 09:21:53.811288 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:21:54.367795 run pcap-recorder_any(filters='host 10.42.42.6')(pid=461): Launched 09:21:54.491730 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:21:54.765349 run patchelf(pid=462): Launched 09:21:54.944470 run osmo-stp_10.42.42.5(pid=459): ERR: Terminated: ERROR {rc=1} [trial-2402↪gprs:trx-lms-limenet-micro↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=459)] 09:21:55.081091 run osmo-stp_10.42.42.5(pid=459): stdout: | (launched: 2022-12-14_09:21:53.626961) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:21:55.219304 run osmo-stp_10.42.42.5(pid=459): stderr: | 20221214092153815 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214092153815 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214092153815 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214092153816 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214092153816 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214092153816 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214092153816 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:21:55.358816 run osmo-stp_10.42.42.5(pid=459): stdout: | (launched: 2022-12-14_09:21:53.626961) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:21:55.491053 run osmo-stp_10.42.42.5(pid=459): stderr: | 20221214092153815 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214092153815 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214092153815 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214092153816 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214092153816 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214092153816 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214092153816 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:21:55.647999 run patchelf(pid=462): Terminating (SIGINT) 09:21:55.828610 run patchelf(pid=462): Terminated: ok {rc=0} 09:21:55.958538 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=459): Process ended prematurely: osmo-stp_10.42.42.5(pid=459) [trial-2402↪gprs:trx-lms-limenet-micro↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=459)] [trial-2402↪gprs:trx-lms-limenet-micro↪iperf3.py:8] 09:21:55.968666 tst iperf3.py:8: Test FAILED (7.6 sec) 09:21:55.997292 run osmo-hlr_10.42.42.2(pid=456): ERR: Terminated: ERROR {rc=237} [trial-2402↪gprs:trx-lms-limenet-micro↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=456)] 09:21:56.046717 run osmo-hlr_10.42.42.2(pid=456): stdout: | (launched: 2022-12-14_09:21:52.670091) 09:21:56.098038 run osmo-hlr_10.42.42.2(pid=456): stderr: | 20221214092152842 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214092152842 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214092152842 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214092152842 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214092152843 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214092152843 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214092152856 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/gprs:trx-lms-limenet-micro/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214092152866 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214092152867 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214092152867 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:21:56.149848 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=451): Terminating (SIGTERM) 09:21:56.191003 run iperf3-srv_10.42.42.10(pid=452): Terminating (SIGTERM) 09:21:56.232032 run pcap-recorder_any(filters='host 10.42.42.2')(pid=455): Terminating (SIGTERM) 09:21:56.273334 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=458): Terminating (SIGTERM) 09:21:56.314799 run pcap-recorder_any(filters='host 10.42.42.6')(pid=461): Terminating (SIGTERM) 09:21:56.356798 --- ParallelTerminationStrategy: PID 451 died... 09:21:56.376886 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=451): Terminated: ok {rc=0} 09:21:56.423768 --- ParallelTerminationStrategy: PID 452 died... 09:21:56.443477 run iperf3-srv_10.42.42.10(pid=452): Terminated {rc=256} 09:21:56.489483 --- ParallelTerminationStrategy: PID 455 died... 09:21:56.509159 run pcap-recorder_any(filters='host 10.42.42.2')(pid=455): Terminated: ok {rc=0} 09:21:56.555253 --- ParallelTerminationStrategy: PID 458 died... 09:21:56.574908 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=458): Terminated: ok {rc=0} 09:21:56.620913 --- ParallelTerminationStrategy: PID 461 died... 09:21:56.640424 run pcap-recorder_any(filters='host 10.42.42.6')(pid=461): Terminated: ok {rc=0} 09:21:56.727378 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2402 gprs:trx-lms-limenet-micro iperf3m4.py ---------------------------------------------- 09:21:57.877203 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 09:21:57.889168 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 09:21:57.935283 tst iperf3m4.py: using LAC 39947 09:21:58.063832 tst iperf3m4.py: using RAC 167 09:21:58.190630 tst iperf3m4.py: using CellId 39947 09:21:58.322071 tst iperf3m4.py: using BVCI 39948 09:21:58.441218 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 09:21:58.452623 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 09:21:58.463830 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 09:21:58.475035 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 09:21:58.486155 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 09:21:58.497317 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 09:21:58.508541 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 09:21:58.519619 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 09:21:58.530954 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 09:21:58.648168 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 09:21:58.769182 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 09:21:58.885337 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 09:21:59.008432 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 09:21:59.209420 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:21:59.512107 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=463): Launched 09:21:59.775469 run iperf3-srv_10.42.42.10(pid=464): Launched 09:21:59.888273 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 09:22:00.089295 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:22:00.391268 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=465): Launched 09:22:00.653285 run iperf3-srv_10.42.42.10(pid=466): Launched 09:22:00.766579 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 09:22:00.979300 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:22:01.292569 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=467): Launched 09:22:01.572549 run iperf3-srv_10.42.42.10(pid=468): Launched 09:22:01.702616 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 09:22:01.908905 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:22:02.221750 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=469): Launched 09:22:02.510263 run iperf3-srv_10.42.42.10(pid=470): Launched 09:22:02.632940 tst iperf3m4.py:8: start network... 09:22:02.850589 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:22:03.352896 run create_hlr_db(pid=471): Launched 09:22:03.484077 bus /gobi_6: Setting Powered False 09:22:04.547410 run create_hlr_db(pid=471): Terminated: ok {rc=0} 09:22:04.978625 run pcap-recorder_any(filters='host 10.42.42.2')(pid=473): Launched 09:22:05.280387 run osmo-hlr_10.42.42.2(pid=474): Launched 09:22:05.397125 run osmo-stp_10.42.42.5: Starting osmo-stp 09:22:06.045309 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=476): Launched 09:22:06.341849 run osmo-stp_10.42.42.5(pid=477): Launched 09:22:06.454853 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:22:06.966336 run pcap-recorder_any(filters='host 10.42.42.6')(pid=479): Launched 09:22:07.078940 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:22:07.328495 run patchelf(pid=480): Launched 09:22:07.493138 run osmo-stp_10.42.42.5(pid=477): ERR: Terminated: ERROR {rc=1} [trial-2402↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=477)] 09:22:07.618513 run osmo-stp_10.42.42.5(pid=477): stdout: | (launched: 2022-12-14_09:22:06.286446) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:22:07.745401 run osmo-stp_10.42.42.5(pid=477): stderr: | 20221214092206453 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214092206453 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214092206453 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214092206454 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214092206454 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214092206454 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214092206454 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:22:07.873299 run osmo-stp_10.42.42.5(pid=477): stdout: | (launched: 2022-12-14_09:22:06.286446) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:22:07.994490 run osmo-stp_10.42.42.5(pid=477): stderr: | 20221214092206453 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214092206453 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214092206453 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214092206454 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214092206454 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214092206454 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214092206454 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:22:08.138206 run patchelf(pid=480): Terminating (SIGINT) 09:22:08.303581 run patchelf(pid=480): Terminated: ok {rc=0} 09:22:08.423119 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=477): Process ended prematurely: osmo-stp_10.42.42.5(pid=477) [trial-2402↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=477)] [trial-2402↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8] 09:22:08.432495 tst iperf3m4.py:8: Test FAILED (10.6 sec) 09:22:08.460050 run osmo-hlr_10.42.42.2(pid=474): ERR: Terminated: ERROR {rc=237} [trial-2402↪gprs:trx-lms-limenet-micro↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=474)] 09:22:08.508201 run osmo-hlr_10.42.42.2(pid=474): stdout: | (launched: 2022-12-14_09:22:05.224300) 09:22:08.557639 run osmo-hlr_10.42.42.2(pid=474): stderr: | 20221214092205398 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214092205398 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214092205398 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214092205398 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214092205398 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214092205398 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214092205410 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/gprs:trx-lms-limenet-micro/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214092205418 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214092205418 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214092205418 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:22:08.607245 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=463): Terminating (SIGTERM) 09:22:08.646854 run iperf3-srv_10.42.42.10(pid=464): Terminating (SIGTERM) 09:22:08.686542 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=465): Terminating (SIGTERM) 09:22:08.726126 run iperf3-srv_10.42.42.10(pid=466): Terminating (SIGTERM) 09:22:08.765422 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=467): Terminating (SIGTERM) 09:22:08.805359 run iperf3-srv_10.42.42.10(pid=468): Terminating (SIGTERM) 09:22:08.845009 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=469): Terminating (SIGTERM) 09:22:08.884456 run iperf3-srv_10.42.42.10(pid=470): Terminating (SIGTERM) 09:22:08.923783 run pcap-recorder_any(filters='host 10.42.42.2')(pid=473): Terminating (SIGTERM) 09:22:08.963561 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=476): Terminating (SIGTERM) 09:22:09.003030 run pcap-recorder_any(filters='host 10.42.42.6')(pid=479): Terminating (SIGTERM) 09:22:09.042914 --- ParallelTerminationStrategy: PID 463 died... 09:22:09.062460 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=463): Terminated: ok {rc=0} 09:22:09.106352 --- ParallelTerminationStrategy: PID 464 died... 09:22:09.125323 run iperf3-srv_10.42.42.10(pid=464): Terminated {rc=256} 09:22:09.169111 --- ParallelTerminationStrategy: PID 465 died... 09:22:09.187818 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=465): Terminated: ok {rc=0} 09:22:09.231349 --- ParallelTerminationStrategy: PID 466 died... 09:22:09.250361 run iperf3-srv_10.42.42.10(pid=466): Terminated {rc=256} 09:22:09.293845 --- ParallelTerminationStrategy: PID 467 died... 09:22:09.312606 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=467): Terminated: ok {rc=0} 09:22:09.356766 --- ParallelTerminationStrategy: PID 468 died... 09:22:09.376296 run iperf3-srv_10.42.42.10(pid=468): Terminated {rc=256} 09:22:09.420101 --- ParallelTerminationStrategy: PID 469 died... 09:22:09.439002 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=469): Terminated: ok {rc=0} 09:22:09.482662 --- ParallelTerminationStrategy: PID 470 died... 09:22:09.501542 run iperf3-srv_10.42.42.10(pid=470): Terminated {rc=256} 09:22:09.545269 --- ParallelTerminationStrategy: PID 473 died... 09:22:09.564302 run pcap-recorder_any(filters='host 10.42.42.2')(pid=473): Terminated: ok {rc=0} 09:22:09.607838 --- ParallelTerminationStrategy: PID 476 died... 09:22:09.626799 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=476): Terminated: ok {rc=0} 09:22:09.670496 --- ParallelTerminationStrategy: PID 479 died... 09:22:09.689271 run pcap-recorder_any(filters='host 10.42.42.6')(pid=479): Terminated: ok {rc=0} 09:22:09.773888 bus /gobi_4: Setting Powered False 09:22:10.870606 bus /gobi_4: Setting Powered False 09:22:11.984262 bus /gobi_1: Setting Powered False 09:22:13.082744 bus /gobi_1: Setting Powered False 09:22:14.196016 bus /gobi_0: Setting Powered False 09:22:15.292244 bus /gobi_0: Setting Powered False 09:22:16.404337 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2402 gprs:trx-lms-limenet-micro ping.py ---------------------------------------------- 09:22:17.504820 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 09:22:17.516210 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 09:22:17.561660 tst ping.py: using LAC 39948 09:22:17.677421 tst ping.py: using RAC 168 09:22:17.800885 tst ping.py: using CellId 39948 09:22:17.922945 tst ping.py: using BVCI 39949 09:22:18.030924 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 09:22:18.041677 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 09:22:18.052190 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 09:22:18.062673 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 09:22:18.074475 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 09:22:18.085814 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 09:22:18.097449 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 09:22:18.108587 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 09:22:18.226315 tst ping.py:19: start network... 09:22:18.434442 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:22:18.915139 run create_hlr_db(pid=488): Launched 09:22:19.041760 bus /gobi_6: Setting Powered False 09:22:20.103277 run create_hlr_db(pid=488): Terminated: ok {rc=0} 09:22:20.519099 run pcap-recorder_any(filters='host 10.42.42.2')(pid=490): Launched 09:22:20.809706 run osmo-hlr_10.42.42.2(pid=491): Launched 09:22:20.919815 run osmo-stp_10.42.42.5: Starting osmo-stp 09:22:21.456615 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=493): Launched 09:22:21.767492 run osmo-stp_10.42.42.5(pid=494): Launched 09:22:21.884602 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:22:22.418381 run pcap-recorder_any(filters='host 10.42.42.6')(pid=496): Launched 09:22:22.536531 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:22:22.799279 run patchelf(pid=497): Launched 09:22:22.971215 run osmo-stp_10.42.42.5(pid=494): ERR: Terminated: ERROR {rc=1} [trial-2402↪gprs:trx-lms-limenet-micro↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=494)] 09:22:23.102343 run osmo-stp_10.42.42.5(pid=494): stdout: | (launched: 2022-12-14_09:22:21.709751) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:22:23.234931 run osmo-stp_10.42.42.5(pid=494): stderr: | 20221214092221897 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214092221897 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214092221897 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214092221897 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214092221898 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214092221898 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214092221898 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:22:23.367627 run osmo-stp_10.42.42.5(pid=494): stdout: | (launched: 2022-12-14_09:22:21.709751) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:22:23.495008 run osmo-stp_10.42.42.5(pid=494): stderr: | 20221214092221897 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214092221897 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214092221897 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214092221897 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214092221898 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214092221898 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214092221898 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:22:23.645460 run patchelf(pid=497): Terminating (SIGINT) 09:22:23.819147 run patchelf(pid=497): Terminated: ok {rc=0} 09:22:23.943593 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=494): Process ended prematurely: osmo-stp_10.42.42.5(pid=494) [trial-2402↪gprs:trx-lms-limenet-micro↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=494)] [trial-2402↪gprs:trx-lms-limenet-micro↪ping.py:22] 09:22:23.953215 tst ping.py:22: Test FAILED (6.4 sec) 09:22:23.980637 run osmo-hlr_10.42.42.2(pid=491): ERR: Terminated: ERROR {rc=237} [trial-2402↪gprs:trx-lms-limenet-micro↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=491)] 09:22:24.029879 run osmo-hlr_10.42.42.2(pid=491): stdout: | (launched: 2022-12-14_09:22:20.756057) 09:22:24.081288 run osmo-hlr_10.42.42.2(pid=491): stderr: | 20221214092220931 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214092220931 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214092220931 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214092220931 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214092220931 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214092220931 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214092220944 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/gprs:trx-lms-limenet-micro/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214092220952 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214092220952 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214092220952 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:22:24.133041 run pcap-recorder_any(filters='host 10.42.42.2')(pid=490): Terminating (SIGTERM) 09:22:24.174229 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=493): Terminating (SIGTERM) 09:22:24.215269 run pcap-recorder_any(filters='host 10.42.42.6')(pid=496): Terminating (SIGTERM) 09:22:24.256707 --- ParallelTerminationStrategy: PID 490 died... 09:22:24.276518 run pcap-recorder_any(filters='host 10.42.42.2')(pid=490): Terminated: ok {rc=0} 09:22:24.322039 --- ParallelTerminationStrategy: PID 493 died... 09:22:24.341427 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=493): Terminated: ok {rc=0} 09:22:24.386626 --- ParallelTerminationStrategy: PID 496 died... 09:22:24.405790 run pcap-recorder_any(filters='host 10.42.42.6')(pid=496): Terminated: ok {rc=0} 09:22:24.491592 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2402 gprs:trx-lms-limenet-micro ping_idle_ping.py ---------------------------------------------- 09:22:25.577935 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 09:22:25.589929 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 09:22:25.635499 tst ping_idle_ping.py: using LAC 39949 09:22:25.752094 tst ping_idle_ping.py: using RAC 169 09:22:25.866707 tst ping_idle_ping.py: using CellId 39949 09:22:25.980436 tst ping_idle_ping.py: using BVCI 39950 09:22:26.086695 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 09:22:26.097573 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 09:22:26.108239 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 09:22:26.118758 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 09:22:26.129464 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 09:22:26.140652 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 09:22:26.152050 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 09:22:26.162971 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 09:22:26.280667 tst ping_idle_ping.py:24: start network... 09:22:26.490261 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:22:26.975947 run create_hlr_db(pid=498): Launched 09:22:27.103468 bus /gobi_6: Setting Powered False 09:22:28.165364 run create_hlr_db(pid=498): Terminated: ok {rc=0} 09:22:28.583213 run pcap-recorder_any(filters='host 10.42.42.2')(pid=500): Launched 09:22:28.874984 run osmo-hlr_10.42.42.2(pid=501): Launched 09:22:28.985465 run osmo-stp_10.42.42.5: Starting osmo-stp 09:22:29.493031 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=503): Launched 09:22:29.785699 run osmo-stp_10.42.42.5(pid=504): Launched 09:22:29.897268 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:22:30.403465 run pcap-recorder_any(filters='host 10.42.42.6')(pid=506): Launched 09:22:30.515172 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:22:30.762563 run patchelf(pid=507): Launched 09:22:30.946603 run osmo-stp_10.42.42.5(pid=504): ERR: Terminated: ERROR {rc=1} [trial-2402↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=504)] 09:22:31.073109 run osmo-stp_10.42.42.5(pid=504): stdout: | (launched: 2022-12-14_09:22:29.731490) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:22:31.201252 run osmo-stp_10.42.42.5(pid=504): stderr: | 20221214092229897 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214092229897 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214092229897 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214092229898 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214092229898 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214092229898 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214092229898 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:22:31.330332 run osmo-stp_10.42.42.5(pid=504): stdout: | (launched: 2022-12-14_09:22:29.731490) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:22:31.454095 run osmo-stp_10.42.42.5(pid=504): stderr: | 20221214092229897 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214092229897 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214092229897 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214092229898 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214092229898 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214092229898 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214092229898 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:22:31.599845 run patchelf(pid=507): Terminating (SIGINT) 09:22:31.766918 run patchelf(pid=507): Terminated: ok {rc=0} 09:22:31.888351 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=504): Process ended prematurely: osmo-stp_10.42.42.5(pid=504) [trial-2402↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=504)] [trial-2402↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27] 09:22:31.898361 tst ping_idle_ping.py:27: Test FAILED (6.3 sec) 09:22:31.925741 run osmo-hlr_10.42.42.2(pid=501): ERR: Terminated: ERROR {rc=237} [trial-2402↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=501)] 09:22:31.975337 run osmo-hlr_10.42.42.2(pid=501): stdout: | (launched: 2022-12-14_09:22:28.820666) 09:22:32.026137 run osmo-hlr_10.42.42.2(pid=501): stderr: | 20221214092228989 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214092228989 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214092228989 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214092228989 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214092228989 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214092228989 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214092229001 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/gprs:trx-lms-limenet-micro/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214092229009 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214092229010 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214092229010 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:22:32.077330 run pcap-recorder_any(filters='host 10.42.42.2')(pid=500): Terminating (SIGTERM) 09:22:32.118454 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=503): Terminating (SIGTERM) 09:22:32.159050 run pcap-recorder_any(filters='host 10.42.42.6')(pid=506): Terminating (SIGTERM) 09:22:32.199555 --- ParallelTerminationStrategy: PID 500 died... 09:22:32.219934 run pcap-recorder_any(filters='host 10.42.42.2')(pid=500): Terminated: ok {rc=0} 09:22:32.264030 --- ParallelTerminationStrategy: PID 503 died... 09:22:32.282478 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=503): Terminated: ok {rc=0} 09:22:32.325486 --- ParallelTerminationStrategy: PID 506 died... 09:22:32.343933 run pcap-recorder_any(filters='host 10.42.42.6')(pid=506): Terminated: ok {rc=0} 09:22:32.426888 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2402 gprs:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 gprs:trx-lms-limenet-micro+mod-bts0-egprs --------------------------------------------------------------------- 09:22:33.727850 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:22:33.734438 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 09:22:33.764471 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 09:22:33.804478 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 09:22:33.892835 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 09:22:33.922598 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 09:22:33.961661 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 09:22:34.558117 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2402 gprs:trx-lms-limenet-micro+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 09:22:34.608567 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:22:34.619997 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 09:22:34.668300 tst cs_paging_gprs_active.py: using LAC 39950 09:22:34.795715 tst cs_paging_gprs_active.py: using RAC 170 09:22:34.920358 tst cs_paging_gprs_active.py: using CellId 39950 09:22:35.045810 tst cs_paging_gprs_active.py: using BVCI 39951 09:22:35.160777 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:22:35.172417 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:22:35.183761 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:22:35.195127 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:22:35.206413 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:22:35.217776 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:22:35.229241 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:22:35.240534 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:22:35.252104 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:22:35.368783 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:22:35.489172 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 09:22:35.703724 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:22:36.022747 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=511): Launched 09:22:36.302355 run iperf3-srv_10.42.42.10(pid=512): Launched 09:22:36.423346 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 09:22:36.637593 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:22:36.956797 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=513): Launched 09:22:37.232828 run iperf3-srv_10.42.42.10(pid=514): Launched 09:22:37.351362 tst cs_paging_gprs_active.py:38: start network... 09:22:37.564525 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:22:38.057269 run create_hlr_db(pid=515): Launched 09:22:38.185353 bus /gobi_6: Setting Powered False 09:22:39.248147 run create_hlr_db(pid=515): Terminated: ok {rc=0} 09:22:39.674110 run pcap-recorder_any(filters='host 10.42.42.2')(pid=517): Launched 09:22:39.971980 run osmo-hlr_10.42.42.2(pid=518): Launched 09:22:40.085652 run osmo-stp_10.42.42.5: Starting osmo-stp 09:22:40.601953 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=520): Launched 09:22:40.899855 run osmo-stp_10.42.42.5(pid=521): Launched 09:22:41.014246 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:22:41.531881 run pcap-recorder_any(filters='host 10.42.42.6')(pid=523): Launched 09:22:41.645779 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:22:41.898174 run patchelf(pid=524): Launched 09:22:42.065867 run osmo-stp_10.42.42.5(pid=521): ERR: Terminated: ERROR {rc=1} [trial-2402↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=521)] 09:22:42.192063 run osmo-stp_10.42.42.5(pid=521): stdout: | (launched: 2022-12-14_09:22:40.844760) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:22:42.320048 run osmo-stp_10.42.42.5(pid=521): stderr: | 20221214092241009 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214092241009 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214092241009 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214092241010 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214092241010 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214092241010 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214092241010 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:22:42.447707 run osmo-stp_10.42.42.5(pid=521): stdout: | (launched: 2022-12-14_09:22:40.844760) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:22:42.570379 run osmo-stp_10.42.42.5(pid=521): stderr: | 20221214092241009 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214092241009 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214092241009 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214092241010 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214092241010 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214092241010 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214092241010 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:22:42.715305 run patchelf(pid=524): Terminating (SIGINT) 09:22:42.882566 run patchelf(pid=524): Terminated: ok {rc=0} 09:22:43.003442 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=521): Process ended prematurely: osmo-stp_10.42.42.5(pid=521) [trial-2402↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=521)] [trial-2402↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 09:22:43.013000 tst cs_paging_gprs_active.py:38: Test FAILED (8.4 sec) 09:22:43.040330 run osmo-hlr_10.42.42.2(pid=518): ERR: Terminated: ERROR {rc=237} [trial-2402↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=518)] 09:22:43.088595 run osmo-hlr_10.42.42.2(pid=518): stdout: | (launched: 2022-12-14_09:22:39.916444) 09:22:43.138242 run osmo-hlr_10.42.42.2(pid=518): stderr: | 20221214092240088 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214092240088 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214092240088 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214092240088 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214092240088 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214092240088 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214092240100 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/gprs:trx-lms-limenet-micro+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214092240108 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214092240109 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214092240109 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:22:43.188282 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=511): Terminating (SIGTERM) 09:22:43.228032 run iperf3-srv_10.42.42.10(pid=512): Terminating (SIGTERM) 09:22:43.267807 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=513): Terminating (SIGTERM) 09:22:43.307858 run iperf3-srv_10.42.42.10(pid=514): Terminating (SIGTERM) 09:22:43.347514 run pcap-recorder_any(filters='host 10.42.42.2')(pid=517): Terminating (SIGTERM) 09:22:43.387179 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=520): Terminating (SIGTERM) 09:22:43.426934 run pcap-recorder_any(filters='host 10.42.42.6')(pid=523): Terminating (SIGTERM) 09:22:43.466956 --- ParallelTerminationStrategy: PID 511 died... 09:22:43.486243 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=511): Terminated: ok {rc=0} 09:22:43.530179 --- ParallelTerminationStrategy: PID 512 died... 09:22:43.548838 run iperf3-srv_10.42.42.10(pid=512): Terminated {rc=256} 09:22:43.592901 --- ParallelTerminationStrategy: PID 513 died... 09:22:43.612121 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=513): Terminated: ok {rc=0} 09:22:43.656144 --- ParallelTerminationStrategy: PID 514 died... 09:22:43.675060 run iperf3-srv_10.42.42.10(pid=514): Terminated {rc=256} 09:22:43.718776 --- ParallelTerminationStrategy: PID 517 died... 09:22:43.737609 run pcap-recorder_any(filters='host 10.42.42.2')(pid=517): Terminated: ok {rc=0} 09:22:43.781390 --- ParallelTerminationStrategy: PID 520 died... 09:22:43.800035 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=520): Terminated: ok {rc=0} 09:22:43.843982 --- ParallelTerminationStrategy: PID 523 died... 09:22:43.862853 run pcap-recorder_any(filters='host 10.42.42.6')(pid=523): Terminated: ok {rc=0} 09:22:43.948222 bus /gobi_0: Setting Powered False 09:22:45.047417 bus /gobi_0: Setting Powered False 09:22:46.172584 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2402 gprs:trx-lms-limenet-micro+mod-bts0-egprs iperf3.py ---------------------------------------------- 09:22:47.322307 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:22:47.334696 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 09:22:47.382747 tst iperf3.py: using LAC 39951 09:22:47.508500 tst iperf3.py: using RAC 171 09:22:47.626747 tst iperf3.py: using CellId 39951 09:22:47.746955 tst iperf3.py: using BVCI 39952 09:22:47.856804 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:22:47.868050 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:22:47.878839 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:22:47.889680 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:22:47.900712 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:22:47.911888 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:22:47.923054 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:22:47.934092 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:22:47.945398 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:22:48.059932 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 09:22:48.273609 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:22:48.592675 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=525): Launched 09:22:48.868070 run iperf3-srv_10.42.42.10(pid=526): Launched 09:22:48.987100 tst iperf3.py:8: start network... 09:22:49.200339 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:22:49.693222 run create_hlr_db(pid=527): Launched 09:22:49.824604 bus /gobi_6: Setting Powered False 09:22:50.887453 run create_hlr_db(pid=527): Terminated: ok {rc=0} 09:22:51.311045 run pcap-recorder_any(filters='host 10.42.42.2')(pid=529): Launched 09:22:51.608082 run osmo-hlr_10.42.42.2(pid=530): Launched 09:22:51.722672 run osmo-stp_10.42.42.5: Starting osmo-stp 09:22:52.247505 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=532): Launched 09:22:52.544064 run osmo-stp_10.42.42.5(pid=533): Launched 09:22:52.667279 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:22:53.216123 run pcap-recorder_any(filters='host 10.42.42.6')(pid=535): Launched 09:22:53.338181 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:22:53.606922 run patchelf(pid=536): Launched 09:22:53.783287 run osmo-stp_10.42.42.5(pid=533): ERR: Terminated: ERROR {rc=1} [trial-2402↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=533)] 09:22:53.917197 run osmo-stp_10.42.42.5(pid=533): stdout: | (launched: 2022-12-14_09:22:52.489327) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:22:54.052221 run osmo-stp_10.42.42.5(pid=533): stderr: | 20221214092252668 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214092252668 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214092252668 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214092252669 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214092252669 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214092252669 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214092252669 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:22:54.187503 run osmo-stp_10.42.42.5(pid=533): stdout: | (launched: 2022-12-14_09:22:52.489327) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:22:54.317066 run osmo-stp_10.42.42.5(pid=533): stderr: | 20221214092252668 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214092252668 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214092252668 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214092252669 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214092252669 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214092252669 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214092252669 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:22:54.470594 run patchelf(pid=536): Terminating (SIGINT) 09:22:54.646772 run patchelf(pid=536): Terminated: ok {rc=0} 09:22:54.774569 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=533): Process ended prematurely: osmo-stp_10.42.42.5(pid=533) [trial-2402↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=533)] [trial-2402↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8] 09:22:54.784728 tst iperf3.py:8: Test FAILED (7.5 sec) 09:22:54.813082 run osmo-hlr_10.42.42.2(pid=530): ERR: Terminated: ERROR {rc=237} [trial-2402↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=530)] 09:22:54.862920 run osmo-hlr_10.42.42.2(pid=530): stdout: | (launched: 2022-12-14_09:22:51.552825) 09:22:54.914454 run osmo-hlr_10.42.42.2(pid=530): stderr: | 20221214092251725 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214092251725 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214092251726 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214092251726 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214092251726 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214092251726 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214092251738 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/gprs:trx-lms-limenet-micro+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214092251747 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214092251747 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214092251747 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:22:54.966335 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=525): Terminating (SIGTERM) 09:22:55.008174 run iperf3-srv_10.42.42.10(pid=526): Terminating (SIGTERM) 09:22:55.049956 run pcap-recorder_any(filters='host 10.42.42.2')(pid=529): Terminating (SIGTERM) 09:22:55.091565 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=532): Terminating (SIGTERM) 09:22:55.133168 run pcap-recorder_any(filters='host 10.42.42.6')(pid=535): Terminating (SIGTERM) 09:22:55.174963 --- ParallelTerminationStrategy: PID 525 died... 09:22:55.194871 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=525): Terminated: ok {rc=0} 09:22:55.240758 --- ParallelTerminationStrategy: PID 526 died... 09:22:55.260210 run iperf3-srv_10.42.42.10(pid=526): Terminated {rc=256} 09:22:55.305985 --- ParallelTerminationStrategy: PID 529 died... 09:22:55.325582 run pcap-recorder_any(filters='host 10.42.42.2')(pid=529): Terminated: ok {rc=0} 09:22:55.371324 --- ParallelTerminationStrategy: PID 532 died... 09:22:55.390881 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=532): Terminated: ok {rc=0} 09:22:55.436658 --- ParallelTerminationStrategy: PID 535 died... 09:22:55.456221 run pcap-recorder_any(filters='host 10.42.42.6')(pid=535): Terminated: ok {rc=0} 09:22:55.543769 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2402 gprs:trx-lms-limenet-micro+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 09:22:56.692880 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:22:56.705335 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 09:22:56.753310 tst iperf3m4.py: using LAC 39952 09:22:56.872046 tst iperf3m4.py: using RAC 172 09:22:56.991158 tst iperf3m4.py: using CellId 39952 09:22:57.108919 tst iperf3m4.py: using BVCI 39953 09:22:57.218713 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:22:57.229965 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:22:57.240726 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:22:57.251732 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:22:57.262717 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:22:57.273967 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:22:57.285186 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:22:57.296109 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:22:57.307302 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:22:57.434411 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:22:57.549989 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:22:57.668532 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:22:57.786161 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 09:22:57.985166 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:22:58.283599 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=537): Launched 09:22:58.542157 run iperf3-srv_10.42.42.10(pid=538): Launched 09:22:58.653719 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 09:22:58.852782 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:22:59.152096 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=539): Launched 09:22:59.411523 run iperf3-srv_10.42.42.10(pid=540): Launched 09:22:59.523136 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 09:22:59.721583 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:23:00.020808 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=541): Launched 09:23:00.279898 run iperf3-srv_10.42.42.10(pid=542): Launched 09:23:00.391634 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 09:23:00.590602 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:23:00.890189 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=543): Launched 09:23:01.193830 run iperf3-srv_10.42.42.10(pid=544): Launched 09:23:01.328107 tst iperf3m4.py:8: start network... 09:23:01.548085 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:23:02.058209 run create_hlr_db(pid=545): Launched 09:23:02.207910 bus /gobi_6: Setting Powered False 09:23:03.266795 run create_hlr_db(pid=545): Terminated: ok {rc=0} 09:23:03.702548 run pcap-recorder_any(filters='host 10.42.42.2')(pid=547): Launched 09:23:04.021506 run osmo-hlr_10.42.42.2(pid=548): Launched 09:23:04.142603 run osmo-stp_10.42.42.5: Starting osmo-stp 09:23:04.695903 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=550): Launched 09:23:05.014264 run osmo-stp_10.42.42.5(pid=551): Launched 09:23:05.134578 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:23:05.682998 run pcap-recorder_any(filters='host 10.42.42.6')(pid=553): Launched 09:23:05.804557 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:23:06.074075 run patchelf(pid=554): Launched 09:23:06.251372 run osmo-stp_10.42.42.5(pid=551): ERR: Terminated: ERROR {rc=1} [trial-2402↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=551)] 09:23:06.385985 run osmo-stp_10.42.42.5(pid=551): stdout: | (launched: 2022-12-14_09:23:04.955675) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:23:06.521984 run osmo-stp_10.42.42.5(pid=551): stderr: | 20221214092305143 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214092305143 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214092305144 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214092305144 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214092305145 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214092305145 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214092305145 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:23:06.658011 run osmo-stp_10.42.42.5(pid=551): stdout: | (launched: 2022-12-14_09:23:04.955675) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:23:06.788562 run osmo-stp_10.42.42.5(pid=551): stderr: | 20221214092305143 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214092305143 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214092305144 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214092305144 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214092305145 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214092305145 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214092305145 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:23:06.943306 run patchelf(pid=554): Terminating (SIGINT) 09:23:07.119880 run patchelf(pid=554): Terminated: ok {rc=0} 09:23:07.247606 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=551): Process ended prematurely: osmo-stp_10.42.42.5(pid=551) [trial-2402↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=551)] [trial-2402↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8] 09:23:07.258101 tst iperf3m4.py:8: Test FAILED (10.6 sec) 09:23:07.286686 run osmo-hlr_10.42.42.2(pid=548): ERR: Terminated: ERROR {rc=237} [trial-2402↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=548)] 09:23:07.336606 run osmo-hlr_10.42.42.2(pid=548): stdout: | (launched: 2022-12-14_09:23:03.962537) 09:23:07.388434 run osmo-hlr_10.42.42.2(pid=548): stderr: | 20221214092304155 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214092304155 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214092304155 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214092304155 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214092304155 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214092304156 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214092304168 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/gprs:trx-lms-limenet-micro+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214092304176 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214092304177 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214092304177 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:23:07.440755 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=537): Terminating (SIGTERM) 09:23:07.482304 run iperf3-srv_10.42.42.10(pid=538): Terminating (SIGTERM) 09:23:07.523758 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=539): Terminating (SIGTERM) 09:23:07.565314 run iperf3-srv_10.42.42.10(pid=540): Terminating (SIGTERM) 09:23:07.606610 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=541): Terminating (SIGTERM) 09:23:07.648046 run iperf3-srv_10.42.42.10(pid=542): Terminating (SIGTERM) 09:23:07.690530 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=543): Terminating (SIGTERM) 09:23:07.733592 run iperf3-srv_10.42.42.10(pid=544): Terminating (SIGTERM) 09:23:07.774400 run pcap-recorder_any(filters='host 10.42.42.2')(pid=547): Terminating (SIGTERM) 09:23:07.815222 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=550): Terminating (SIGTERM) 09:23:07.855689 run pcap-recorder_any(filters='host 10.42.42.6')(pid=553): Terminating (SIGTERM) 09:23:07.897053 --- ParallelTerminationStrategy: PID 537 died... 09:23:07.916324 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=537): Terminated: ok {rc=0} 09:23:07.960250 --- ParallelTerminationStrategy: PID 538 died... 09:23:07.978927 run iperf3-srv_10.42.42.10(pid=538): Terminated {rc=256} 09:23:08.022729 --- ParallelTerminationStrategy: PID 539 died... 09:23:08.041558 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=539): Terminated: ok {rc=0} 09:23:08.085480 --- ParallelTerminationStrategy: PID 540 died... 09:23:08.104145 run iperf3-srv_10.42.42.10(pid=540): Terminated {rc=256} 09:23:08.147904 --- ParallelTerminationStrategy: PID 541 died... 09:23:08.166808 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=541): Terminated: ok {rc=0} 09:23:08.210698 --- ParallelTerminationStrategy: PID 542 died... 09:23:08.229471 run iperf3-srv_10.42.42.10(pid=542): Terminated {rc=256} 09:23:08.273170 --- ParallelTerminationStrategy: PID 543 died... 09:23:08.291835 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=543): Terminated: ok {rc=0} 09:23:08.335882 --- ParallelTerminationStrategy: PID 544 died... 09:23:08.354725 run iperf3-srv_10.42.42.10(pid=544): Terminated {rc=256} 09:23:08.398454 --- ParallelTerminationStrategy: PID 547 died... 09:23:08.417392 run pcap-recorder_any(filters='host 10.42.42.2')(pid=547): Terminated: ok {rc=0} 09:23:08.461250 --- ParallelTerminationStrategy: PID 550 died... 09:23:08.480076 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=550): Terminated: ok {rc=0} 09:23:08.523982 --- ParallelTerminationStrategy: PID 553 died... 09:23:08.542788 run pcap-recorder_any(filters='host 10.42.42.6')(pid=553): Terminated: ok {rc=0} 09:23:08.628407 bus /gobi_4: Setting Powered False 09:23:09.727933 bus /gobi_4: Setting Powered False 09:23:10.842275 bus /gobi_1: Setting Powered False 09:23:11.940153 bus /gobi_1: Setting Powered False 09:23:13.051469 bus /gobi_0: Setting Powered False 09:23:14.148785 bus /gobi_0: Setting Powered False 09:23:15.264075 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2402 gprs:trx-lms-limenet-micro+mod-bts0-egprs ping.py ---------------------------------------------- 09:23:16.368059 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:23:16.381282 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 09:23:16.430739 tst ping.py: using LAC 39953 09:23:16.559963 tst ping.py: using RAC 173 09:23:16.706827 tst ping.py: using CellId 39953 09:23:16.862427 tst ping.py: using BVCI 39954 09:23:16.978788 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:23:16.991527 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:23:17.003955 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:23:17.016335 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:23:17.028609 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:23:17.040570 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:23:17.052645 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:23:17.064680 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:23:17.184113 tst ping.py:19: start network... 09:23:17.395492 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:23:17.878493 run create_hlr_db(pid=555): Launched 09:23:18.004155 bus /gobi_6: Setting Powered False 09:23:19.066649 run create_hlr_db(pid=555): Terminated: ok {rc=0} 09:23:19.500317 run pcap-recorder_any(filters='host 10.42.42.2')(pid=557): Launched 09:23:19.811208 run osmo-hlr_10.42.42.2(pid=558): Launched 09:23:19.930429 run osmo-stp_10.42.42.5: Starting osmo-stp 09:23:20.475885 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=560): Launched 09:23:20.786972 run osmo-stp_10.42.42.5(pid=561): Launched 09:23:20.904184 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:23:21.440568 run pcap-recorder_any(filters='host 10.42.42.6')(pid=563): Launched 09:23:21.559287 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:23:21.823556 run patchelf(pid=564): Launched 09:23:21.997360 run osmo-stp_10.42.42.5(pid=561): ERR: Terminated: ERROR {rc=1} [trial-2402↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=561)] 09:23:22.129587 run osmo-stp_10.42.42.5(pid=561): stdout: | (launched: 2022-12-14_09:23:20.729014) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:23:22.263301 run osmo-stp_10.42.42.5(pid=561): stderr: | 20221214092320916 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214092320916 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214092320916 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214092320917 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214092320917 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214092320917 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214092320917 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:23:22.398201 run osmo-stp_10.42.42.5(pid=561): stdout: | (launched: 2022-12-14_09:23:20.729014) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:23:22.526531 run osmo-stp_10.42.42.5(pid=561): stderr: | 20221214092320916 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214092320916 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214092320916 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214092320917 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214092320917 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214092320917 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214092320917 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:23:22.678057 run patchelf(pid=564): Terminating (SIGINT) 09:23:22.852511 run patchelf(pid=564): Terminated: ok {rc=0} 09:23:22.978048 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=561): Process ended prematurely: osmo-stp_10.42.42.5(pid=561) [trial-2402↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=561)] [trial-2402↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22] 09:23:22.987624 tst ping.py:22: Test FAILED (6.6 sec) 09:23:23.015472 run osmo-hlr_10.42.42.2(pid=558): ERR: Terminated: ERROR {rc=237} [trial-2402↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=558)] 09:23:23.065063 run osmo-hlr_10.42.42.2(pid=558): stdout: | (launched: 2022-12-14_09:23:19.753663) 09:23:23.116687 run osmo-hlr_10.42.42.2(pid=558): stderr: | 20221214092319946 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214092319946 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214092319946 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214092319946 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214092319946 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214092319947 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214092319958 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/gprs:trx-lms-limenet-micro+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214092319966 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214092319967 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214092319967 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:23:23.168770 run pcap-recorder_any(filters='host 10.42.42.2')(pid=557): Terminating (SIGTERM) 09:23:23.210478 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=560): Terminating (SIGTERM) 09:23:23.251882 run pcap-recorder_any(filters='host 10.42.42.6')(pid=563): Terminating (SIGTERM) 09:23:23.293627 --- ParallelTerminationStrategy: PID 557 died... 09:23:23.313549 run pcap-recorder_any(filters='host 10.42.42.2')(pid=557): Terminated: ok {rc=0} 09:23:23.359480 --- ParallelTerminationStrategy: PID 560 died... 09:23:23.378977 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=560): Terminated: ok {rc=0} 09:23:23.424639 --- ParallelTerminationStrategy: PID 563 died... 09:23:23.444127 run pcap-recorder_any(filters='host 10.42.42.6')(pid=563): Terminated: ok {rc=0} 09:23:23.530817 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2402 gprs:trx-lms-limenet-micro+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 09:23:24.616548 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:23:24.628761 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 09:23:24.678218 tst ping_idle_ping.py: using LAC 39954 09:23:24.802023 tst ping_idle_ping.py: using RAC 174 09:23:24.925053 tst ping_idle_ping.py: using CellId 39954 09:23:25.047950 tst ping_idle_ping.py: using BVCI 39955 09:23:25.162287 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:23:25.173901 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:23:25.185180 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:23:25.196406 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:23:25.207861 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:23:25.219084 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:23:25.230584 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:23:25.242131 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:23:25.360058 tst ping_idle_ping.py:24: start network... 09:23:25.569467 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:23:26.056600 run create_hlr_db(pid=565): Launched 09:23:26.185445 bus /gobi_6: Setting Powered False 09:23:27.247905 run create_hlr_db(pid=565): Terminated: ok {rc=0} 09:23:27.668754 run pcap-recorder_any(filters='host 10.42.42.2')(pid=567): Launched 09:23:27.960602 run osmo-hlr_10.42.42.2(pid=568): Launched 09:23:28.071306 run osmo-stp_10.42.42.5: Starting osmo-stp 09:23:28.586696 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=570): Launched 09:23:28.880786 run osmo-stp_10.42.42.5(pid=571): Launched 09:23:28.992443 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:23:29.497397 run pcap-recorder_any(filters='host 10.42.42.6')(pid=573): Launched 09:23:29.609897 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:23:29.857246 run patchelf(pid=574): Launched 09:23:30.019911 run osmo-stp_10.42.42.5(pid=571): ERR: Terminated: ERROR {rc=1} [trial-2402↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=571)] 09:23:30.143974 run osmo-stp_10.42.42.5(pid=571): stdout: | (launched: 2022-12-14_09:23:28.826652) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:23:30.269082 run osmo-stp_10.42.42.5(pid=571): stderr: | 20221214092328991 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214092328991 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214092328991 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214092328992 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214092328992 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214092328992 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214092328992 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:23:30.394402 run osmo-stp_10.42.42.5(pid=571): stdout: | (launched: 2022-12-14_09:23:28.826652) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:23:30.514492 run osmo-stp_10.42.42.5(pid=571): stderr: | 20221214092328991 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214092328991 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214092328991 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214092328992 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214092328992 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214092328992 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214092328992 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:23:30.656587 run patchelf(pid=574): Terminating (SIGINT) 09:23:30.820098 run patchelf(pid=574): Terminated: ok {rc=0} 09:23:30.965454 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=571): Process ended prematurely: osmo-stp_10.42.42.5(pid=571) [trial-2402↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=571)] [trial-2402↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27] 09:23:30.976022 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 09:23:31.005673 run osmo-hlr_10.42.42.2(pid=568): ERR: Terminated: ERROR {rc=237} [trial-2402↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=568)] 09:23:31.057338 run osmo-hlr_10.42.42.2(pid=568): stdout: | (launched: 2022-12-14_09:23:27.906537) 09:23:31.112124 run osmo-hlr_10.42.42.2(pid=568): stderr: | 20221214092328079 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214092328080 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214092328080 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214092328080 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214092328080 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214092328080 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214092328092 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/gprs:trx-lms-limenet-micro+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214092328100 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214092328100 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214092328100 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:23:31.167482 run pcap-recorder_any(filters='host 10.42.42.2')(pid=567): Terminating (SIGTERM) 09:23:31.211016 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=570): Terminating (SIGTERM) 09:23:31.255732 run pcap-recorder_any(filters='host 10.42.42.6')(pid=573): Terminating (SIGTERM) 09:23:31.301778 --- ParallelTerminationStrategy: PID 567 died... 09:23:31.322554 run pcap-recorder_any(filters='host 10.42.42.2')(pid=567): Terminated: ok {rc=0} 09:23:31.371720 --- ParallelTerminationStrategy: PID 570 died... 09:23:31.392449 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=570): Terminated: ok {rc=0} 09:23:31.440739 --- ParallelTerminationStrategy: PID 573 died... 09:23:31.461215 run pcap-recorder_any(filters='host 10.42.42.6')(pid=573): Terminated: ok {rc=0} 09:23:31.552688 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2402 gprs:trx-lms-limenet-micro+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa --------------------------------------------------------------------- 09:23:32.853246 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:23:32.859242 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 09:23:32.887792 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 09:23:32.927623 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 09:23:33.013319 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 09:23:33.041809 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 09:23:33.080524 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 09:23:33.677943 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2402 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 09:23:33.726668 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:23:33.737759 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 09:23:33.802193 tst cs_paging_gprs_active.py: using LAC 39955 09:23:33.928722 tst cs_paging_gprs_active.py: using RAC 175 09:23:34.052364 tst cs_paging_gprs_active.py: using CellId 39955 09:23:34.176772 tst cs_paging_gprs_active.py: using BVCI 39956 09:23:34.292766 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:23:34.304544 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:23:34.316127 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:23:34.327396 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:23:34.338880 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:23:34.350523 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:23:34.362117 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:23:34.373567 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:23:34.385235 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:23:34.501849 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:23:34.622687 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 09:23:34.838496 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:23:35.159522 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=579): Launched 09:23:35.437814 run iperf3-srv_10.42.42.10(pid=580): Launched 09:23:35.559007 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 09:23:35.774463 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:23:36.096075 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=581): Launched 09:23:36.374042 run iperf3-srv_10.42.42.10(pid=582): Launched 09:23:36.493540 tst cs_paging_gprs_active.py:38: start network... 09:23:36.708415 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:23:37.206541 run create_hlr_db(pid=583): Launched 09:23:37.338072 bus /gobi_6: Setting Powered False 09:23:38.401559 run create_hlr_db(pid=583): Terminated: ok {rc=0} 09:23:38.828602 run pcap-recorder_any(filters='host 10.42.42.2')(pid=585): Launched 09:23:39.128911 run osmo-hlr_10.42.42.2(pid=586): Launched 09:23:39.243013 run osmo-stp_10.42.42.5: Starting osmo-stp 09:23:39.767655 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=588): Launched 09:23:40.066105 run osmo-stp_10.42.42.5(pid=589): Launched 09:23:40.180399 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:23:40.695918 run pcap-recorder_any(filters='host 10.42.42.6')(pid=591): Launched 09:23:40.809573 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:23:41.061947 run patchelf(pid=592): Launched 09:23:41.227301 run osmo-stp_10.42.42.5(pid=589): ERR: Terminated: ERROR {rc=1} [trial-2402↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=589)] 09:23:41.353749 run osmo-stp_10.42.42.5(pid=589): stdout: | (launched: 2022-12-14_09:23:40.010882) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:23:41.481878 run osmo-stp_10.42.42.5(pid=589): stderr: | 20221214092340178 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214092340178 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214092340178 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214092340179 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214092340179 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214092340179 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214092340179 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:23:41.610126 run osmo-stp_10.42.42.5(pid=589): stdout: | (launched: 2022-12-14_09:23:40.010882) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:23:41.732767 run osmo-stp_10.42.42.5(pid=589): stderr: | 20221214092340178 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214092340178 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214092340178 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214092340179 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214092340179 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214092340179 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214092340179 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:23:41.878295 run patchelf(pid=592): Terminating (SIGINT) 09:23:42.045579 run patchelf(pid=592): Terminated: ok {rc=0} 09:23:42.166981 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=589): Process ended prematurely: osmo-stp_10.42.42.5(pid=589) [trial-2402↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=589)] [trial-2402↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 09:23:42.176532 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 09:23:42.203474 run osmo-hlr_10.42.42.2(pid=586): ERR: Terminated: ERROR {rc=237} [trial-2402↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=586)] 09:23:42.251273 run osmo-hlr_10.42.42.2(pid=586): stdout: | (launched: 2022-12-14_09:23:39.073574) 09:23:42.300233 run osmo-hlr_10.42.42.2(pid=586): stderr: | 20221214092339244 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214092339244 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214092339244 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214092339244 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214092339245 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214092339245 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214092339256 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214092339264 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214092339264 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214092339265 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:23:42.350015 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=579): Terminating (SIGTERM) 09:23:42.389331 run iperf3-srv_10.42.42.10(pid=580): Terminating (SIGTERM) 09:23:42.428618 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=581): Terminating (SIGTERM) 09:23:42.467878 run iperf3-srv_10.42.42.10(pid=582): Terminating (SIGTERM) 09:23:42.507046 run pcap-recorder_any(filters='host 10.42.42.2')(pid=585): Terminating (SIGTERM) 09:23:42.546421 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=588): Terminating (SIGTERM) 09:23:42.585603 run pcap-recorder_any(filters='host 10.42.42.6')(pid=591): Terminating (SIGTERM) 09:23:42.625197 --- ParallelTerminationStrategy: PID 579 died... 09:23:42.644308 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=579): Terminated: ok {rc=0} 09:23:42.687957 --- ParallelTerminationStrategy: PID 580 died... 09:23:42.706601 run iperf3-srv_10.42.42.10(pid=580): Terminated {rc=256} 09:23:42.749972 --- ParallelTerminationStrategy: PID 581 died... 09:23:42.768662 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=581): Terminated: ok {rc=0} 09:23:42.811949 --- ParallelTerminationStrategy: PID 582 died... 09:23:42.830591 run iperf3-srv_10.42.42.10(pid=582): Terminated {rc=256} 09:23:42.873978 --- ParallelTerminationStrategy: PID 585 died... 09:23:42.892752 run pcap-recorder_any(filters='host 10.42.42.2')(pid=585): Terminated: ok {rc=0} 09:23:42.936348 --- ParallelTerminationStrategy: PID 588 died... 09:23:42.955256 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=588): Terminated: ok {rc=0} 09:23:42.998659 --- ParallelTerminationStrategy: PID 591 died... 09:23:43.017428 run pcap-recorder_any(filters='host 10.42.42.6')(pid=591): Terminated: ok {rc=0} 09:23:43.102788 bus /gobi_0: Setting Powered False 09:23:44.200712 bus /gobi_0: Setting Powered False 09:23:45.314689 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2402 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 09:23:46.486032 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:23:46.501272 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 09:23:46.589339 tst iperf3.py: using LAC 39956 09:23:46.718285 tst iperf3.py: using RAC 176 09:23:46.883481 tst iperf3.py: using CellId 39956 09:23:47.035676 tst iperf3.py: using BVCI 39957 09:23:47.148602 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:23:47.161001 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:23:47.173159 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:23:47.185186 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:23:47.198554 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:23:47.211683 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:23:47.224836 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:23:47.237572 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:23:47.250563 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:23:47.371449 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 09:23:47.585662 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:23:47.906131 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=593): Launched 09:23:48.186010 run iperf3-srv_10.42.42.10(pid=594): Launched 09:23:48.306576 tst iperf3.py:8: start network... 09:23:48.521019 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:23:49.015708 run create_hlr_db(pid=595): Launched 09:23:49.146062 bus /gobi_6: Setting Powered False 09:23:50.210044 run create_hlr_db(pid=595): Terminated: ok {rc=0} 09:23:50.634791 run pcap-recorder_any(filters='host 10.42.42.2')(pid=597): Launched 09:23:50.933441 run osmo-hlr_10.42.42.2(pid=598): Launched 09:23:51.046960 run osmo-stp_10.42.42.5: Starting osmo-stp 09:23:51.577251 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=600): Launched 09:23:51.874499 run osmo-stp_10.42.42.5(pid=601): Launched 09:23:51.988209 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:23:52.504230 run pcap-recorder_any(filters='host 10.42.42.6')(pid=603): Launched 09:23:52.617769 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:23:52.869463 run patchelf(pid=604): Launched 09:23:53.034400 run osmo-stp_10.42.42.5(pid=601): ERR: Terminated: ERROR {rc=1} [trial-2402↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=601)] 09:23:53.160459 run osmo-stp_10.42.42.5(pid=601): stdout: | (launched: 2022-12-14_09:23:51.819520) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:23:53.288316 run osmo-stp_10.42.42.5(pid=601): stderr: | 20221214092351984 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214092351984 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214092351984 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214092351985 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214092351985 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214092351985 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214092351985 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:23:53.416335 run osmo-stp_10.42.42.5(pid=601): stdout: | (launched: 2022-12-14_09:23:51.819520) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:23:53.538559 run osmo-stp_10.42.42.5(pid=601): stderr: | 20221214092351984 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214092351984 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214092351984 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214092351985 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214092351985 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214092351985 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214092351985 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:23:53.682805 run patchelf(pid=604): Terminating (SIGINT) 09:23:53.849762 run patchelf(pid=604): Terminated: ok {rc=0} 09:23:53.970169 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=601): Process ended prematurely: osmo-stp_10.42.42.5(pid=601) [trial-2402↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=601)] [trial-2402↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8] 09:23:53.979644 tst iperf3.py:8: Test FAILED (7.5 sec) 09:23:54.006513 run osmo-hlr_10.42.42.2(pid=598): ERR: Terminated: ERROR {rc=237} [trial-2402↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=598)] 09:23:54.054048 run osmo-hlr_10.42.42.2(pid=598): stdout: | (launched: 2022-12-14_09:23:50.877934) 09:23:54.103291 run osmo-hlr_10.42.42.2(pid=598): stderr: | 20221214092351048 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214092351048 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214092351048 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214092351048 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214092351048 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214092351048 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214092351060 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214092351071 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214092351072 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214092351072 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:23:54.153258 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=593): Terminating (SIGTERM) 09:23:54.193446 run iperf3-srv_10.42.42.10(pid=594): Terminating (SIGTERM) 09:23:54.234611 run pcap-recorder_any(filters='host 10.42.42.2')(pid=597): Terminating (SIGTERM) 09:23:54.274565 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=600): Terminating (SIGTERM) 09:23:54.314067 run pcap-recorder_any(filters='host 10.42.42.6')(pid=603): Terminating (SIGTERM) 09:23:54.353802 --- ParallelTerminationStrategy: PID 593 died... 09:23:54.373141 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=593): Terminated: ok {rc=0} 09:23:54.416746 --- ParallelTerminationStrategy: PID 594 died... 09:23:54.435489 run iperf3-srv_10.42.42.10(pid=594): Terminated {rc=256} 09:23:54.478980 --- ParallelTerminationStrategy: PID 597 died... 09:23:54.497918 run pcap-recorder_any(filters='host 10.42.42.2')(pid=597): Terminated: ok {rc=0} 09:23:54.541407 --- ParallelTerminationStrategy: PID 600 died... 09:23:54.560126 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=600): Terminated: ok {rc=0} 09:23:54.603468 --- ParallelTerminationStrategy: PID 603 died... 09:23:54.621999 run pcap-recorder_any(filters='host 10.42.42.6')(pid=603): Terminated: ok {rc=0} 09:23:54.707282 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2402 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 09:23:55.852115 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:23:55.864078 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 09:23:55.931128 tst iperf3m4.py: using LAC 39957 09:23:56.062176 tst iperf3m4.py: using RAC 177 09:23:56.186489 tst iperf3m4.py: using CellId 39957 09:23:56.310666 tst iperf3m4.py: using BVCI 39958 09:23:56.428127 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:23:56.439968 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:23:56.451494 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:23:56.462967 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:23:56.474366 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:23:56.485957 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:23:56.497492 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:23:56.508754 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:23:56.520451 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:23:56.634613 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:23:56.751515 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:23:56.870398 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:23:56.986654 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 09:23:57.197172 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:23:57.515393 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=605): Launched 09:23:57.792774 run iperf3-srv_10.42.42.10(pid=606): Launched 09:23:57.911782 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 09:23:58.126315 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:23:58.445979 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=607): Launched 09:23:58.724126 run iperf3-srv_10.42.42.10(pid=608): Launched 09:23:58.843581 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 09:23:59.056746 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:23:59.375694 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=609): Launched 09:23:59.654126 run iperf3-srv_10.42.42.10(pid=610): Launched 09:23:59.773209 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 09:23:59.987097 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:24:00.306921 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=611): Launched 09:24:00.583641 run iperf3-srv_10.42.42.10(pid=612): Launched 09:24:00.702811 tst iperf3m4.py:8: start network... 09:24:00.924543 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:24:01.409682 run create_hlr_db(pid=613): Launched 09:24:01.571927 bus /gobi_6: Setting Powered False 09:24:02.658982 run create_hlr_db(pid=613): Terminated: ok {rc=0} 09:24:03.166095 run pcap-recorder_any(filters='host 10.42.42.2')(pid=765): Launched 09:24:03.561859 run osmo-hlr_10.42.42.2(pid=811): Launched 09:24:03.763845 run osmo-stp_10.42.42.5: Starting osmo-stp 09:24:04.529719 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=909): Launched 09:24:04.849986 run osmo-stp_10.42.42.5(pid=910): Launched 09:24:05.096228 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:24:05.732264 run pcap-recorder_any(filters='host 10.42.42.6')(pid=912): Launched 09:24:05.867504 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:24:06.142713 run patchelf(pid=914): Launched 09:24:06.332504 run osmo-stp_10.42.42.5(pid=910): ERR: Terminated: ERROR {rc=1} [trial-2402↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=910)] 09:24:06.464374 run osmo-stp_10.42.42.5(pid=910): stdout: | (launched: 2022-12-14_09:24:04.792346) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:24:06.598543 run osmo-stp_10.42.42.5(pid=910): stderr: | 20221214092405083 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214092405083 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214092405083 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214092405083 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214092405084 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214092405084 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214092405084 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:24:06.733730 run osmo-stp_10.42.42.5(pid=910): stdout: | (launched: 2022-12-14_09:24:04.792346) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:24:06.863531 run osmo-stp_10.42.42.5(pid=910): stderr: | 20221214092405083 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214092405083 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214092405083 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214092405083 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214092405084 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214092405084 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214092405084 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:24:07.016194 run patchelf(pid=914): Terminating (SIGINT) 09:24:07.190210 run patchelf(pid=914): Terminated: ok {rc=0} 09:24:07.316693 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=910): Process ended prematurely: osmo-stp_10.42.42.5(pid=910) [trial-2402↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=910)] [trial-2402↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8] 09:24:07.327687 tst iperf3m4.py:8: Test FAILED (11.5 sec) 09:24:07.356648 run osmo-hlr_10.42.42.2(pid=811): ERR: Terminated: ERROR {rc=237} [trial-2402↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=811)] 09:24:07.407978 run osmo-hlr_10.42.42.2(pid=811): stdout: | (launched: 2022-12-14_09:24:03.493599) 09:24:07.460737 run osmo-hlr_10.42.42.2(pid=811): stderr: | 20221214092403820 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214092403820 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214092403820 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214092403830 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214092403830 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214092403830 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214092403844 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214092403866 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214092403866 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214092403866 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:24:07.516670 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=605): Terminating (SIGTERM) 09:24:07.558738 run iperf3-srv_10.42.42.10(pid=606): Terminating (SIGTERM) 09:24:07.604730 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=607): Terminating (SIGTERM) 09:24:07.647858 run iperf3-srv_10.42.42.10(pid=608): Terminating (SIGTERM) 09:24:07.694449 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=609): Terminating (SIGTERM) 09:24:07.738420 run iperf3-srv_10.42.42.10(pid=610): Terminating (SIGTERM) 09:24:07.784266 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=611): Terminating (SIGTERM) 09:24:07.827565 run iperf3-srv_10.42.42.10(pid=612): Terminating (SIGTERM) 09:24:07.872504 run pcap-recorder_any(filters='host 10.42.42.2')(pid=765): Terminating (SIGTERM) 09:24:07.916417 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=909): Terminating (SIGTERM) 09:24:07.960608 run pcap-recorder_any(filters='host 10.42.42.6')(pid=912): Terminating (SIGTERM) 09:24:08.004710 --- ParallelTerminationStrategy: PID 605 died... 09:24:08.025890 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=605): Terminated: ok {rc=0} 09:24:08.072099 --- ParallelTerminationStrategy: PID 606 died... 09:24:08.094108 run iperf3-srv_10.42.42.10(pid=606): Terminated {rc=256} 09:24:08.140301 --- ParallelTerminationStrategy: PID 607 died... 09:24:08.161252 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=607): Terminated: ok {rc=0} 09:24:08.207641 --- ParallelTerminationStrategy: PID 608 died... 09:24:08.228710 run iperf3-srv_10.42.42.10(pid=608): Terminated {rc=256} 09:24:08.274784 --- ParallelTerminationStrategy: PID 609 died... 09:24:08.296262 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=609): Terminated: ok {rc=0} 09:24:08.342852 --- ParallelTerminationStrategy: PID 610 died... 09:24:08.363873 run iperf3-srv_10.42.42.10(pid=610): Terminated {rc=256} 09:24:08.411441 --- ParallelTerminationStrategy: PID 611 died... 09:24:08.432289 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=611): Terminated: ok {rc=0} 09:24:08.480922 --- ParallelTerminationStrategy: PID 612 died... 09:24:08.501597 run iperf3-srv_10.42.42.10(pid=612): Terminated {rc=256} 09:24:08.548306 --- ParallelTerminationStrategy: PID 765 died... 09:24:08.569554 run pcap-recorder_any(filters='host 10.42.42.2')(pid=765): Terminated: ok {rc=0} 09:24:08.615989 --- ParallelTerminationStrategy: PID 909 died... 09:24:08.636790 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=909): Terminated: ok {rc=0} 09:24:08.684522 --- ParallelTerminationStrategy: PID 912 died... 09:24:08.705970 run pcap-recorder_any(filters='host 10.42.42.6')(pid=912): Terminated: ok {rc=0} 09:24:08.794787 bus /gobi_4: Setting Powered False 09:24:09.893904 bus /gobi_4: Setting Powered False 09:24:11.010720 bus /gobi_1: Setting Powered False 09:24:12.112203 bus /gobi_1: Setting Powered False 09:24:13.233221 bus /gobi_0: Setting Powered False 09:24:14.338872 bus /gobi_0: Setting Powered False 09:24:15.461537 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2402 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 09:24:16.592291 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:24:16.611305 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 09:24:16.712294 tst ping.py: using LAC 39958 09:24:16.874738 tst ping.py: using RAC 178 09:24:17.036213 tst ping.py: using CellId 39958 09:24:17.177687 tst ping.py: using BVCI 39959 09:24:17.343033 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:24:17.359342 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:24:17.376088 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:24:17.389885 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:24:17.403751 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:24:17.416257 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:24:17.429818 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:24:17.442306 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:24:17.569234 tst ping.py:19: start network... 09:24:17.789825 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:24:18.293118 run create_hlr_db(pid=916): Launched 09:24:18.457560 bus /gobi_6: Setting Powered False 09:24:19.522698 run create_hlr_db(pid=916): Terminated: ok {rc=0} 09:24:19.977289 run pcap-recorder_any(filters='host 10.42.42.2')(pid=918): Launched 09:24:20.312356 run osmo-hlr_10.42.42.2(pid=919): Launched 09:24:20.559651 run osmo-stp_10.42.42.5: Starting osmo-stp 09:24:21.219165 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=921): Launched 09:24:21.554543 run osmo-stp_10.42.42.5(pid=922): Launched 09:24:21.796027 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:24:22.434778 run pcap-recorder_any(filters='host 10.42.42.6')(pid=924): Launched 09:24:22.571914 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:24:22.848486 run patchelf(pid=925): Launched 09:24:23.043955 run osmo-stp_10.42.42.5(pid=922): ERR: Terminated: ERROR {rc=1} [trial-2402↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=922)] 09:24:23.183029 run osmo-stp_10.42.42.5(pid=922): stdout: | (launched: 2022-12-14_09:24:21.495490) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:24:23.324306 run osmo-stp_10.42.42.5(pid=922): stderr: | 20221214092421782 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214092421782 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214092421782 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214092421783 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214092421783 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214092421783 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214092421783 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:24:23.464145 run osmo-stp_10.42.42.5(pid=922): stdout: | (launched: 2022-12-14_09:24:21.495490) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:24:23.602310 run osmo-stp_10.42.42.5(pid=922): stderr: | 20221214092421782 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214092421782 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214092421782 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214092421783 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214092421783 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214092421783 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214092421783 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:24:23.765414 run patchelf(pid=925): Terminating (SIGINT) 09:24:23.948672 run patchelf(pid=925): Terminated: ok {rc=0} 09:24:24.080839 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=922): Process ended prematurely: osmo-stp_10.42.42.5(pid=922) [trial-2402↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=922)] [trial-2402↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22] 09:24:24.092083 tst ping.py:22: Test FAILED (7.5 sec) 09:24:24.121718 run osmo-hlr_10.42.42.2(pid=919): ERR: Terminated: ERROR {rc=237} [trial-2402↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=919)] 09:24:24.173595 run osmo-hlr_10.42.42.2(pid=919): stdout: | (launched: 2022-12-14_09:24:20.252486) 09:24:24.227251 run osmo-hlr_10.42.42.2(pid=919): stderr: | 20221214092420555 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214092420555 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214092420555 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214092420555 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214092420555 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214092420555 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214092420574 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214092420593 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214092420593 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214092420593 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:24:24.283017 run pcap-recorder_any(filters='host 10.42.42.2')(pid=918): Terminating (SIGTERM) 09:24:24.326448 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=921): Terminating (SIGTERM) 09:24:24.372770 run pcap-recorder_any(filters='host 10.42.42.6')(pid=924): Terminating (SIGTERM) 09:24:24.418496 --- ParallelTerminationStrategy: PID 918 died... 09:24:24.440300 run pcap-recorder_any(filters='host 10.42.42.2')(pid=918): Terminated: ok {rc=0} 09:24:24.492185 --- ParallelTerminationStrategy: PID 921 died... 09:24:24.513149 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=921): Terminated: ok {rc=0} 09:24:24.561963 --- ParallelTerminationStrategy: PID 924 died... 09:24:24.582844 run pcap-recorder_any(filters='host 10.42.42.6')(pid=924): Terminated: ok {rc=0} 09:24:24.674264 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2402 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 09:24:25.765676 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:24:25.778451 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 09:24:25.847834 tst ping_idle_ping.py: using LAC 39959 09:24:25.966392 tst ping_idle_ping.py: using RAC 179 09:24:26.085910 tst ping_idle_ping.py: using CellId 39959 09:24:26.210951 tst ping_idle_ping.py: using BVCI 39960 09:24:26.328900 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:24:26.340520 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:24:26.351988 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:24:26.363434 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:24:26.374787 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:24:26.386184 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:24:26.397669 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:24:26.409051 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:24:26.524746 tst ping_idle_ping.py:24: start network... 09:24:26.722405 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:24:27.183822 run create_hlr_db(pid=926): Launched 09:24:27.297992 bus /gobi_6: Setting Powered False 09:24:28.357540 run create_hlr_db(pid=926): Terminated: ok {rc=0} 09:24:28.792710 run pcap-recorder_any(filters='host 10.42.42.2')(pid=928): Launched 09:24:29.110756 run osmo-hlr_10.42.42.2(pid=929): Launched 09:24:29.232432 run osmo-stp_10.42.42.5: Starting osmo-stp 09:24:29.779486 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=931): Launched 09:24:30.098535 run osmo-stp_10.42.42.5(pid=932): Launched 09:24:30.221056 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:24:30.768744 run pcap-recorder_any(filters='host 10.42.42.6')(pid=935): Launched 09:24:30.909167 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:24:31.185425 run patchelf(pid=936): Launched 09:24:31.376724 run osmo-stp_10.42.42.5(pid=932): ERR: Terminated: ERROR {rc=1} [trial-2402↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=932)] 09:24:31.513335 run osmo-stp_10.42.42.5(pid=932): stdout: | (launched: 2022-12-14_09:24:30.039971) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:24:31.650952 run osmo-stp_10.42.42.5(pid=932): stderr: | 20221214092430228 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214092430228 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214092430228 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214092430229 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214092430229 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214092430229 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214092430229 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:24:31.788802 run osmo-stp_10.42.42.5(pid=932): stdout: | (launched: 2022-12-14_09:24:30.039971) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:24:31.922338 run osmo-stp_10.42.42.5(pid=932): stderr: | 20221214092430228 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214092430228 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214092430228 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214092430229 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214092430229 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214092430229 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214092430229 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:24:32.078893 run patchelf(pid=936): Terminating (SIGINT) 09:24:32.256783 run patchelf(pid=936): Terminated: ok {rc=0} 09:24:32.384173 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=932): Process ended prematurely: osmo-stp_10.42.42.5(pid=932) [trial-2402↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=932)] [trial-2402↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 09:24:32.394007 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 09:24:32.422026 run osmo-hlr_10.42.42.2(pid=929): ERR: Terminated: ERROR {rc=237} [trial-2402↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=929)] 09:24:32.472244 run osmo-hlr_10.42.42.2(pid=929): stdout: | (launched: 2022-12-14_09:24:29.051906) 09:24:32.524601 run osmo-hlr_10.42.42.2(pid=929): stderr: | 20221214092429245 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214092429245 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214092429245 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214092429245 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214092429245 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214092429245 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214092429258 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214092429266 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214092429266 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214092429266 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:24:32.577191 run pcap-recorder_any(filters='host 10.42.42.2')(pid=928): Terminating (SIGTERM) 09:24:32.618400 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=931): Terminating (SIGTERM) 09:24:32.659709 run pcap-recorder_any(filters='host 10.42.42.6')(pid=935): Terminating (SIGTERM) 09:24:32.701302 --- ParallelTerminationStrategy: PID 928 died... 09:24:32.721345 run pcap-recorder_any(filters='host 10.42.42.2')(pid=928): Terminated: ok {rc=0} 09:24:32.767402 --- ParallelTerminationStrategy: PID 931 died... 09:24:32.786960 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=931): Terminated: ok {rc=0} 09:24:32.833200 --- ParallelTerminationStrategy: PID 935 died... 09:24:32.852651 run pcap-recorder_any(filters='host 10.42.42.6')(pid=935): Terminated: ok {rc=0} 09:24:32.940880 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2402 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo --------------------------------------------------------------------- 09:24:34.248515 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:24:34.256115 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 09:24:34.285784 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 09:24:34.323948 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 09:24:34.413266 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 09:24:34.442685 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 09:24:34.480491 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 09:24:35.074725 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2402 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 09:24:35.123243 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:24:35.134292 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 09:24:35.202772 tst cs_paging_gprs_active.py: using LAC 39960 09:24:35.320663 tst cs_paging_gprs_active.py: using RAC 180 09:24:35.437388 tst cs_paging_gprs_active.py: using CellId 39960 09:24:35.555869 tst cs_paging_gprs_active.py: using BVCI 39961 09:24:35.664768 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:24:35.675923 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:24:35.686770 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:24:35.697663 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:24:35.708997 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:24:35.720213 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:24:35.731560 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:24:35.742750 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:24:35.754131 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 09:24:35.875475 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 09:24:35.997123 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 09:24:36.214445 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:24:36.538639 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=941): Launched 09:24:36.819862 run iperf3-srv_10.42.42.10(pid=942): Launched 09:24:36.942307 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 09:24:37.158776 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:24:37.482964 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=943): Launched 09:24:37.764237 run iperf3-srv_10.42.42.10(pid=944): Launched 09:24:37.886304 tst cs_paging_gprs_active.py:38: start network... 09:24:38.102984 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:24:38.603046 run create_hlr_db(pid=945): Launched 09:24:38.734599 bus /gobi_6: Setting Powered False 09:24:39.798614 run create_hlr_db(pid=945): Terminated: ok {rc=0} 09:24:40.228865 run pcap-recorder_any(filters='host 10.42.42.2')(pid=947): Launched 09:24:40.531111 run osmo-hlr_10.42.42.2(pid=948): Launched 09:24:40.649137 run osmo-stp_10.42.42.5: Starting osmo-stp 09:24:41.180334 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=950): Launched 09:24:41.482544 run osmo-stp_10.42.42.5(pid=951): Launched 09:24:41.599720 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:24:42.121266 run pcap-recorder_any(filters='host 10.42.42.6')(pid=954): Launched 09:24:42.237202 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:24:42.500055 run patchelf(pid=955): Launched 09:24:42.669196 run osmo-stp_10.42.42.5(pid=951): ERR: Terminated: ERROR {rc=1} [trial-2402↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=951)] 09:24:42.797443 run osmo-stp_10.42.42.5(pid=951): stdout: | (launched: 2022-12-14_09:24:41.426335) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:24:42.927747 run osmo-stp_10.42.42.5(pid=951): stderr: | 20221214092441595 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214092441596 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214092441596 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214092441596 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214092441597 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214092441597 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214092441597 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:24:43.057672 run osmo-stp_10.42.42.5(pid=951): stdout: | (launched: 2022-12-14_09:24:41.426335) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:24:43.182313 run osmo-stp_10.42.42.5(pid=951): stderr: | 20221214092441595 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214092441596 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214092441596 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214092441596 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214092441597 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214092441597 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214092441597 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:24:43.329730 run patchelf(pid=955): Terminating (SIGINT) 09:24:43.499604 run patchelf(pid=955): Terminated: ok {rc=0} 09:24:43.621883 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=951): Process ended prematurely: osmo-stp_10.42.42.5(pid=951) [trial-2402↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=951)] [trial-2402↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 09:24:43.631543 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 09:24:43.658982 run osmo-hlr_10.42.42.2(pid=948): ERR: Terminated: ERROR {rc=237} [trial-2402↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=948)] 09:24:43.707296 run osmo-hlr_10.42.42.2(pid=948): stdout: | (launched: 2022-12-14_09:24:40.475106) 09:24:43.756895 run osmo-hlr_10.42.42.2(pid=948): stderr: | 20221214092440647 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214092440647 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214092440647 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214092440647 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214092440647 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214092440647 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214092440660 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214092440670 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214092440670 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214092440671 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:24:43.807011 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=941): Terminating (SIGTERM) 09:24:43.847175 run iperf3-srv_10.42.42.10(pid=942): Terminating (SIGTERM) 09:24:43.887072 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=943): Terminating (SIGTERM) 09:24:43.927159 run iperf3-srv_10.42.42.10(pid=944): Terminating (SIGTERM) 09:24:43.967048 run pcap-recorder_any(filters='host 10.42.42.2')(pid=947): Terminating (SIGTERM) 09:24:44.007025 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=950): Terminating (SIGTERM) 09:24:44.046953 run pcap-recorder_any(filters='host 10.42.42.6')(pid=954): Terminating (SIGTERM) 09:24:44.087125 --- ParallelTerminationStrategy: PID 941 died... 09:24:44.106640 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=941): Terminated: ok {rc=0} 09:24:44.150617 --- ParallelTerminationStrategy: PID 942 died... 09:24:44.169542 run iperf3-srv_10.42.42.10(pid=942): Terminated {rc=256} 09:24:44.213269 --- ParallelTerminationStrategy: PID 943 died... 09:24:44.232116 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=943): Terminated: ok {rc=0} 09:24:44.275758 --- ParallelTerminationStrategy: PID 944 died... 09:24:44.294604 run iperf3-srv_10.42.42.10(pid=944): Terminated {rc=256} 09:24:44.338428 --- ParallelTerminationStrategy: PID 947 died... 09:24:44.357370 run pcap-recorder_any(filters='host 10.42.42.2')(pid=947): Terminated: ok {rc=0} 09:24:44.401168 --- ParallelTerminationStrategy: PID 950 died... 09:24:44.419903 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=950): Terminated: ok {rc=0} 09:24:44.463914 --- ParallelTerminationStrategy: PID 954 died... 09:24:44.482767 run pcap-recorder_any(filters='host 10.42.42.6')(pid=954): Terminated: ok {rc=0} 09:24:44.568349 bus /gobi_0: Setting Powered False 09:24:45.670898 bus /gobi_0: Setting Powered False 09:24:46.788421 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2402 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 09:24:47.932662 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:24:47.944434 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 09:24:48.010789 tst iperf3.py: using LAC 39961 09:24:48.129367 tst iperf3.py: using RAC 181 09:24:48.247983 tst iperf3.py: using CellId 39961 09:24:48.371388 tst iperf3.py: using BVCI 39962 09:24:48.482280 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:24:48.493464 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:24:48.504336 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:24:48.515229 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:24:48.526453 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:24:48.537726 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:24:48.548903 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:24:48.560123 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:24:48.571430 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 09:24:48.692653 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 09:24:48.909291 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:24:49.230925 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=957): Launched 09:24:49.511072 run iperf3-srv_10.42.42.10(pid=958): Launched 09:24:49.632941 tst iperf3.py:8: start network... 09:24:49.848885 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:24:50.348122 run create_hlr_db(pid=959): Launched 09:24:50.479435 bus /gobi_6: Setting Powered False 09:24:51.543000 run create_hlr_db(pid=959): Terminated: ok {rc=0} 09:24:51.973688 run pcap-recorder_any(filters='host 10.42.42.2')(pid=961): Launched 09:24:52.276534 run osmo-hlr_10.42.42.2(pid=962): Launched 09:24:52.391306 run osmo-stp_10.42.42.5: Starting osmo-stp 09:24:52.921720 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=964): Launched 09:24:53.224482 run osmo-stp_10.42.42.5(pid=965): Launched 09:24:53.339458 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:24:53.861193 run pcap-recorder_any(filters='host 10.42.42.6')(pid=967): Launched 09:24:53.976401 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:24:54.231868 run patchelf(pid=968): Launched 09:24:54.399196 run osmo-stp_10.42.42.5(pid=965): ERR: Terminated: ERROR {rc=1} [trial-2402↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=965)] 09:24:54.526953 run osmo-stp_10.42.42.5(pid=965): stdout: | (launched: 2022-12-14_09:24:53.168295) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:24:54.655995 run osmo-stp_10.42.42.5(pid=965): stderr: | 20221214092453338 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214092453338 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214092453338 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214092453339 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214092453339 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214092453339 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214092453340 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:24:54.786208 run osmo-stp_10.42.42.5(pid=965): stdout: | (launched: 2022-12-14_09:24:53.168295) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:24:54.909931 run osmo-stp_10.42.42.5(pid=965): stderr: | 20221214092453338 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214092453338 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214092453338 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214092453339 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214092453339 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214092453339 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214092453340 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:24:55.056277 run patchelf(pid=968): Terminating (SIGINT) 09:24:55.225500 run patchelf(pid=968): Terminated: ok {rc=0} 09:24:55.347497 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=965): Process ended prematurely: osmo-stp_10.42.42.5(pid=965) [trial-2402↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=965)] [trial-2402↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8] 09:24:55.357129 tst iperf3.py:8: Test FAILED (7.5 sec) 09:24:55.384211 run osmo-hlr_10.42.42.2(pid=962): ERR: Terminated: ERROR {rc=237} [trial-2402↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=962)] 09:24:55.432181 run osmo-hlr_10.42.42.2(pid=962): stdout: | (launched: 2022-12-14_09:24:52.219561) 09:24:55.481551 run osmo-hlr_10.42.42.2(pid=962): stderr: | 20221214092452394 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214092452394 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214092452394 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214092452394 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214092452394 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214092452394 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214092452408 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214092452417 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214092452417 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214092452417 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:24:55.531379 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=957): Terminating (SIGTERM) 09:24:55.571325 run iperf3-srv_10.42.42.10(pid=958): Terminating (SIGTERM) 09:24:55.611088 run pcap-recorder_any(filters='host 10.42.42.2')(pid=961): Terminating (SIGTERM) 09:24:55.650846 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=964): Terminating (SIGTERM) 09:24:55.690609 run pcap-recorder_any(filters='host 10.42.42.6')(pid=967): Terminating (SIGTERM) 09:24:55.731069 --- ParallelTerminationStrategy: PID 957 died... 09:24:55.750786 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=957): Terminated: ok {rc=0} 09:24:55.794667 --- ParallelTerminationStrategy: PID 958 died... 09:24:55.813766 run iperf3-srv_10.42.42.10(pid=958): Terminated {rc=256} 09:24:55.857486 --- ParallelTerminationStrategy: PID 961 died... 09:24:55.876220 run pcap-recorder_any(filters='host 10.42.42.2')(pid=961): Terminated: ok {rc=0} 09:24:55.920044 --- ParallelTerminationStrategy: PID 964 died... 09:24:55.938840 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=964): Terminated: ok {rc=0} 09:24:55.982479 --- ParallelTerminationStrategy: PID 967 died... 09:24:56.001334 run pcap-recorder_any(filters='host 10.42.42.6')(pid=967): Terminated: ok {rc=0} 09:24:56.087384 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2402 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 09:24:57.232435 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:24:57.244265 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 09:24:57.311821 tst iperf3m4.py: using LAC 39962 09:24:57.429565 tst iperf3m4.py: using RAC 182 09:24:57.560294 tst iperf3m4.py: using CellId 39962 09:24:57.686226 tst iperf3m4.py: using BVCI 39963 09:24:57.803323 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:24:57.815182 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:24:57.826941 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:24:57.838470 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:24:57.849943 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:24:57.861503 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:24:57.872938 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:24:57.884340 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:24:57.896019 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 09:24:58.017720 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 09:24:58.142974 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 09:24:58.261375 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 09:24:58.377332 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 09:24:58.578796 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:24:58.883632 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=969): Launched 09:24:59.146118 run iperf3-srv_10.42.42.10(pid=970): Launched 09:24:59.260874 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 09:24:59.461591 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:24:59.764852 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=971): Launched 09:25:00.027993 run iperf3-srv_10.42.42.10(pid=972): Launched 09:25:00.141365 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 09:25:00.342321 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:25:00.646026 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=973): Launched 09:25:00.929685 run iperf3-srv_10.42.42.10(pid=974): Launched 09:25:01.099847 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 09:25:01.373122 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:25:01.714266 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=978): Launched 09:25:02.055313 run iperf3-srv_10.42.42.10(pid=979): Launched 09:25:02.193396 tst iperf3m4.py:8: start network... 09:25:02.411368 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:25:02.914438 run create_hlr_db(pid=980): Launched 09:25:03.044408 bus /gobi_6: Setting Powered False 09:25:04.108580 run create_hlr_db(pid=980): Terminated: ok {rc=0} 09:25:04.538494 run pcap-recorder_any(filters='host 10.42.42.2')(pid=982): Launched 09:25:04.842295 run osmo-hlr_10.42.42.2(pid=983): Launched 09:25:04.958033 run osmo-stp_10.42.42.5: Starting osmo-stp 09:25:05.494663 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=985): Launched 09:25:05.797311 run osmo-stp_10.42.42.5(pid=986): Launched 09:25:05.912487 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:25:06.434773 run pcap-recorder_any(filters='host 10.42.42.6')(pid=989): Launched 09:25:06.549774 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:25:06.805776 run patchelf(pid=990): Launched 09:25:06.973269 run osmo-stp_10.42.42.5(pid=986): ERR: Terminated: ERROR {rc=1} [trial-2402↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=986)] 09:25:07.100480 run osmo-stp_10.42.42.5(pid=986): stdout: | (launched: 2022-12-14_09:25:05.740282) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:25:07.229878 run osmo-stp_10.42.42.5(pid=986): stderr: | 20221214092505909 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214092505909 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214092505909 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214092505910 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214092505910 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214092505910 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214092505910 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:25:07.359085 run osmo-stp_10.42.42.5(pid=986): stdout: | (launched: 2022-12-14_09:25:05.740282) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:25:07.482811 run osmo-stp_10.42.42.5(pid=986): stderr: | 20221214092505909 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214092505909 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214092505909 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214092505910 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214092505910 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214092505910 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214092505910 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:25:07.628840 run patchelf(pid=990): Terminating (SIGINT) 09:25:07.797688 run patchelf(pid=990): Terminated: ok {rc=0} 09:25:07.919060 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=986): Process ended prematurely: osmo-stp_10.42.42.5(pid=986) [trial-2402↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=986)] [trial-2402↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8] 09:25:07.928768 tst iperf3m4.py:8: Test FAILED (10.7 sec) 09:25:07.956302 run osmo-hlr_10.42.42.2(pid=983): ERR: Terminated: ERROR {rc=237} [trial-2402↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=983)] 09:25:08.004171 run osmo-hlr_10.42.42.2(pid=983): stdout: | (launched: 2022-12-14_09:25:04.785647) 09:25:08.054036 run osmo-hlr_10.42.42.2(pid=983): stderr: | 20221214092504959 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214092504959 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214092504959 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214092504959 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214092504959 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214092504959 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214092504972 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214092504982 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214092504983 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214092504983 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:25:08.103830 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=969): Terminating (SIGTERM) 09:25:08.143719 run iperf3-srv_10.42.42.10(pid=970): Terminating (SIGTERM) 09:25:08.183413 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=971): Terminating (SIGTERM) 09:25:08.223112 run iperf3-srv_10.42.42.10(pid=972): Terminating (SIGTERM) 09:25:08.262691 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=973): Terminating (SIGTERM) 09:25:08.302432 run iperf3-srv_10.42.42.10(pid=974): Terminating (SIGTERM) 09:25:08.341801 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=978): Terminating (SIGTERM) 09:25:08.381533 run iperf3-srv_10.42.42.10(pid=979): Terminating (SIGTERM) 09:25:08.421090 run pcap-recorder_any(filters='host 10.42.42.2')(pid=982): Terminating (SIGTERM) 09:25:08.460752 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=985): Terminating (SIGTERM) 09:25:08.500413 run pcap-recorder_any(filters='host 10.42.42.6')(pid=989): Terminating (SIGTERM) 09:25:08.540428 --- ParallelTerminationStrategy: PID 969 died... 09:25:08.559826 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=969): Terminated: ok {rc=0} 09:25:08.603890 --- ParallelTerminationStrategy: PID 970 died... 09:25:08.622741 run iperf3-srv_10.42.42.10(pid=970): Terminated {rc=256} 09:25:08.666472 --- ParallelTerminationStrategy: PID 971 died... 09:25:08.685332 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=971): Terminated: ok {rc=0} 09:25:08.729329 --- ParallelTerminationStrategy: PID 972 died... 09:25:08.748222 run iperf3-srv_10.42.42.10(pid=972): Terminated {rc=256} 09:25:08.792536 --- ParallelTerminationStrategy: PID 973 died... 09:25:08.811669 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=973): Terminated: ok {rc=0} 09:25:08.855754 --- ParallelTerminationStrategy: PID 974 died... 09:25:08.874969 run iperf3-srv_10.42.42.10(pid=974): Terminated {rc=256} 09:25:08.919058 --- ParallelTerminationStrategy: PID 978 died... 09:25:08.937996 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=978): Terminated: ok {rc=0} 09:25:08.982206 --- ParallelTerminationStrategy: PID 979 died... 09:25:09.001256 run iperf3-srv_10.42.42.10(pid=979): Terminated {rc=256} 09:25:09.045140 --- ParallelTerminationStrategy: PID 982 died... 09:25:09.064034 run pcap-recorder_any(filters='host 10.42.42.2')(pid=982): Terminated: ok {rc=0} 09:25:09.108327 --- ParallelTerminationStrategy: PID 985 died... 09:25:09.127436 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=985): Terminated: ok {rc=0} 09:25:09.171504 --- ParallelTerminationStrategy: PID 989 died... 09:25:09.190616 run pcap-recorder_any(filters='host 10.42.42.6')(pid=989): Terminated: ok {rc=0} 09:25:09.277258 bus /gobi_4: Setting Powered False 09:25:10.377044 bus /gobi_4: Setting Powered False 09:25:11.492379 bus /gobi_1: Setting Powered False 09:25:12.592450 bus /gobi_1: Setting Powered False 09:25:13.710972 bus /gobi_0: Setting Powered False 09:25:14.811080 bus /gobi_0: Setting Powered False 09:25:15.940684 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2402 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 09:25:17.045477 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:25:17.058328 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 09:25:17.129315 tst ping.py: using LAC 39963 09:25:17.279310 tst ping.py: using RAC 183 09:25:17.402488 tst ping.py: using CellId 39963 09:25:17.527863 tst ping.py: using BVCI 39964 09:25:17.642922 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:25:17.654844 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:25:17.666697 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:25:17.678326 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:25:17.689961 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:25:17.701513 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:25:17.713041 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:25:17.724502 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 09:25:17.839516 tst ping.py:19: start network... 09:25:18.036088 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:25:18.493035 run create_hlr_db(pid=994): Launched 09:25:18.605467 bus /gobi_6: Setting Powered False 09:25:19.664747 run create_hlr_db(pid=994): Terminated: ok {rc=0} 09:25:20.099520 run pcap-recorder_any(filters='host 10.42.42.2')(pid=997): Launched 09:25:20.401191 run osmo-hlr_10.42.42.2(pid=998): Launched 09:25:20.513713 run osmo-stp_10.42.42.5: Starting osmo-stp 09:25:21.037681 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1000): Launched 09:25:21.354408 run osmo-stp_10.42.42.5(pid=1001): Launched 09:25:21.475067 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:25:22.022310 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1003): Launched 09:25:22.144592 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:25:22.411968 run patchelf(pid=1004): Launched 09:25:22.588363 run osmo-stp_10.42.42.5(pid=1001): ERR: Terminated: ERROR {rc=1} [trial-2402↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1001)] 09:25:22.722978 run osmo-stp_10.42.42.5(pid=1001): stdout: | (launched: 2022-12-14_09:25:21.295898) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:25:22.859289 run osmo-stp_10.42.42.5(pid=1001): stderr: | 20221214092521484 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214092521484 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214092521485 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214092521486 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214092521486 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214092521486 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214092521487 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:25:22.995828 run osmo-stp_10.42.42.5(pid=1001): stdout: | (launched: 2022-12-14_09:25:21.295898) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:25:23.126126 run osmo-stp_10.42.42.5(pid=1001): stderr: | 20221214092521484 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214092521484 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214092521485 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214092521486 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214092521486 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214092521486 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214092521487 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:25:23.280163 run patchelf(pid=1004): Terminating (SIGINT) 09:25:23.457422 run patchelf(pid=1004): Terminated: ok {rc=0} 09:25:23.585288 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=1001): Process ended prematurely: osmo-stp_10.42.42.5(pid=1001) [trial-2402↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1001)] [trial-2402↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22] 09:25:23.595229 tst ping.py:22: Test FAILED (6.5 sec) 09:25:23.623571 run osmo-hlr_10.42.42.2(pid=998): ERR: Terminated: ERROR {rc=237} [trial-2402↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=998)] 09:25:23.674472 run osmo-hlr_10.42.42.2(pid=998): stdout: | (launched: 2022-12-14_09:25:20.346152) 09:25:23.727150 run osmo-hlr_10.42.42.2(pid=998): stderr: | 20221214092520519 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214092520519 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214092520519 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214092520519 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214092520519 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214092520519 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214092520530 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214092520538 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214092520539 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214092520539 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:25:23.779773 run pcap-recorder_any(filters='host 10.42.42.2')(pid=997): Terminating (SIGTERM) 09:25:23.822326 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1000): Terminating (SIGTERM) 09:25:23.864918 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1003): Terminating (SIGTERM) 09:25:23.907364 --- ParallelTerminationStrategy: PID 997 died... 09:25:23.927815 run pcap-recorder_any(filters='host 10.42.42.2')(pid=997): Terminated: ok {rc=0} 09:25:23.974391 --- ParallelTerminationStrategy: PID 1000 died... 09:25:23.994205 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1000): Terminated: ok {rc=0} 09:25:24.040245 --- ParallelTerminationStrategy: PID 1003 died... 09:25:24.059739 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1003): Terminated: ok {rc=0} 09:25:24.146834 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2402 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 09:25:25.234630 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:25:25.247051 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 09:25:25.315050 tst ping_idle_ping.py: using LAC 39964 09:25:25.433306 tst ping_idle_ping.py: using RAC 184 09:25:25.559748 tst ping_idle_ping.py: using CellId 39964 09:25:25.685371 tst ping_idle_ping.py: using BVCI 39965 09:25:25.796066 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:25:25.807719 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:25:25.818816 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:25:25.830039 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:25:25.841376 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:25:25.852655 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:25:25.864122 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:25:25.875643 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 09:25:25.996076 tst ping_idle_ping.py:24: start network... 09:25:26.210029 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:25:26.706105 run create_hlr_db(pid=1005): Launched 09:25:26.836568 bus /gobi_6: Setting Powered False 09:25:27.899170 run create_hlr_db(pid=1005): Terminated: ok {rc=0} 09:25:28.324593 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1007): Launched 09:25:28.623312 run osmo-hlr_10.42.42.2(pid=1008): Launched 09:25:28.738246 run osmo-stp_10.42.42.5: Starting osmo-stp 09:25:29.263885 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1010): Launched 09:25:29.561703 run osmo-stp_10.42.42.5(pid=1011): Launched 09:25:29.674413 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:25:30.189197 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1013): Launched 09:25:30.312090 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:25:30.581974 run patchelf(pid=1014): Launched 09:25:30.760146 run osmo-stp_10.42.42.5(pid=1011): ERR: Terminated: ERROR {rc=1} [trial-2402↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1011)] 09:25:30.901297 run osmo-stp_10.42.42.5(pid=1011): stdout: | (launched: 2022-12-14_09:25:29.506335) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:25:31.041726 run osmo-stp_10.42.42.5(pid=1011): stderr: | 20221214092529674 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214092529674 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214092529675 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214092529675 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214092529675 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214092529676 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214092529676 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:25:31.182591 run osmo-stp_10.42.42.5(pid=1011): stdout: | (launched: 2022-12-14_09:25:29.506335) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:25:31.317830 run osmo-stp_10.42.42.5(pid=1011): stderr: | 20221214092529674 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214092529674 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214092529675 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214092529675 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214092529675 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214092529676 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214092529676 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:25:31.477631 run patchelf(pid=1014): Terminating (SIGINT) 09:25:31.659136 run patchelf(pid=1014): Terminated: ok {rc=0} 09:25:31.789657 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=1011): Process ended prematurely: osmo-stp_10.42.42.5(pid=1011) [trial-2402↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1011)] [trial-2402↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 09:25:31.800028 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 09:25:31.835665 run osmo-hlr_10.42.42.2(pid=1008): ERR: Terminated: ERROR {rc=237} [trial-2402↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1008)] 09:25:31.902151 run osmo-hlr_10.42.42.2(pid=1008): stdout: | (launched: 2022-12-14_09:25:28.567311) 09:25:31.967041 run osmo-hlr_10.42.42.2(pid=1008): stderr: | 20221214092528742 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214092528742 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214092528742 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214092528742 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214092528742 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214092528742 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214092528755 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214092528765 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214092528765 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214092528765 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:25:32.030327 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1007): Terminating (SIGTERM) 09:25:32.082020 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1010): Terminating (SIGTERM) 09:25:32.130730 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1013): Terminating (SIGTERM) 09:25:32.174356 --- ParallelTerminationStrategy: PID 1007 died... 09:25:32.195470 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1007): Terminated: ok {rc=0} 09:25:32.241928 --- ParallelTerminationStrategy: PID 1010 died... 09:25:32.260930 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1010): Terminated: ok {rc=0} 09:25:32.306271 --- ParallelTerminationStrategy: PID 1013 died... 09:25:32.325408 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1013): Terminated: ok {rc=0} 09:25:32.411471 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2402 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 09:25:33.713654 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:25:33.720337 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 09:25:33.749093 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 09:25:33.784410 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 09:25:33.837956 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 09:25:33.868145 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 09:25:33.904356 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 09:25:34.459579 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2402 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 09:25:34.465711 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 09:25:34.477593 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 09:25:34.547117 tst switch_tch_pdch.py: using LAC 39965 09:25:34.662836 tst switch_tch_pdch.py: using RAC 185 09:25:34.782260 tst switch_tch_pdch.py: using CellId 39965 09:25:34.898413 tst switch_tch_pdch.py: using BVCI 39966 09:25:35.007175 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 09:25:35.018646 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 09:25:35.029905 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 09:25:35.040904 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 09:25:35.052394 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 09:25:35.063881 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 09:25:35.075390 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 09:25:35.086891 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 09:25:35.207689 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 09:25:35.326736 tst switch_tch_pdch.py:51: start network... 09:25:35.540491 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:25:36.031249 run create_hlr_db(pid=1018): Launched 09:25:36.160551 bus /gobi_6: Setting Powered False 09:25:37.223583 run create_hlr_db(pid=1018): Terminated: ok {rc=0} 09:25:37.647901 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1020): Launched 09:25:37.945266 run osmo-hlr_10.42.42.2(pid=1021): Launched 09:25:38.057631 run osmo-stp_10.42.42.5: Starting osmo-stp 09:25:38.578714 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1023): Launched 09:25:38.875162 run osmo-stp_10.42.42.5(pid=1024): Launched 09:25:38.989849 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:25:39.499652 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1026): Launched 09:25:39.612770 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:25:39.863624 run patchelf(pid=1027): Launched 09:25:40.028816 run osmo-stp_10.42.42.5(pid=1024): ERR: Terminated: ERROR {rc=1} [trial-2402↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1024)] 09:25:40.154758 run osmo-stp_10.42.42.5(pid=1024): stdout: | (launched: 2022-12-14_09:25:38.819460) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:25:40.282453 run osmo-stp_10.42.42.5(pid=1024): stderr: | 20221214092538985 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214092538985 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214092538986 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214092538986 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214092538986 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214092538987 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214092538987 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:25:40.410015 run osmo-stp_10.42.42.5(pid=1024): stdout: | (launched: 2022-12-14_09:25:38.819460) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:25:40.532380 run osmo-stp_10.42.42.5(pid=1024): stderr: | 20221214092538985 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214092538985 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214092538986 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214092538986 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214092538986 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214092538987 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214092538987 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:25:40.676572 run patchelf(pid=1027): Terminating (SIGINT) 09:25:40.843422 run patchelf(pid=1027): Terminated: ok {rc=0} 09:25:40.963160 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=1024): Process ended prematurely: osmo-stp_10.42.42.5(pid=1024) [trial-2402↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1024)] [trial-2402↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 09:25:40.972546 tst switch_tch_pdch.py:54: Test FAILED (6.5 sec) 09:25:40.999327 run osmo-hlr_10.42.42.2(pid=1021): ERR: Terminated: ERROR {rc=237} [trial-2402↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1021)] 09:25:41.048267 run osmo-hlr_10.42.42.2(pid=1021): stdout: | (launched: 2022-12-14_09:25:37.889649) 09:25:41.098615 run osmo-hlr_10.42.42.2(pid=1021): stderr: | 20221214092538062 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214092538062 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214092538062 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214092538062 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214092538062 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214092538062 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214092538074 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214092538083 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214092538083 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214092538083 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:25:41.148940 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1020): Terminating (SIGTERM) 09:25:41.189051 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1023): Terminating (SIGTERM) 09:25:41.229061 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1026): Terminating (SIGTERM) 09:25:41.269227 --- ParallelTerminationStrategy: PID 1020 died... 09:25:41.288819 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1020): Terminated: ok {rc=0} 09:25:41.333163 --- ParallelTerminationStrategy: PID 1023 died... 09:25:41.352504 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1023): Terminated: ok {rc=0} 09:25:41.396645 --- ParallelTerminationStrategy: PID 1026 died... 09:25:41.416006 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1026): Terminated: ok {rc=0} 09:25:41.499774 bus /gobi_0: Setting Powered False 09:25:42.595611 bus /gobi_0: Setting Powered False 09:25:43.709709 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2402 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 09:25:44.975558 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:25:44.981847 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 09:25:45.011685 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 09:25:45.047129 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 09:25:45.102099 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 09:25:45.131269 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 09:25:45.165478 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 09:25:45.726020 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2402 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 09:25:45.731436 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 09:25:45.743383 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 09:25:45.809202 tst switch_tch_pdch.py: using LAC 39966 09:25:45.971951 tst switch_tch_pdch.py: using RAC 186 09:25:46.097297 tst switch_tch_pdch.py: using CellId 39966 09:25:46.219188 tst switch_tch_pdch.py: using BVCI 39967 09:25:46.370631 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 09:25:46.386221 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 09:25:46.400024 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 09:25:46.415531 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 09:25:46.431574 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 09:25:46.448611 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 09:25:46.465423 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 09:25:46.482462 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 09:25:46.609827 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 09:25:46.727661 tst switch_tch_pdch.py:51: start network... 09:25:46.930619 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:25:47.375607 run create_hlr_db(pid=1031): Launched 09:25:47.488366 bus /gobi_6: Setting Powered False 09:25:48.548127 run create_hlr_db(pid=1031): Terminated: ok {rc=0} 09:25:48.955241 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1033): Launched 09:25:49.272443 run osmo-hlr_10.42.42.2(pid=1034): Launched 09:25:49.394294 run osmo-stp_10.42.42.5: Starting osmo-stp 09:25:49.918529 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1036): Launched 09:25:50.235651 run osmo-stp_10.42.42.5(pid=1037): Launched 09:25:50.356543 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:25:50.874991 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1039): Launched 09:25:50.995752 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:25:51.263328 run patchelf(pid=1040): Launched 09:25:51.440443 run osmo-stp_10.42.42.5(pid=1037): ERR: Terminated: ERROR {rc=1} [trial-2402↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1037)] 09:25:51.574264 run osmo-stp_10.42.42.5(pid=1037): stdout: | (launched: 2022-12-14_09:25:50.177255) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:25:51.709520 run osmo-stp_10.42.42.5(pid=1037): stderr: | 20221214092550365 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214092550365 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214092550366 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214092550366 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214092550367 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214092550367 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214092550367 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:25:51.845154 run osmo-stp_10.42.42.5(pid=1037): stdout: | (launched: 2022-12-14_09:25:50.177255) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:25:51.976403 run osmo-stp_10.42.42.5(pid=1037): stderr: | 20221214092550365 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214092550365 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214092550366 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214092550366 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214092550367 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214092550367 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214092550367 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:25:52.122315 run patchelf(pid=1040): Terminating (SIGINT) 09:25:52.288125 run patchelf(pid=1040): Terminated: ok {rc=0} 09:25:52.407343 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=1037): Process ended prematurely: osmo-stp_10.42.42.5(pid=1037) [trial-2402↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1037)] [trial-2402↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 09:25:52.416440 tst switch_tch_pdch.py:54: Test FAILED (6.7 sec) 09:25:52.443117 run osmo-hlr_10.42.42.2(pid=1034): ERR: Terminated: ERROR {rc=237} [trial-2402↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1034)] 09:25:52.491075 run osmo-hlr_10.42.42.2(pid=1034): stdout: | (launched: 2022-12-14_09:25:49.213959) 09:25:52.540809 run osmo-hlr_10.42.42.2(pid=1034): stderr: | 20221214092549407 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214092549407 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214092549408 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214092549408 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214092549408 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214092549408 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214092549421 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214092549430 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214092549431 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214092549431 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:25:52.590869 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1033): Terminating (SIGTERM) 09:25:52.630712 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1036): Terminating (SIGTERM) 09:25:52.670470 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1039): Terminating (SIGTERM) 09:25:52.710325 --- ParallelTerminationStrategy: PID 1033 died... 09:25:52.729704 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1033): Terminated: ok {rc=0} 09:25:52.773677 --- ParallelTerminationStrategy: PID 1036 died... 09:25:52.792365 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1036): Terminated: ok {rc=0} 09:25:52.836265 --- ParallelTerminationStrategy: PID 1039 died... 09:25:52.855048 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1039): Terminated: ok {rc=0} 09:25:52.940468 bus /gobi_0: Setting Powered False 09:25:54.040286 bus /gobi_0: Setting Powered False 09:25:55.155141 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2402 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 nitb_sms:nanobts --------------------------------------------------------------------- 09:25:56.403978 tst nitb_sms:nanobts: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:25:56.408524 tst nitb_sms:nanobts: Verifying 1 x bts (candidates: 11) 09:25:56.432595 tst nitb_sms:nanobts: Verifying 1 x ip_address (candidates: 9) 09:25:56.439354 tst nitb_sms:nanobts: Verifying 2 x modem (candidates: 12) 09:25:56.493328 tst nitb_sms:nanobts: Reserving 1 x bts (candidates: 11) 09:25:56.517632 tst nitb_sms:nanobts: Reserving 1 x ip_address (candidates: 9) 09:25:56.524536 tst nitb_sms:nanobts: Reserving 2 x modem (candidates: 12) 09:25:57.060343 tst nitb_sms:nanobts: RESERVED RESOURCES for nitb_sms: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2402 nitb_sms:nanobts mo_mt_sms.py ---------------------------------------------- 09:25:57.065696 tst nitb_sms:nanobts: Using 1 x ip_address (candidates: 1) 09:25:57.076416 tst nitb_sms:nanobts: Using 1 x bts (candidates: 1) 09:25:57.114093 tst mo_mt_sms.py: using LAC 39967 09:25:57.232000 tst mo_mt_sms.py: using RAC 187 09:25:57.357521 tst mo_mt_sms.py: using CellId 39967 09:25:57.476320 tst mo_mt_sms.py: using BVCI 39968 09:25:57.584216 tst nitb_sms:nanobts: Using 1 x modem (candidates: 2) 09:25:57.702619 tst nitb_sms:nanobts: Using 1 x modem (candidates: 2) 09:25:57.817873 tst mo_mt_sms.py:9: start nitb and bts... 09:25:58.015028 run osmo-nitb_10.42.42.2: Starting osmo-nitb 09:25:58.619804 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=1047): Launched 09:25:58.915567 run osmo-nitb_10.42.42.2(pid=1048): Launched 09:25:59.079270 run osmo-nitb_10.42.42.2(pid=1048): ERR: Terminated: ERROR {rc=2} [trial-2402↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=1048)] 09:25:59.212719 run osmo-nitb_10.42.42.2(pid=1048): stdout: | (launched: 2022-12-14_09:25:58.860567) 09:25:59.347055 run osmo-nitb_10.42.42.2(pid=1048): stderr: | (launched: 2022-12-14_09:25:58.904437) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 09:25:59.481289 run osmo-nitb_10.42.42.2(pid=1048): stdout: | (launched: 2022-12-14_09:25:58.860567) 09:25:59.609890 run osmo-nitb_10.42.42.2(pid=1048): stderr: | (launched: 2022-12-14_09:25:58.904437) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fe4ae4b0268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=1048): Process ended prematurely: osmo-nitb_10.42.42.2(pid=1048) [trial-2402↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=1048)] 09:26:00.026760 tst osmo-nitb_10.42.42.2(pid=1048): stdout: | (launched: 2022-12-14_09:25:58.860567) 09:26:00.146830 tst osmo-nitb_10.42.42.2(pid=1048): stderr: | (launched: 2022-12-14_09:25:58.904437) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 09:26:00.287360 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=1048): Process ended prematurely: osmo-nitb_10.42.42.2(pid=1048) [trial-2402↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=1048)] [trial-2402↪nitb_sms:nanobts↪mo_mt_sms.py:11] 09:26:00.296017 tst mo_mt_sms.py:11: Test FAILED (3.2 sec) 09:26:00.302724 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=1047): Terminating (SIGTERM) 09:26:00.511428 --- ParallelTerminationStrategy: PID 1047 died... 09:26:00.532232 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=1047): Terminated: ok {rc=0} 09:26:00.619089 bus /sierra_3: Setting Powered False 09:26:01.725460 bus /sierra_3: Setting Powered False 09:26:02.844007 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2402 nitb_sms:nanobts FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 sms:nanobts+band-1900 --------------------------------------------------------------------- 09:26:04.027969 tst sms:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:26:04.033066 tst sms:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 09:26:04.056476 tst sms:nanobts+band-1900: Verifying 6 x ip_address (candidates: 9) 09:26:04.083734 tst sms:nanobts+band-1900: Verifying 2 x modem (candidates: 12) 09:26:04.135930 tst sms:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 09:26:04.160761 tst sms:nanobts+band-1900: Reserving 6 x ip_address (candidates: 9) 09:26:04.188437 tst sms:nanobts+band-1900: Reserving 2 x modem (candidates: 12) 09:26:04.732519 tst sms:nanobts+band-1900: RESERVED RESOURCES for sms: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2402 sms:nanobts+band-1900 mo_mt_sms.py ---------------------------------------------- 09:26:04.738957 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 09:26:04.750829 tst sms:nanobts+band-1900: Using 1 x bts (candidates: 1) 09:26:04.790176 tst mo_mt_sms.py: using LAC 39968 09:26:04.915412 tst mo_mt_sms.py: using RAC 188 09:26:05.044140 tst mo_mt_sms.py: using CellId 39968 09:26:05.167822 tst mo_mt_sms.py: using BVCI 39969 09:26:05.282700 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 09:26:05.294064 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 09:26:05.305104 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 09:26:05.316198 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 09:26:05.327382 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 09:26:05.338457 tst sms:nanobts+band-1900: Using 1 x modem (candidates: 2) 09:26:05.455830 tst sms:nanobts+band-1900: Using 1 x modem (candidates: 2) 09:26:05.571645 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:26:06.031573 run create_hlr_db(pid=1052): Launched 09:26:06.145300 bus /sierra_2: Setting Powered False 09:26:07.204830 run create_hlr_db(pid=1052): Terminated: ok {rc=0} 09:26:07.619115 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1054): Launched 09:26:07.915356 run osmo-hlr_10.42.42.2(pid=1055): Launched 09:26:08.027648 run osmo-stp_10.42.42.5: Starting osmo-stp 09:26:08.549350 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1057): Launched 09:26:08.846129 run osmo-stp_10.42.42.5(pid=1058): Launched 09:26:08.958652 run osmo-msc_10.42.42.6: Starting osmo-msc 09:26:09.494513 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1060): Launched 09:26:09.790926 run osmo-msc_10.42.42.6(pid=1061): Launched 09:26:09.957083 run osmo-stp_10.42.42.5(pid=1058): ERR: Terminated: ERROR {rc=1} [trial-2402↪sms:nanobts+band-1900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1058)] 09:26:10.083600 run osmo-stp_10.42.42.5(pid=1058): stdout: | (launched: 2022-12-14_09:26:08.790776) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:26:10.210163 run osmo-stp_10.42.42.5(pid=1058): stderr: | 20221214092608956 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214092608956 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214092608956 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214092608957 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214092608957 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214092608957 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214092608957 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:26:10.334343 run osmo-stp_10.42.42.5(pid=1058): stdout: | (launched: 2022-12-14_09:26:08.790776) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:26:10.452026 run osmo-stp_10.42.42.5(pid=1058): stderr: | 20221214092608956 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214092608956 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214092608956 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214092608957 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214092608957 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214092608957 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214092608957 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:26:10.593442 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=1058): Process ended prematurely: osmo-stp_10.42.42.5(pid=1058) [trial-2402↪sms:nanobts+band-1900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1058)] [trial-2402↪sms:nanobts+band-1900↪mo_mt_sms.py:16] 09:26:10.601842 tst mo_mt_sms.py:16: Test FAILED (5.9 sec) 09:26:10.627595 run osmo-hlr_10.42.42.2(pid=1055): ERR: Terminated: ERROR {rc=237} [trial-2402↪sms:nanobts+band-1900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1055)] 09:26:10.675081 run osmo-hlr_10.42.42.2(pid=1055): stdout: | (launched: 2022-12-14_09:26:07.860316) 09:26:10.724322 run osmo-hlr_10.42.42.2(pid=1055): stderr: | 20221214092608031 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214092608031 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214092608031 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214092608031 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214092608031 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214092608031 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214092608044 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/sms:nanobts+band-1900/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214092608052 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214092608052 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214092608053 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:26:10.793462 run osmo-msc_10.42.42.6(pid=1061): ERR: Terminated: ERROR {rc=2} [trial-2402↪sms:nanobts+band-1900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1061)] 09:26:10.840440 run osmo-msc_10.42.42.6(pid=1061): stdout: | (launched: 2022-12-14_09:26:09.735254) 09:26:10.889355 run osmo-msc_10.42.42.6(pid=1061): stderr: | 20221214092610002 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214092610002 DLGLOBAL DEBUG validating counter group 0x7ff297521c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214092610002 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214092610002 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214092610002 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214092610003 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214092610004 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214092610005 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214092610005 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214092610005 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:26:10.938720 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1054): Terminating (SIGTERM) 09:26:10.978445 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1057): Terminating (SIGTERM) 09:26:11.018096 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1060): Terminating (SIGTERM) 09:26:11.058249 --- ParallelTerminationStrategy: PID 1054 died... 09:26:11.077643 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1054): Terminated: ok {rc=0} 09:26:11.121702 --- ParallelTerminationStrategy: PID 1057 died... 09:26:11.140348 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1057): Terminated: ok {rc=0} 09:26:11.184263 --- ParallelTerminationStrategy: PID 1060 died... 09:26:11.203060 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1060): Terminated: ok {rc=0} 09:26:11.289636 bus /sierra_3: Setting Powered False 09:26:12.388591 bus /sierra_3: Setting Powered False 09:26:13.500735 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2402 sms:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 nitb_ussd:nanobts+band-1900 --------------------------------------------------------------------- 09:26:14.718778 tst nitb_ussd:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:26:14.723621 tst nitb_ussd:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 09:26:14.747039 tst nitb_ussd:nanobts+band-1900: Verifying 1 x ip_address (candidates: 9) 09:26:14.753871 tst nitb_ussd:nanobts+band-1900: Verifying 1 x modem (candidates: 12) 09:26:14.789907 tst nitb_ussd:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 09:26:14.813749 tst nitb_ussd:nanobts+band-1900: Reserving 1 x ip_address (candidates: 9) 09:26:14.820529 tst nitb_ussd:nanobts+band-1900: Reserving 1 x modem (candidates: 12) 09:26:15.339154 tst nitb_ussd:nanobts+band-1900: RESERVED RESOURCES for nitb_ussd: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2402 nitb_ussd:nanobts+band-1900 assert_extension.py ---------------------------------------------- 09:26:15.344353 tst nitb_ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 1) 09:26:15.355365 tst nitb_ussd:nanobts+band-1900: Using 1 x bts (candidates: 1) 09:26:15.392134 tst assert_extension.py: using LAC 39969 09:26:15.508857 tst assert_extension.py: using RAC 189 09:26:15.625519 tst assert_extension.py: using CellId 39969 09:26:15.750319 tst assert_extension.py: using BVCI 39970 09:26:15.896195 tst nitb_ussd:nanobts+band-1900: Using 1 x modem (candidates: 1) 09:26:16.027897 tst assert_extension.py:10: start nitb and bts... 09:26:16.234335 run osmo-nitb_10.42.42.2: Starting osmo-nitb 09:26:16.863597 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=1067): Launched 09:26:17.207586 run osmo-nitb_10.42.42.2(pid=1068): Launched 09:26:17.383402 run osmo-nitb_10.42.42.2(pid=1068): ERR: Terminated: ERROR {rc=2} [trial-2402↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=1068)] 09:26:17.525435 run osmo-nitb_10.42.42.2(pid=1068): stdout: | (launched: 2022-12-14_09:26:17.149304) 09:26:17.668559 run osmo-nitb_10.42.42.2(pid=1068): stderr: | (launched: 2022-12-14_09:26:17.196836) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 09:26:17.811475 run osmo-nitb_10.42.42.2(pid=1068): stdout: | (launched: 2022-12-14_09:26:17.149304) 09:26:17.949428 run osmo-nitb_10.42.42.2(pid=1068): stderr: | (launched: 2022-12-14_09:26:17.196836) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fe4ae4b0268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=1068): Process ended prematurely: osmo-nitb_10.42.42.2(pid=1068) [trial-2402↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=1068)] 09:26:18.326704 tst osmo-nitb_10.42.42.2(pid=1068): stdout: | (launched: 2022-12-14_09:26:17.149304) 09:26:18.453817 tst osmo-nitb_10.42.42.2(pid=1068): stderr: | (launched: 2022-12-14_09:26:17.196836) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 09:26:18.603515 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=1068): Process ended prematurely: osmo-nitb_10.42.42.2(pid=1068) [trial-2402↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=1068)] [trial-2402↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12] 09:26:18.612590 tst assert_extension.py:12: Test FAILED (3.3 sec) 09:26:18.619591 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=1067): Terminating (SIGTERM) 09:26:18.829827 --- ParallelTerminationStrategy: PID 1067 died... 09:26:18.851885 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=1067): Terminated: ok {rc=0} 09:26:18.939505 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2402 nitb_ussd:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 ussd:nanobts+band-1900 --------------------------------------------------------------------- 09:26:20.105626 tst ussd:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:26:20.111503 tst ussd:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 09:26:20.136237 tst ussd:nanobts+band-1900: Verifying 6 x ip_address (candidates: 9) 09:26:20.163562 tst ussd:nanobts+band-1900: Verifying 1 x modem (candidates: 12) 09:26:20.199144 tst ussd:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 09:26:20.223679 tst ussd:nanobts+band-1900: Reserving 6 x ip_address (candidates: 9) 09:26:20.250735 tst ussd:nanobts+band-1900: Reserving 1 x modem (candidates: 12) 09:26:20.780666 tst ussd:nanobts+band-1900: RESERVED RESOURCES for ussd: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2402 ussd:nanobts+band-1900 assert_extension.py ---------------------------------------------- 09:26:20.785934 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 09:26:20.797187 tst ussd:nanobts+band-1900: Using 1 x bts (candidates: 1) 09:26:20.835872 tst assert_extension.py: using LAC 39970 09:26:20.962850 tst assert_extension.py: using RAC 190 09:26:21.088831 tst assert_extension.py: using CellId 39970 09:26:21.212718 tst assert_extension.py: using BVCI 39971 09:26:21.327271 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 09:26:21.338532 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 09:26:21.349701 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 09:26:21.360925 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 09:26:21.372134 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 09:26:21.383400 tst ussd:nanobts+band-1900: Using 1 x modem (candidates: 1) 09:26:21.500481 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:26:21.991422 run create_hlr_db(pid=1073): Launched 09:26:22.118467 bus /sierra_2: Setting Powered False 09:26:23.181688 run create_hlr_db(pid=1073): Terminated: ok {rc=0} 09:26:23.622938 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1075): Launched 09:26:23.940749 run osmo-hlr_10.42.42.2(pid=1076): Launched 09:26:24.062412 run osmo-stp_10.42.42.5: Starting osmo-stp 09:26:24.614517 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1078): Launched 09:26:24.932427 run osmo-stp_10.42.42.5(pid=1079): Launched 09:26:25.053705 run osmo-msc_10.42.42.6: Starting osmo-msc 09:26:25.625864 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1081): Launched 09:26:25.943798 run osmo-msc_10.42.42.6(pid=1082): Launched 09:26:26.121074 run osmo-stp_10.42.42.5(pid=1079): ERR: Terminated: ERROR {rc=1} [trial-2402↪ussd:nanobts+band-1900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1079)] 09:26:26.254288 run osmo-stp_10.42.42.5(pid=1079): stdout: | (launched: 2022-12-14_09:26:24.873772) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:26:26.388292 run osmo-stp_10.42.42.5(pid=1079): stderr: | 20221214092625063 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214092625063 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214092625063 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214092625064 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214092625064 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214092625064 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214092625064 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:26:26.521117 run osmo-stp_10.42.42.5(pid=1079): stdout: | (launched: 2022-12-14_09:26:24.873772) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:26:26.647180 run osmo-stp_10.42.42.5(pid=1079): stderr: | 20221214092625063 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214092625063 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214092625063 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214092625064 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214092625064 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214092625064 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214092625064 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:26:26.797412 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=1079): Process ended prematurely: osmo-stp_10.42.42.5(pid=1079) [trial-2402↪ussd:nanobts+band-1900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1079)] [trial-2402↪ussd:nanobts+band-1900↪assert_extension.py:17] 09:26:26.806496 tst assert_extension.py:17: Test FAILED (6.0 sec) 09:26:26.833806 run osmo-hlr_10.42.42.2(pid=1076): ERR: Terminated: ERROR {rc=237} [trial-2402↪ussd:nanobts+band-1900↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1076)] 09:26:26.884148 run osmo-hlr_10.42.42.2(pid=1076): stdout: | (launched: 2022-12-14_09:26:23.882282) 09:26:26.936147 run osmo-hlr_10.42.42.2(pid=1076): stderr: | 20221214092624076 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214092624076 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214092624077 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214092624077 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214092624077 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214092624077 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214092624090 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/ussd:nanobts+band-1900/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214092624098 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214092624098 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214092624098 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:26:27.008236 run osmo-msc_10.42.42.6(pid=1082): ERR: Terminated: ERROR {rc=2} [trial-2402↪ussd:nanobts+band-1900↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1082)] 09:26:27.058398 run osmo-msc_10.42.42.6(pid=1082): stdout: | (launched: 2022-12-14_09:26:25.885071) 09:26:27.110154 run osmo-msc_10.42.42.6(pid=1082): stderr: | 20221214092626202 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214092626203 DLGLOBAL DEBUG validating counter group 0x7f7427b98c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214092626203 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214092626203 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214092626203 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214092626203 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214092626205 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214092626205 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214092626205 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214092626206 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:26:27.162493 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1075): Terminating (SIGTERM) 09:26:27.204130 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1078): Terminating (SIGTERM) 09:26:27.245790 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1081): Terminating (SIGTERM) 09:26:27.287547 --- ParallelTerminationStrategy: PID 1075 died... 09:26:27.307129 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1075): Terminated: ok {rc=0} 09:26:27.352837 --- ParallelTerminationStrategy: PID 1078 died... 09:26:27.372710 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1078): Terminated: ok {rc=0} 09:26:27.418822 --- ParallelTerminationStrategy: PID 1081 died... 09:26:27.438400 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1081): Terminated: ok {rc=0} 09:26:27.524501 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2402 ussd:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 09:26:28.723110 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:26:28.730906 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 09:26:28.754730 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 09:26:28.782319 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 09:26:28.834180 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 09:26:28.859065 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 09:26:28.886578 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 09:26:29.435008 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2402 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 09:26:29.483967 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:26:29.495356 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 09:26:29.554132 tst mo_mt_call.py: using LAC 39971 09:26:29.673786 tst mo_mt_call.py: using RAC 191 09:26:29.802754 tst mo_mt_call.py: using CellId 39971 09:26:29.931611 tst mo_mt_call.py: using BVCI 39972 09:26:30.049200 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:26:30.061146 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:26:30.072783 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:26:30.084337 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:26:30.096002 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:26:30.107637 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 09:26:30.224140 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 09:26:30.343528 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:26:30.849173 run create_hlr_db(pid=1087): Launched 09:26:31.018122 bus /sierra_2: Setting Powered False 09:26:32.077181 run create_hlr_db(pid=1087): Terminated: ok {rc=0} 09:26:32.541435 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1089): Launched 09:26:32.863692 run osmo-hlr_10.42.42.2(pid=1090): Launched 09:26:32.988631 run osmo-stp_10.42.42.5: Starting osmo-stp 09:26:33.546002 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1092): Launched 09:26:33.868493 run osmo-stp_10.42.42.5(pid=1093): Launched 09:26:33.992677 run osmo-msc_10.42.42.6: Starting osmo-msc 09:26:34.575036 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1095): Launched 09:26:34.897255 run osmo-msc_10.42.42.6(pid=1096): Launched 09:26:35.078226 run osmo-stp_10.42.42.5(pid=1093): ERR: Terminated: ERROR {rc=1} [trial-2402↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1093)] 09:26:35.213322 run osmo-stp_10.42.42.5(pid=1093): stdout: | (launched: 2022-12-14_09:26:33.808918) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:26:35.349118 run osmo-stp_10.42.42.5(pid=1093): stderr: | 20221214092633999 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214092633999 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214092634000 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214092634000 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214092634001 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214092634001 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214092634001 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:26:35.483568 run osmo-stp_10.42.42.5(pid=1093): stdout: | (launched: 2022-12-14_09:26:33.808918) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:26:35.611681 run osmo-stp_10.42.42.5(pid=1093): stderr: | 20221214092633999 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214092633999 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214092634000 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214092634000 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214092634001 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214092634001 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214092634001 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:26:35.764500 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1093): Process ended prematurely: osmo-stp_10.42.42.5(pid=1093) [trial-2402↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1093)] [trial-2402↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 09:26:35.774223 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 09:26:35.801935 run osmo-hlr_10.42.42.2(pid=1090): ERR: Terminated: ERROR {rc=237} [trial-2402↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1090)] 09:26:35.852023 run osmo-hlr_10.42.42.2(pid=1090): stdout: | (launched: 2022-12-14_09:26:32.803841) 09:26:35.903535 run osmo-hlr_10.42.42.2(pid=1090): stderr: | 20221214092632999 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214092633000 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214092633000 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214092633000 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214092633000 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214092633000 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214092633012 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214092633020 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214092633020 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214092633020 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:26:35.975543 run osmo-msc_10.42.42.6(pid=1096): ERR: Terminated: ERROR {rc=2} [trial-2402↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1096)] 09:26:36.025517 run osmo-msc_10.42.42.6(pid=1096): stdout: | (launched: 2022-12-14_09:26:34.837439) 09:26:36.077141 run osmo-msc_10.42.42.6(pid=1096): stderr: | 20221214092635155 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214092635155 DLGLOBAL DEBUG validating counter group 0x7f6fa3b27c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214092635155 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214092635155 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214092635155 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214092635155 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214092635157 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214092635158 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214092635158 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214092635158 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:26:36.129056 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1089): Terminating (SIGTERM) 09:26:36.170405 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1092): Terminating (SIGTERM) 09:26:36.211752 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1095): Terminating (SIGTERM) 09:26:36.253297 --- ParallelTerminationStrategy: PID 1089 died... 09:26:36.273241 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1089): Terminated: ok {rc=0} 09:26:36.319194 --- ParallelTerminationStrategy: PID 1092 died... 09:26:36.338715 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1092): Terminated: ok {rc=0} 09:26:36.384364 --- ParallelTerminationStrategy: PID 1095 died... 09:26:36.403882 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1095): Terminated: ok {rc=0} 09:26:36.490997 bus /sierra_3: Setting Powered False 09:26:37.589348 bus /sierra_3: Setting Powered False 09:26:38.705094 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2402 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 09:26:39.853222 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:26:39.865664 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 09:26:39.927257 tst mo_mt_call_osmux.py: using LAC 39972 09:26:40.053952 tst mo_mt_call_osmux.py: using RAC 192 09:26:40.186828 tst mo_mt_call_osmux.py: using CellId 39972 09:26:40.324146 tst mo_mt_call_osmux.py: using BVCI 39973 09:26:40.435032 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:26:40.446436 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:26:40.457779 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:26:40.468926 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:26:40.480701 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:26:40.492788 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 09:26:40.611713 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 09:26:40.729489 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:26:41.199200 run create_hlr_db(pid=1098): Launched 09:26:41.316403 bus /sierra_2: Setting Powered False 09:26:42.376641 run create_hlr_db(pid=1098): Terminated: ok {rc=0} 09:26:42.817494 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1100): Launched 09:26:43.142267 run osmo-hlr_10.42.42.2(pid=1101): Launched 09:26:43.266961 run osmo-stp_10.42.42.5: Starting osmo-stp 09:26:43.827986 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1103): Launched 09:26:44.151078 run osmo-stp_10.42.42.5(pid=1104): Launched 09:26:44.273356 run osmo-msc_10.42.42.6: Starting osmo-msc 09:26:44.861962 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1106): Launched 09:26:45.185226 run osmo-msc_10.42.42.6(pid=1107): Launched 09:26:45.364863 run osmo-stp_10.42.42.5(pid=1104): ERR: Terminated: ERROR {rc=1} [trial-2402↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1104)] 09:26:45.500661 run osmo-stp_10.42.42.5(pid=1104): stdout: | (launched: 2022-12-14_09:26:44.091671) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:26:45.637700 run osmo-stp_10.42.42.5(pid=1104): stderr: | 20221214092644279 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214092644279 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214092644280 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214092644280 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214092644281 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214092644281 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214092644281 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:26:45.772119 run osmo-stp_10.42.42.5(pid=1104): stdout: | (launched: 2022-12-14_09:26:44.091671) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:26:45.923063 run osmo-stp_10.42.42.5(pid=1104): stderr: | 20221214092644279 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214092644279 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214092644280 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214092644280 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214092644281 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214092644281 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214092644281 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:26:46.082418 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1104): Process ended prematurely: osmo-stp_10.42.42.5(pid=1104) [trial-2402↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1104)] [trial-2402↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 09:26:46.093803 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 09:26:46.121875 run osmo-hlr_10.42.42.2(pid=1101): ERR: Terminated: ERROR {rc=237} [trial-2402↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1101)] 09:26:46.173350 run osmo-hlr_10.42.42.2(pid=1101): stdout: | (launched: 2022-12-14_09:26:43.082759) 09:26:46.225986 run osmo-hlr_10.42.42.2(pid=1101): stderr: | 20221214092643277 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214092643277 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214092643277 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214092643277 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214092643277 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214092643278 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214092643293 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214092643301 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214092643301 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214092643301 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:26:46.298856 run osmo-msc_10.42.42.6(pid=1107): ERR: Terminated: ERROR {rc=2} [trial-2402↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1107)] 09:26:46.348143 run osmo-msc_10.42.42.6(pid=1107): stdout: | (launched: 2022-12-14_09:26:45.125627) 09:26:46.400434 run osmo-msc_10.42.42.6(pid=1107): stderr: | 20221214092645444 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214092645444 DLGLOBAL DEBUG validating counter group 0x7f533cfa4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214092645445 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214092645445 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214092645445 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214092645445 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214092645447 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214092645447 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214092645447 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214092645447 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:26:46.452525 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1100): Terminating (SIGTERM) 09:26:46.496347 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1103): Terminating (SIGTERM) 09:26:46.541087 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1106): Terminating (SIGTERM) 09:26:46.586228 --- ParallelTerminationStrategy: PID 1100 died... 09:26:46.607645 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1100): Terminated: ok {rc=0} 09:26:46.656932 --- ParallelTerminationStrategy: PID 1103 died... 09:26:46.677892 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1103): Terminated: ok {rc=0} 09:26:46.726803 --- ParallelTerminationStrategy: PID 1106 died... 09:26:46.747233 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1106): Terminated: ok {rc=0} 09:26:46.839735 bus /sierra_3: Setting Powered False 09:26:47.938658 bus /sierra_3: Setting Powered False 09:26:49.050744 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2402 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 09:26:50.301583 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:26:50.310017 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 09:26:50.334292 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 09:26:50.361772 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 09:26:50.415387 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 09:26:50.439882 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 09:26:50.466872 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 09:26:51.016892 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2402 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 09:26:51.069545 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:26:51.081378 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 09:26:51.142287 tst mo_mt_call.py: using LAC 39973 09:26:51.269621 tst mo_mt_call.py: using RAC 193 09:26:51.390955 tst mo_mt_call.py: using CellId 39973 09:26:51.511829 tst mo_mt_call.py: using BVCI 39974 09:26:51.621961 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:26:51.634113 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:26:51.645309 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:26:51.656432 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:26:51.667993 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:26:51.679536 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 09:26:51.795585 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 09:26:51.915605 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:26:52.414717 run create_hlr_db(pid=1112): Launched 09:26:52.545790 bus /sierra_2: Setting Powered False 09:26:53.609934 run create_hlr_db(pid=1112): Terminated: ok {rc=0} 09:26:54.040559 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1115): Launched 09:26:54.342650 run osmo-hlr_10.42.42.2(pid=1116): Launched 09:26:54.459458 run osmo-stp_10.42.42.5: Starting osmo-stp 09:26:54.992169 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1118): Launched 09:26:55.294326 run osmo-stp_10.42.42.5(pid=1120): Launched 09:26:55.411807 run osmo-msc_10.42.42.6: Starting osmo-msc 09:26:55.958403 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1122): Launched 09:26:56.260627 run osmo-msc_10.42.42.6(pid=1123): Launched 09:26:56.430380 run osmo-stp_10.42.42.5(pid=1120): ERR: Terminated: ERROR {rc=1} [trial-2402↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1120)] 09:26:56.558120 run osmo-stp_10.42.42.5(pid=1120): stdout: | (launched: 2022-12-14_09:26:55.238137) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:26:56.685429 run osmo-stp_10.42.42.5(pid=1120): stderr: | 20221214092655406 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214092655406 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214092655406 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214092655407 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214092655407 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214092655407 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214092655407 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:26:56.811539 run osmo-stp_10.42.42.5(pid=1120): stdout: | (launched: 2022-12-14_09:26:55.238137) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:26:56.931176 run osmo-stp_10.42.42.5(pid=1120): stderr: | 20221214092655406 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214092655406 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214092655406 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214092655407 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214092655407 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214092655407 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214092655407 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:26:57.074714 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1120): Process ended prematurely: osmo-stp_10.42.42.5(pid=1120) [trial-2402↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1120)] [trial-2402↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 09:26:57.083571 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 09:26:57.110041 run osmo-hlr_10.42.42.2(pid=1116): ERR: Terminated: ERROR {rc=237} [trial-2402↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1116)] 09:26:57.158002 run osmo-hlr_10.42.42.2(pid=1116): stdout: | (launched: 2022-12-14_09:26:54.286656) 09:26:57.207259 run osmo-hlr_10.42.42.2(pid=1116): stderr: | 20221214092654457 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214092654457 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214092654457 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214092654457 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214092654457 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214092654457 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214092654470 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214092654478 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214092654478 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214092654478 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:26:57.276424 run osmo-msc_10.42.42.6(pid=1123): ERR: Terminated: ERROR {rc=2} [trial-2402↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1123)] 09:26:57.323486 run osmo-msc_10.42.42.6(pid=1123): stdout: | (launched: 2022-12-14_09:26:56.204428) 09:26:57.372720 run osmo-msc_10.42.42.6(pid=1123): stderr: | 20221214092656472 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214092656473 DLGLOBAL DEBUG validating counter group 0x7f78896d7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214092656473 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214092656473 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214092656473 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214092656473 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214092656475 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214092656475 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214092656476 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214092656476 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:26:57.422072 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1115): Terminating (SIGTERM) 09:26:57.461724 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1118): Terminating (SIGTERM) 09:26:57.501461 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1122): Terminating (SIGTERM) 09:26:57.541486 --- ParallelTerminationStrategy: PID 1115 died... 09:26:57.560811 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1115): Terminated: ok {rc=0} 09:26:57.605085 --- ParallelTerminationStrategy: PID 1118 died... 09:26:57.623944 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1118): Terminated: ok {rc=0} 09:26:57.668111 --- ParallelTerminationStrategy: PID 1122 died... 09:26:57.686975 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1122): Terminated: ok {rc=0} 09:26:57.770358 bus /sierra_3: Setting Powered False 09:26:58.868382 bus /sierra_3: Setting Powered False 09:26:59.983969 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2402 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 09:27:01.160859 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:27:01.178297 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 09:27:01.251193 tst mo_mt_call_osmux.py: using LAC 39974 09:27:01.410465 tst mo_mt_call_osmux.py: using RAC 194 09:27:01.562119 tst mo_mt_call_osmux.py: using CellId 39974 09:27:01.685285 tst mo_mt_call_osmux.py: using BVCI 39975 09:27:01.832614 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:27:01.845421 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:27:01.857642 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:27:01.869879 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:27:01.883902 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:27:01.898255 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 09:27:02.037110 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 09:27:02.184743 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:27:02.701199 run create_hlr_db(pid=1129): Launched 09:27:02.831908 bus /sierra_2: Setting Powered False 09:27:03.896777 run create_hlr_db(pid=1129): Terminated: ok {rc=0} 09:27:04.328008 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1131): Launched 09:27:04.630915 run osmo-hlr_10.42.42.2(pid=1132): Launched 09:27:04.746212 run osmo-stp_10.42.42.5: Starting osmo-stp 09:27:05.271026 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1139): Launched 09:27:05.572728 run osmo-stp_10.42.42.5(pid=1140): Launched 09:27:05.687276 run osmo-msc_10.42.42.6: Starting osmo-msc 09:27:06.235672 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1142): Launched 09:27:06.537931 run osmo-msc_10.42.42.6(pid=1144): Launched 09:27:06.707237 run osmo-stp_10.42.42.5(pid=1140): ERR: Terminated: ERROR {rc=1} [trial-2402↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1140)] 09:27:06.836244 run osmo-stp_10.42.42.5(pid=1140): stdout: | (launched: 2022-12-14_09:27:05.516661) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:27:06.964252 run osmo-stp_10.42.42.5(pid=1140): stderr: | 20221214092705685 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214092705685 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214092705685 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214092705686 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214092705686 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214092705686 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214092705686 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:27:07.090361 run osmo-stp_10.42.42.5(pid=1140): stdout: | (launched: 2022-12-14_09:27:05.516661) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:27:07.210907 run osmo-stp_10.42.42.5(pid=1140): stderr: | 20221214092705685 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214092705685 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214092705685 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214092705686 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214092705686 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214092705686 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214092705686 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:27:07.355298 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1140): Process ended prematurely: osmo-stp_10.42.42.5(pid=1140) [trial-2402↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1140)] [trial-2402↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 09:27:07.364494 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 09:27:07.391098 run osmo-hlr_10.42.42.2(pid=1132): ERR: Terminated: ERROR {rc=237} [trial-2402↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1132)] 09:27:07.439601 run osmo-hlr_10.42.42.2(pid=1132): stdout: | (launched: 2022-12-14_09:27:04.574822) 09:27:07.489329 run osmo-hlr_10.42.42.2(pid=1132): stderr: | 20221214092704752 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214092704752 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214092704752 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214092704752 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214092704752 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214092704752 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214092704764 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214092704773 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214092704773 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214092704774 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:27:07.558880 run osmo-msc_10.42.42.6(pid=1144): ERR: Terminated: ERROR {rc=2} [trial-2402↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1144)] 09:27:07.606472 run osmo-msc_10.42.42.6(pid=1144): stdout: | (launched: 2022-12-14_09:27:06.481325) 09:27:07.656087 run osmo-msc_10.42.42.6(pid=1144): stderr: | 20221214092706752 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214092706753 DLGLOBAL DEBUG validating counter group 0x7fe75c488c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214092706753 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214092706753 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214092706753 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214092706753 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214092706755 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214092706755 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214092706755 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214092706756 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:27:07.706195 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1131): Terminating (SIGTERM) 09:27:07.746063 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1139): Terminating (SIGTERM) 09:27:07.785768 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1142): Terminating (SIGTERM) 09:27:07.825546 --- ParallelTerminationStrategy: PID 1131 died... 09:27:07.845160 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1131): Terminated: ok {rc=0} 09:27:07.889405 --- ParallelTerminationStrategy: PID 1139 died... 09:27:07.908333 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1139): Terminated: ok {rc=0} 09:27:07.952489 --- ParallelTerminationStrategy: PID 1142 died... 09:27:07.971574 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1142): Terminated: ok {rc=0} 09:27:08.057452 bus /sierra_3: Setting Powered False 09:27:09.156182 bus /sierra_3: Setting Powered False 09:27:10.269385 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2402 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 09:27:11.510910 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:27:11.519188 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 09:27:11.543989 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 09:27:11.571909 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 09:27:11.624546 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 09:27:11.649220 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 09:27:11.676476 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 09:27:12.230154 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2402 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 09:27:12.282196 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:27:12.293996 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 09:27:12.361337 tst mo_mt_call.py: using LAC 39975 09:27:12.488219 tst mo_mt_call.py: using RAC 195 09:27:12.607707 tst mo_mt_call.py: using CellId 39975 09:27:12.726361 tst mo_mt_call.py: using BVCI 39976 09:27:12.838451 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:27:12.849909 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:27:12.861198 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:27:12.872396 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:27:12.884309 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:27:12.896066 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 09:27:13.017055 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 09:27:13.137588 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:27:13.636781 run create_hlr_db(pid=1149): Launched 09:27:13.768919 bus /sierra_2: Setting Powered False 09:27:14.833075 run create_hlr_db(pid=1149): Terminated: ok {rc=0} 09:27:15.281623 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1151): Launched 09:27:15.605191 run osmo-hlr_10.42.42.2(pid=1152): Launched 09:27:15.728440 run osmo-stp_10.42.42.5: Starting osmo-stp 09:27:16.316414 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1154): Launched 09:27:16.641967 run osmo-stp_10.42.42.5(pid=1155): Launched 09:27:16.881952 run osmo-msc_10.42.42.6: Starting osmo-msc 09:27:17.571080 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1157): Launched 09:27:17.875113 run osmo-msc_10.42.42.6(pid=1158): Launched 09:27:18.046014 run osmo-stp_10.42.42.5(pid=1155): ERR: Terminated: ERROR {rc=1} [trial-2402↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1155)] 09:27:18.173780 run osmo-stp_10.42.42.5(pid=1155): stdout: | (launched: 2022-12-14_09:27:16.584023) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:27:18.301161 run osmo-stp_10.42.42.5(pid=1155): stderr: | 20221214092716913 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214092716914 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214092716914 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214092716914 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214092716915 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214092716915 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214092716915 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:27:18.427629 run osmo-stp_10.42.42.5(pid=1155): stdout: | (launched: 2022-12-14_09:27:16.584023) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:27:18.547741 run osmo-stp_10.42.42.5(pid=1155): stderr: | 20221214092716913 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214092716914 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214092716914 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214092716914 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214092716915 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214092716915 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214092716915 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:27:18.692023 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1155): Process ended prematurely: osmo-stp_10.42.42.5(pid=1155) [trial-2402↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1155)] [trial-2402↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 09:27:18.701284 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 09:27:18.727770 run osmo-hlr_10.42.42.2(pid=1152): ERR: Terminated: ERROR {rc=237} [trial-2402↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1152)] 09:27:18.775998 run osmo-hlr_10.42.42.2(pid=1152): stdout: | (launched: 2022-12-14_09:27:15.545703) 09:27:18.825642 run osmo-hlr_10.42.42.2(pid=1152): stderr: | 20221214092715743 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214092715743 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214092715743 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214092715743 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214092715743 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214092715743 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214092715756 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214092715764 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214092715765 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214092715765 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:27:18.895681 run osmo-msc_10.42.42.6(pid=1158): ERR: Terminated: ERROR {rc=2} [trial-2402↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1158)] 09:27:18.943233 run osmo-msc_10.42.42.6(pid=1158): stdout: | (launched: 2022-12-14_09:27:17.818545) 09:27:18.992674 run osmo-msc_10.42.42.6(pid=1158): stderr: | 20221214092718088 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214092718088 DLGLOBAL DEBUG validating counter group 0x7fd5c5e26c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214092718088 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214092718088 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214092718088 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214092718089 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214092718090 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214092718091 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214092718091 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214092718091 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:27:19.042337 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1151): Terminating (SIGTERM) 09:27:19.082368 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1154): Terminating (SIGTERM) 09:27:19.122395 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1157): Terminating (SIGTERM) 09:27:19.162745 --- ParallelTerminationStrategy: PID 1151 died... 09:27:19.182138 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1151): Terminated: ok {rc=0} 09:27:19.226589 --- ParallelTerminationStrategy: PID 1154 died... 09:27:19.245878 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1154): Terminated: ok {rc=0} 09:27:19.290008 --- ParallelTerminationStrategy: PID 1157 died... 09:27:19.309258 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1157): Terminated: ok {rc=0} 09:27:19.395557 bus /sierra_3: Setting Powered False 09:27:20.493930 bus /sierra_3: Setting Powered False 09:27:21.608252 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2402 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 09:27:22.758423 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:27:22.770953 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 09:27:22.833105 tst mo_mt_call_osmux.py: using LAC 39976 09:27:22.959048 tst mo_mt_call_osmux.py: using RAC 196 09:27:23.086051 tst mo_mt_call_osmux.py: using CellId 39976 09:27:23.214857 tst mo_mt_call_osmux.py: using BVCI 39977 09:27:23.333519 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:27:23.345464 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:27:23.357096 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:27:23.368693 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:27:23.380438 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:27:23.392091 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 09:27:23.511340 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 09:27:23.629228 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:27:24.098459 run create_hlr_db(pid=1160): Launched 09:27:24.215757 bus /sierra_2: Setting Powered False 09:27:25.275411 run create_hlr_db(pid=1160): Terminated: ok {rc=0} 09:27:25.714570 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1162): Launched 09:27:26.038592 run osmo-hlr_10.42.42.2(pid=1163): Launched 09:27:26.163114 run osmo-stp_10.42.42.5: Starting osmo-stp 09:27:26.719166 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1165): Launched 09:27:27.041698 run osmo-stp_10.42.42.5(pid=1166): Launched 09:27:27.165817 run osmo-msc_10.42.42.6: Starting osmo-msc 09:27:27.756234 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1168): Launched 09:27:28.081717 run osmo-msc_10.42.42.6(pid=1169): Launched 09:27:28.263007 run osmo-stp_10.42.42.5(pid=1166): ERR: Terminated: ERROR {rc=1} [trial-2402↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1166)] 09:27:28.398457 run osmo-stp_10.42.42.5(pid=1166): stdout: | (launched: 2022-12-14_09:27:26.982276) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:27:28.534688 run osmo-stp_10.42.42.5(pid=1166): stderr: | 20221214092727172 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214092727173 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214092727173 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214092727173 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214092727174 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214092727174 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214092727174 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:27:28.669888 run osmo-stp_10.42.42.5(pid=1166): stdout: | (launched: 2022-12-14_09:27:26.982276) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:27:28.798593 run osmo-stp_10.42.42.5(pid=1166): stderr: | 20221214092727172 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214092727173 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214092727173 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214092727173 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214092727174 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214092727174 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214092727174 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:27:28.953265 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1166): Process ended prematurely: osmo-stp_10.42.42.5(pid=1166) [trial-2402↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1166)] [trial-2402↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 09:27:28.963280 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 09:27:28.991419 run osmo-hlr_10.42.42.2(pid=1163): ERR: Terminated: ERROR {rc=237} [trial-2402↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1163)] 09:27:29.041895 run osmo-hlr_10.42.42.2(pid=1163): stdout: | (launched: 2022-12-14_09:27:25.979253) 09:27:29.093851 run osmo-hlr_10.42.42.2(pid=1163): stderr: | 20221214092726173 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214092726173 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214092726173 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214092726173 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214092726173 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214092726173 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214092726186 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214092726195 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214092726195 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214092726195 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:27:29.166450 run osmo-msc_10.42.42.6(pid=1169): ERR: Terminated: ERROR {rc=2} [trial-2402↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1169)] 09:27:29.216159 run osmo-msc_10.42.42.6(pid=1169): stdout: | (launched: 2022-12-14_09:27:28.021382) 09:27:29.267636 run osmo-msc_10.42.42.6(pid=1169): stderr: | 20221214092728341 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214092728342 DLGLOBAL DEBUG validating counter group 0x7f65bc3a6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214092728342 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214092728342 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214092728342 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214092728342 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214092728344 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214092728345 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214092728345 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214092728345 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:27:29.319499 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1162): Terminating (SIGTERM) 09:27:29.361720 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1165): Terminating (SIGTERM) 09:27:29.403337 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1168): Terminating (SIGTERM) 09:27:29.445383 --- ParallelTerminationStrategy: PID 1162 died... 09:27:29.465626 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1162): Terminated: ok {rc=0} 09:27:29.512275 --- ParallelTerminationStrategy: PID 1165 died... 09:27:29.532244 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1165): Terminated: ok {rc=0} 09:27:29.578359 --- ParallelTerminationStrategy: PID 1168 died... 09:27:29.598299 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1168): Terminated: ok {rc=0} 09:27:29.686017 bus /sierra_3: Setting Powered False 09:27:30.783693 bus /sierra_3: Setting Powered False 09:27:31.914117 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2402 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 09:27:33.158193 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:27:33.165666 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 09:27:33.189134 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 09:27:33.217319 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 09:27:33.269118 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 09:27:33.292503 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 09:27:33.319955 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 09:27:33.871071 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2402 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 09:27:33.920524 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:27:33.932110 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 09:27:33.992572 tst mo_mt_call.py: using LAC 39977 09:27:34.111928 tst mo_mt_call.py: using RAC 197 09:27:34.232079 tst mo_mt_call.py: using CellId 39977 09:27:34.350319 tst mo_mt_call.py: using BVCI 39978 09:27:34.468124 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:27:34.480106 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:27:34.491904 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:27:34.504021 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:27:34.515882 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:27:34.527613 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 09:27:34.644804 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 09:27:34.765086 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:27:35.264424 run create_hlr_db(pid=1176): Launched 09:27:35.395109 bus /sierra_2: Setting Powered False 09:27:36.457961 run create_hlr_db(pid=1176): Terminated: ok {rc=0} 09:27:36.887388 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1178): Launched 09:27:37.190025 run osmo-hlr_10.42.42.2(pid=1179): Launched 09:27:37.304727 run osmo-stp_10.42.42.5: Starting osmo-stp 09:27:37.835472 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1181): Launched 09:27:38.137314 run osmo-stp_10.42.42.5(pid=1182): Launched 09:27:38.251431 run osmo-msc_10.42.42.6: Starting osmo-msc 09:27:38.798879 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1184): Launched 09:27:39.101431 run osmo-msc_10.42.42.6(pid=1185): Launched 09:27:39.269200 run osmo-stp_10.42.42.5(pid=1182): ERR: Terminated: ERROR {rc=1} [trial-2402↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1182)] 09:27:39.396508 run osmo-stp_10.42.42.5(pid=1182): stdout: | (launched: 2022-12-14_09:27:38.081134) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:27:39.523493 run osmo-stp_10.42.42.5(pid=1182): stderr: | 20221214092738248 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214092738249 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214092738249 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214092738249 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214092738250 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214092738250 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214092738250 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:27:39.649278 run osmo-stp_10.42.42.5(pid=1182): stdout: | (launched: 2022-12-14_09:27:38.081134) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:27:39.768552 run osmo-stp_10.42.42.5(pid=1182): stderr: | 20221214092738248 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214092738249 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214092738249 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214092738249 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214092738250 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214092738250 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214092738250 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:27:39.911514 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1182): Process ended prematurely: osmo-stp_10.42.42.5(pid=1182) [trial-2402↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1182)] [trial-2402↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 09:27:39.920543 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 09:27:39.946893 run osmo-hlr_10.42.42.2(pid=1179): ERR: Terminated: ERROR {rc=237} [trial-2402↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1179)] 09:27:39.995525 run osmo-hlr_10.42.42.2(pid=1179): stdout: | (launched: 2022-12-14_09:27:37.134087) 09:27:40.044901 run osmo-hlr_10.42.42.2(pid=1179): stderr: | 20221214092737306 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214092737306 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214092737306 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214092737306 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214092737306 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214092737306 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214092737319 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214092737329 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214092737329 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214092737330 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:27:40.114268 run osmo-msc_10.42.42.6(pid=1185): ERR: Terminated: ERROR {rc=2} [trial-2402↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1185)] 09:27:40.161378 run osmo-msc_10.42.42.6(pid=1185): stdout: | (launched: 2022-12-14_09:27:39.045381) 09:27:40.210449 run osmo-msc_10.42.42.6(pid=1185): stderr: | 20221214092739313 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214092739313 DLGLOBAL DEBUG validating counter group 0x7fc642459c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214092739313 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214092739314 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214092739314 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214092739314 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214092739315 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214092739316 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214092739316 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214092739316 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:27:40.259736 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1178): Terminating (SIGTERM) 09:27:40.299500 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1181): Terminating (SIGTERM) 09:27:40.339071 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1184): Terminating (SIGTERM) 09:27:40.378976 --- ParallelTerminationStrategy: PID 1178 died... 09:27:40.398397 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1178): Terminated: ok {rc=0} 09:27:40.442356 --- ParallelTerminationStrategy: PID 1181 died... 09:27:40.461224 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1181): Terminated: ok {rc=0} 09:27:40.505095 --- ParallelTerminationStrategy: PID 1184 died... 09:27:40.523837 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1184): Terminated: ok {rc=0} 09:27:40.609865 bus /sierra_3: Setting Powered False 09:27:41.708332 bus /sierra_3: Setting Powered False 09:27:42.822197 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2402 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 09:27:43.970646 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:27:43.983157 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 09:27:44.044330 tst mo_mt_call_osmux.py: using LAC 39978 09:27:44.168572 tst mo_mt_call_osmux.py: using RAC 198 09:27:44.285914 tst mo_mt_call_osmux.py: using CellId 39978 09:27:44.405624 tst mo_mt_call_osmux.py: using BVCI 39979 09:27:44.523338 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:27:44.535227 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:27:44.546936 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:27:44.558605 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:27:44.570372 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:27:44.582092 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 09:27:44.699602 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 09:27:44.819220 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:27:45.321874 run create_hlr_db(pid=1187): Launched 09:27:45.453924 bus /sierra_2: Setting Powered False 09:27:46.518269 run create_hlr_db(pid=1187): Terminated: ok {rc=0} 09:27:46.985468 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1189): Launched 09:27:47.296339 run osmo-hlr_10.42.42.2(pid=1190): Launched 09:27:47.412100 run osmo-stp_10.42.42.5: Starting osmo-stp 09:27:47.950154 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1192): Launched 09:27:48.254022 run osmo-stp_10.42.42.5(pid=1193): Launched 09:27:48.371946 run osmo-msc_10.42.42.6: Starting osmo-msc 09:27:48.920044 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1195): Launched 09:27:49.222740 run osmo-msc_10.42.42.6(pid=1196): Launched 09:27:49.393123 run osmo-stp_10.42.42.5(pid=1193): ERR: Terminated: ERROR {rc=1} [trial-2402↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1193)] 09:27:49.520348 run osmo-stp_10.42.42.5(pid=1193): stdout: | (launched: 2022-12-14_09:27:48.197759) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:27:49.648122 run osmo-stp_10.42.42.5(pid=1193): stderr: | 20221214092748366 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214092748366 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214092748366 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214092748367 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214092748367 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214092748367 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214092748367 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:27:49.774204 run osmo-stp_10.42.42.5(pid=1193): stdout: | (launched: 2022-12-14_09:27:48.197759) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:27:49.894239 run osmo-stp_10.42.42.5(pid=1193): stderr: | 20221214092748366 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214092748366 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214092748366 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214092748367 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214092748367 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214092748367 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214092748367 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:27:50.038023 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1193): Process ended prematurely: osmo-stp_10.42.42.5(pid=1193) [trial-2402↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1193)] [trial-2402↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 09:27:50.047288 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 09:27:50.074284 run osmo-hlr_10.42.42.2(pid=1190): ERR: Terminated: ERROR {rc=237} [trial-2402↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1190)] 09:27:50.122731 run osmo-hlr_10.42.42.2(pid=1190): stdout: | (launched: 2022-12-14_09:27:47.240321) 09:27:50.172415 run osmo-hlr_10.42.42.2(pid=1190): stderr: | 20221214092747413 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214092747413 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214092747413 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214092747413 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214092747413 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214092747413 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214092747426 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214092747434 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214092747435 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214092747435 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:27:50.242038 run osmo-msc_10.42.42.6(pid=1196): ERR: Terminated: ERROR {rc=2} [trial-2402↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1196)] 09:27:50.289430 run osmo-msc_10.42.42.6(pid=1196): stdout: | (launched: 2022-12-14_09:27:49.166558) 09:27:50.339028 run osmo-msc_10.42.42.6(pid=1196): stderr: | 20221214092749433 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214092749433 DLGLOBAL DEBUG validating counter group 0x7f564ff5ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214092749433 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214092749433 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214092749433 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214092749434 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214092749435 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214092749436 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214092749436 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214092749436 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:27:50.389182 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1189): Terminating (SIGTERM) 09:27:50.429327 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1192): Terminating (SIGTERM) 09:27:50.469230 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1195): Terminating (SIGTERM) 09:27:50.509358 --- ParallelTerminationStrategy: PID 1189 died... 09:27:50.529058 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1189): Terminated: ok {rc=0} 09:27:50.573360 --- ParallelTerminationStrategy: PID 1192 died... 09:27:50.592488 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1192): Terminated: ok {rc=0} 09:27:50.636465 --- ParallelTerminationStrategy: PID 1195 died... 09:27:50.655392 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1195): Terminated: ok {rc=0} 09:27:50.742270 bus /sierra_3: Setting Powered False 09:27:51.840812 bus /sierra_3: Setting Powered False 09:27:52.956781 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2402 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 09:27:54.194806 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:27:54.202297 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 09:27:54.225757 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 09:27:54.253180 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 09:27:54.306471 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 09:27:54.332149 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 09:27:54.361111 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 09:27:54.909902 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2402 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 09:27:54.959673 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:27:54.971216 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 09:27:55.030892 tst mo_mt_call.py: using LAC 39979 09:27:55.148751 tst mo_mt_call.py: using RAC 199 09:27:55.267916 tst mo_mt_call.py: using CellId 39979 09:27:55.397105 tst mo_mt_call.py: using BVCI 39980 09:27:55.514808 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:27:55.526850 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:27:55.538710 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:27:55.550495 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:27:55.563018 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:27:55.575202 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 09:27:55.693223 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 09:27:55.810820 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:27:56.280357 run create_hlr_db(pid=1201): Launched 09:27:56.396047 bus /sierra_2: Setting Powered False 09:27:57.456844 run create_hlr_db(pid=1201): Terminated: ok {rc=0} 09:27:57.876714 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1203): Launched 09:27:58.179563 run osmo-hlr_10.42.42.2(pid=1204): Launched 09:27:58.294551 run osmo-stp_10.42.42.5: Starting osmo-stp 09:27:58.817105 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1206): Launched 09:27:59.118868 run osmo-stp_10.42.42.5(pid=1207): Launched 09:27:59.235999 run osmo-msc_10.42.42.6: Starting osmo-msc 09:27:59.785261 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1209): Launched 09:28:00.087623 run osmo-msc_10.42.42.6(pid=1210): Launched 09:28:00.257532 run osmo-stp_10.42.42.5(pid=1207): ERR: Terminated: ERROR {rc=1} [trial-2402↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1207)] 09:28:00.385084 run osmo-stp_10.42.42.5(pid=1207): stdout: | (launched: 2022-12-14_09:27:59.062691) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:28:00.512837 run osmo-stp_10.42.42.5(pid=1207): stderr: | 20221214092759229 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214092759229 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214092759229 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214092759230 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214092759230 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214092759230 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214092759230 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:28:00.638434 run osmo-stp_10.42.42.5(pid=1207): stdout: | (launched: 2022-12-14_09:27:59.062691) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:28:00.758051 run osmo-stp_10.42.42.5(pid=1207): stderr: | 20221214092759229 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214092759229 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214092759229 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214092759230 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214092759230 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214092759230 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214092759230 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:28:00.933540 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1207): Process ended prematurely: osmo-stp_10.42.42.5(pid=1207) [trial-2402↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1207)] [trial-2402↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 09:28:00.943481 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 09:28:00.971129 run osmo-hlr_10.42.42.2(pid=1204): ERR: Terminated: ERROR {rc=237} [trial-2402↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1204)] 09:28:01.025812 run osmo-hlr_10.42.42.2(pid=1204): stdout: | (launched: 2022-12-14_09:27:58.123451) 09:28:01.076295 run osmo-hlr_10.42.42.2(pid=1204): stderr: | 20221214092758295 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214092758295 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214092758295 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214092758295 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214092758295 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214092758295 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214092758307 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214092758316 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214092758316 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214092758316 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:28:01.148538 run osmo-msc_10.42.42.6(pid=1210): ERR: Terminated: ERROR {rc=2} [trial-2402↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1210)] 09:28:01.197258 run osmo-msc_10.42.42.6(pid=1210): stdout: | (launched: 2022-12-14_09:28:00.031563) 09:28:01.248802 run osmo-msc_10.42.42.6(pid=1210): stderr: | 20221214092800299 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214092800300 DLGLOBAL DEBUG validating counter group 0x7f52db1a7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214092800300 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214092800300 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214092800300 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214092800300 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214092800302 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214092800302 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214092800302 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214092800302 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:28:01.300736 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1203): Terminating (SIGTERM) 09:28:01.342769 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1206): Terminating (SIGTERM) 09:28:01.383883 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1209): Terminating (SIGTERM) 09:28:01.425434 --- ParallelTerminationStrategy: PID 1203 died... 09:28:01.446244 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1203): Terminated: ok {rc=0} 09:28:01.492342 --- ParallelTerminationStrategy: PID 1206 died... 09:28:01.513097 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1206): Terminated: ok {rc=0} 09:28:01.558896 --- ParallelTerminationStrategy: PID 1209 died... 09:28:01.579466 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1209): Terminated: ok {rc=0} 09:28:01.666827 bus /sierra_3: Setting Powered False 09:28:02.764394 bus /sierra_3: Setting Powered False 09:28:03.876458 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2402 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 09:28:05.024830 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:28:05.037678 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 09:28:05.099590 tst mo_mt_call_osmux.py: using LAC 39980 09:28:05.227490 tst mo_mt_call_osmux.py: using RAC 200 09:28:05.348678 tst mo_mt_call_osmux.py: using CellId 39980 09:28:05.470294 tst mo_mt_call_osmux.py: using BVCI 39981 09:28:05.580592 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:28:05.592035 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:28:05.603346 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:28:05.614678 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:28:05.626492 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:28:05.638194 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 09:28:05.753710 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 09:28:05.875605 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:28:06.377133 run create_hlr_db(pid=1212): Launched 09:28:06.509245 bus /sierra_2: Setting Powered False 09:28:07.573403 run create_hlr_db(pid=1212): Terminated: ok {rc=0} 09:28:08.004683 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1214): Launched 09:28:08.309710 run osmo-hlr_10.42.42.2(pid=1215): Launched 09:28:08.425850 run osmo-stp_10.42.42.5: Starting osmo-stp 09:28:08.951759 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1217): Launched 09:28:09.254660 run osmo-stp_10.42.42.5(pid=1218): Launched 09:28:09.371527 run osmo-msc_10.42.42.6: Starting osmo-msc 09:28:09.919686 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1220): Launched 09:28:10.223223 run osmo-msc_10.42.42.6(pid=1221): Launched 09:28:10.393860 run osmo-stp_10.42.42.5(pid=1218): ERR: Terminated: ERROR {rc=1} [trial-2402↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1218)] 09:28:10.521944 run osmo-stp_10.42.42.5(pid=1218): stdout: | (launched: 2022-12-14_09:28:09.198463) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:28:10.649633 run osmo-stp_10.42.42.5(pid=1218): stderr: | 20221214092809365 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214092809365 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214092809365 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214092809366 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214092809366 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214092809366 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214092809366 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:28:10.775740 run osmo-stp_10.42.42.5(pid=1218): stdout: | (launched: 2022-12-14_09:28:09.198463) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:28:10.895701 run osmo-stp_10.42.42.5(pid=1218): stderr: | 20221214092809365 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214092809365 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214092809365 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214092809366 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214092809366 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214092809366 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214092809366 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:28:11.039665 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1218): Process ended prematurely: osmo-stp_10.42.42.5(pid=1218) [trial-2402↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1218)] [trial-2402↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 09:28:11.048787 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 09:28:11.075374 run osmo-hlr_10.42.42.2(pid=1215): ERR: Terminated: ERROR {rc=237} [trial-2402↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1215)] 09:28:11.124019 run osmo-hlr_10.42.42.2(pid=1215): stdout: | (launched: 2022-12-14_09:28:08.252787) 09:28:11.173568 run osmo-hlr_10.42.42.2(pid=1215): stderr: | 20221214092808425 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214092808425 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214092808425 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214092808425 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214092808425 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214092808425 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214092808438 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214092808447 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214092808447 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214092808447 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:28:11.243321 run osmo-msc_10.42.42.6(pid=1221): ERR: Terminated: ERROR {rc=2} [trial-2402↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1221)] 09:28:11.290992 run osmo-msc_10.42.42.6(pid=1221): stdout: | (launched: 2022-12-14_09:28:10.166211) 09:28:11.340870 run osmo-msc_10.42.42.6(pid=1221): stderr: | 20221214092810433 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214092810433 DLGLOBAL DEBUG validating counter group 0x7f18ba607c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214092810433 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214092810433 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214092810433 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214092810433 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214092810435 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214092810435 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214092810436 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214092810436 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:28:11.391210 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1214): Terminating (SIGTERM) 09:28:11.431173 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1217): Terminating (SIGTERM) 09:28:11.471115 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1220): Terminating (SIGTERM) 09:28:11.511243 --- ParallelTerminationStrategy: PID 1214 died... 09:28:11.531004 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1214): Terminated: ok {rc=0} 09:28:11.575496 --- ParallelTerminationStrategy: PID 1217 died... 09:28:11.594755 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1217): Terminated: ok {rc=0} 09:28:11.639035 --- ParallelTerminationStrategy: PID 1220 died... 09:28:11.658333 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1220): Terminated: ok {rc=0} 09:28:11.745675 bus /sierra_3: Setting Powered False 09:28:12.844248 bus /sierra_3: Setting Powered False 09:28:13.959829 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2402 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 emergency:nanobts+band-1900 --------------------------------------------------------------------- 09:28:15.198059 tst emergency:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:28:15.203574 tst emergency:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 09:28:15.227056 tst emergency:nanobts+band-1900: Verifying 6 x ip_address (candidates: 9) 09:28:15.254560 tst emergency:nanobts+band-1900: Verifying 4 x modem (candidates: 12) 09:28:15.338248 tst emergency:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 09:28:15.361904 tst emergency:nanobts+band-1900: Reserving 6 x ip_address (candidates: 9) 09:28:15.388392 tst emergency:nanobts+band-1900: Reserving 4 x modem (candidates: 12) 09:28:15.989492 tst emergency:nanobts+band-1900: RESERVED RESOURCES for emergency: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2402 emergency:nanobts+band-1900 emergency_mo_mt_call.py ---------------------------------------------- 09:28:15.995147 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 09:28:16.014236 tst emergency:nanobts+band-1900: Using 1 x bts (candidates: 1) 09:28:16.057603 tst emergency_mo_mt_call.py: using LAC 39981 09:28:16.226631 tst emergency_mo_mt_call.py: using RAC 201 09:28:16.354442 tst emergency_mo_mt_call.py: using CellId 39981 09:28:16.481105 tst emergency_mo_mt_call.py: using BVCI 39982 09:28:16.601726 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 09:28:16.613833 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 09:28:16.626602 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 09:28:16.638671 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 09:28:16.650753 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 09:28:16.663095 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 09:28:16.789788 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 09:28:16.912892 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:28:17.396825 run create_hlr_db(pid=1226): Launched 09:28:17.524469 bus /sierra_2: Setting Powered False 09:28:18.586722 run create_hlr_db(pid=1226): Terminated: ok {rc=0} 09:28:19.023960 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1228): Launched 09:28:19.336442 run osmo-hlr_10.42.42.2(pid=1229): Launched 09:28:19.454320 run osmo-stp_10.42.42.5: Starting osmo-stp 09:28:20.000238 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1232): Launched 09:28:20.313679 run osmo-stp_10.42.42.5(pid=1233): Launched 09:28:20.442189 tst emergency_mo_mt_call.py: using MSISDN 8609 09:28:20.602620 run osmo-msc_10.42.42.6: Starting osmo-msc 09:28:21.167608 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1235): Launched 09:28:21.481641 run osmo-msc_10.42.42.6(pid=1236): Launched 09:28:21.655975 run osmo-stp_10.42.42.5(pid=1233): ERR: Terminated: ERROR {rc=1} [trial-2402↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1233)] 09:28:21.788304 run osmo-stp_10.42.42.5(pid=1233): stdout: | (launched: 2022-12-14_09:28:20.255604) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:28:21.921753 run osmo-stp_10.42.42.5(pid=1233): stderr: | 20221214092820443 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214092820443 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214092820443 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214092820444 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214092820444 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214092820444 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214092820444 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:28:22.054221 run osmo-stp_10.42.42.5(pid=1233): stdout: | (launched: 2022-12-14_09:28:20.255604) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:28:22.179267 run osmo-stp_10.42.42.5(pid=1233): stderr: | 20221214092820443 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214092820443 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214092820443 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214092820444 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214092820444 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214092820444 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214092820444 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:28:22.329006 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=1233): Process ended prematurely: osmo-stp_10.42.42.5(pid=1233) [trial-2402↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1233)] [trial-2402↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19] 09:28:22.338278 tst emergency_mo_mt_call.py:19: Test FAILED (6.3 sec) 09:28:22.365786 run osmo-hlr_10.42.42.2(pid=1229): ERR: Terminated: ERROR {rc=237} [trial-2402↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1229)] 09:28:22.416211 run osmo-hlr_10.42.42.2(pid=1229): stdout: | (launched: 2022-12-14_09:28:19.278891) 09:28:22.468122 run osmo-hlr_10.42.42.2(pid=1229): stderr: | 20221214092819470 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214092819470 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214092819470 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214092819470 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214092819470 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214092819470 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214092819483 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/emergency:nanobts+band-1900/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214092819491 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214092819491 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214092819491 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:28:22.540743 run osmo-msc_10.42.42.6(pid=1236): ERR: Terminated: ERROR {rc=2} [trial-2402↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1236)] 09:28:22.590673 run osmo-msc_10.42.42.6(pid=1236): stdout: | (launched: 2022-12-14_09:28:21.423176) 09:28:22.642244 run osmo-msc_10.42.42.6(pid=1236): stderr: | 20221214092821743 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214092821744 DLGLOBAL DEBUG validating counter group 0x7f9c2dfb1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214092821744 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214092821744 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214092821744 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214092821744 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214092821746 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214092821746 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214092821746 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214092821746 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:28:22.694036 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1228): Terminating (SIGTERM) 09:28:22.735507 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1232): Terminating (SIGTERM) 09:28:22.776998 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1235): Terminating (SIGTERM) 09:28:22.819322 --- ParallelTerminationStrategy: PID 1228 died... 09:28:22.839481 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1228): Terminated: ok {rc=0} 09:28:22.885330 --- ParallelTerminationStrategy: PID 1232 died... 09:28:22.904851 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1232): Terminated: ok {rc=0} 09:28:22.951345 --- ParallelTerminationStrategy: PID 1235 died... 09:28:22.970934 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1235): Terminated: ok {rc=0} 09:28:23.058090 bus /sierra_3: Setting Powered False 09:28:24.156212 bus /sierra_3: Setting Powered False 09:28:25.272778 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2402 emergency:nanobts+band-1900 emergency_preemptive_call.py ---------------------------------------------- 09:28:26.359396 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 09:28:26.371561 tst emergency:nanobts+band-1900: Using 1 x bts (candidates: 1) 09:28:26.416880 tst emergency_preemptive_call.py: using LAC 39982 09:28:26.533336 tst emergency_preemptive_call.py: using RAC 202 09:28:26.646975 tst emergency_preemptive_call.py: using CellId 39982 09:28:26.761165 tst emergency_preemptive_call.py: using BVCI 39983 09:28:26.867742 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 09:28:26.878856 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 09:28:26.889868 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 09:28:26.900612 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 09:28:26.912003 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 09:28:26.923197 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 09:28:27.037463 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 09:28:27.151843 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 09:28:27.270451 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 09:28:27.389142 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:28:27.879506 run create_hlr_db(pid=1238): Launched 09:28:28.008191 bus /sierra_2: Setting Powered False 09:28:29.070814 run create_hlr_db(pid=1238): Terminated: ok {rc=0} 09:28:29.492646 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1240): Launched 09:28:29.787359 run osmo-hlr_10.42.42.2(pid=1241): Launched 09:28:29.898551 run osmo-stp_10.42.42.5: Starting osmo-stp 09:28:30.419614 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1243): Launched 09:28:30.713392 run osmo-stp_10.42.42.5(pid=1244): Launched 09:28:30.849362 tst emergency_preemptive_call.py: using MSISDN 8610 09:28:31.054288 run osmo-msc_10.42.42.6: Starting osmo-msc 09:28:31.642287 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1246): Launched 09:28:31.976229 run osmo-msc_10.42.42.6(pid=1247): Launched 09:28:32.268728 run osmo-stp_10.42.42.5(pid=1244): ERR: Terminated: ERROR {rc=1} [trial-2402↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1244)] 09:28:32.404301 run osmo-stp_10.42.42.5(pid=1244): stdout: | (launched: 2022-12-14_09:28:30.658417) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:28:32.535831 run osmo-stp_10.42.42.5(pid=1244): stderr: | 20221214092830822 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214092830822 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214092830822 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214092830823 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214092830823 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214092830823 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214092830823 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:28:32.667033 run osmo-stp_10.42.42.5(pid=1244): stdout: | (launched: 2022-12-14_09:28:30.658417) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:28:32.791326 run osmo-stp_10.42.42.5(pid=1244): stderr: | 20221214092830822 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214092830822 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214092830822 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214092830823 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214092830823 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214092830823 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214092830823 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:28:32.940598 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=1244): Process ended prematurely: osmo-stp_10.42.42.5(pid=1244) [trial-2402↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1244)] [trial-2402↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32] 09:28:32.949464 tst emergency_preemptive_call.py:32: Test FAILED (6.6 sec) 09:28:32.977064 run osmo-hlr_10.42.42.2(pid=1241): ERR: Terminated: ERROR {rc=237} [trial-2402↪emergency:nanobts+band-1900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1241)] 09:28:33.027081 run osmo-hlr_10.42.42.2(pid=1241): stdout: | (launched: 2022-12-14_09:28:29.732483) 09:28:33.078672 run osmo-hlr_10.42.42.2(pid=1241): stderr: | 20221214092829902 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214092829903 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214092829903 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214092829903 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214092829903 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214092829903 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214092829918 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/emergency:nanobts+band-1900/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214092829929 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214092829929 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214092829929 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:28:33.150954 run osmo-msc_10.42.42.6(pid=1247): ERR: Terminated: ERROR {rc=2} [trial-2402↪emergency:nanobts+band-1900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1247)] 09:28:33.201160 run osmo-msc_10.42.42.6(pid=1247): stdout: | (launched: 2022-12-14_09:28:31.916584) 09:28:33.252591 run osmo-msc_10.42.42.6(pid=1247): stderr: | 20221214092832314 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214092832314 DLGLOBAL DEBUG validating counter group 0x7f352668cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214092832314 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214092832314 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214092832315 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214092832315 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214092832317 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214092832317 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214092832317 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214092832317 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:28:33.304490 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1240): Terminating (SIGTERM) 09:28:33.345948 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1243): Terminating (SIGTERM) 09:28:33.387377 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1246): Terminating (SIGTERM) 09:28:33.429164 --- ParallelTerminationStrategy: PID 1240 died... 09:28:33.449057 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1240): Terminated: ok {rc=0} 09:28:33.494837 --- ParallelTerminationStrategy: PID 1243 died... 09:28:33.514236 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1243): Terminated: ok {rc=0} 09:28:33.559781 --- ParallelTerminationStrategy: PID 1246 died... 09:28:33.579491 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1246): Terminated: ok {rc=0} 09:28:33.666802 bus /sierra_9: Setting Powered False 09:28:34.764729 bus /sierra_9: Setting Powered False 09:28:35.880703 bus /sierra_8: Setting Powered False 09:28:36.978742 bus /sierra_8: Setting Powered False 09:28:38.092707 bus /sierra_3: Setting Powered False 09:28:39.191064 bus /sierra_3: Setting Powered False 09:28:40.305137 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2402 emergency:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 gprs:nanobts+band-1900 --------------------------------------------------------------------- 09:28:41.573607 tst gprs:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:28:41.578970 tst gprs:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 09:28:41.602226 tst gprs:nanobts+band-1900: Verifying 9 x ip_address (candidates: 9) 09:28:41.641364 tst gprs:nanobts+band-1900: Verifying 4 x modem (candidates: 12) 09:28:41.728084 tst gprs:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 09:28:41.752873 tst gprs:nanobts+band-1900: Reserving 9 x ip_address (candidates: 9) 09:28:41.792571 tst gprs:nanobts+band-1900: Reserving 4 x modem (candidates: 12) 09:28:42.378915 tst gprs:nanobts+band-1900: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2402 gprs:nanobts+band-1900 cs_paging_gprs_active.py ---------------------------------------------- 09:28:42.428014 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 09:28:42.438857 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 09:28:42.477185 tst cs_paging_gprs_active.py: using LAC 39983 09:28:42.597364 tst cs_paging_gprs_active.py: using RAC 203 09:28:42.727073 tst cs_paging_gprs_active.py: using CellId 39983 09:28:42.852423 tst cs_paging_gprs_active.py: using BVCI 39984 09:28:42.968939 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 09:28:42.980305 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 09:28:42.991588 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 09:28:43.002833 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 09:28:43.013773 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 09:28:43.024831 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 09:28:43.036021 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 09:28:43.047006 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 09:28:43.058492 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 09:28:43.175192 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 09:28:43.292730 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 09:28:43.508844 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:28:43.830404 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1252): Launched 09:28:44.111231 run iperf3-srv_10.42.42.10(pid=1253): Launched 09:28:44.231293 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 09:28:44.447265 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:28:44.770338 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1254): Launched 09:28:45.050616 run iperf3-srv_10.42.42.10(pid=1255): Launched 09:28:45.170998 tst cs_paging_gprs_active.py:38: start network... 09:28:45.387244 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:28:45.898605 run create_hlr_db(pid=1256): Launched 09:28:46.065364 bus /sierra_2: Setting Powered False 09:28:47.142864 run create_hlr_db(pid=1256): Terminated: ok {rc=0} 09:28:47.597390 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1258): Launched 09:28:47.918142 run osmo-hlr_10.42.42.2(pid=1259): Launched 09:28:48.040106 run osmo-stp_10.42.42.5: Starting osmo-stp 09:28:48.591962 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1261): Launched 09:28:48.913746 run osmo-stp_10.42.42.5(pid=1262): Launched 09:28:49.035243 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:28:49.587511 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1264): Launched 09:28:49.709976 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:28:49.981754 run patchelf(pid=1265): Launched 09:28:50.159430 run osmo-stp_10.42.42.5(pid=1262): ERR: Terminated: ERROR {rc=1} [trial-2402↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1262)] 09:28:50.294894 run osmo-stp_10.42.42.5(pid=1262): stdout: | (launched: 2022-12-14_09:28:48.854530) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:28:50.431697 run osmo-stp_10.42.42.5(pid=1262): stderr: | 20221214092849043 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214092849043 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214092849043 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214092849043 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214092849044 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214092849044 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214092849044 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:28:50.569271 run osmo-stp_10.42.42.5(pid=1262): stdout: | (launched: 2022-12-14_09:28:48.854530) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:28:50.701051 run osmo-stp_10.42.42.5(pid=1262): stderr: | 20221214092849043 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214092849043 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214092849043 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214092849043 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214092849044 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214092849044 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214092849044 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:28:50.856689 run patchelf(pid=1265): Terminating (SIGINT) 09:28:51.036332 run patchelf(pid=1265): Terminated: ok {rc=0} 09:28:51.165166 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=1262): Process ended prematurely: osmo-stp_10.42.42.5(pid=1262) [trial-2402↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1262)] [trial-2402↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38] 09:28:51.175238 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 09:28:51.203413 run osmo-hlr_10.42.42.2(pid=1259): ERR: Terminated: ERROR {rc=237} [trial-2402↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1259)] 09:28:51.253191 run osmo-hlr_10.42.42.2(pid=1259): stdout: | (launched: 2022-12-14_09:28:47.858456) 09:28:51.304555 run osmo-hlr_10.42.42.2(pid=1259): stderr: | 20221214092848052 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214092848052 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214092848052 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214092848052 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214092848052 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214092848052 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214092848105 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/gprs:nanobts+band-1900/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214092848116 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214092848116 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214092848116 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:28:51.356242 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1252): Terminating (SIGTERM) 09:28:51.398112 run iperf3-srv_10.42.42.10(pid=1253): Terminating (SIGTERM) 09:28:51.439776 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1254): Terminating (SIGTERM) 09:28:51.481686 run iperf3-srv_10.42.42.10(pid=1255): Terminating (SIGTERM) 09:28:51.523331 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1258): Terminating (SIGTERM) 09:28:51.565136 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1261): Terminating (SIGTERM) 09:28:51.606870 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1264): Terminating (SIGTERM) 09:28:51.648758 --- ParallelTerminationStrategy: PID 1252 died... 09:28:51.669102 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1252): Terminated: ok {rc=0} 09:28:51.715430 --- ParallelTerminationStrategy: PID 1253 died... 09:28:51.734996 run iperf3-srv_10.42.42.10(pid=1253): Terminated {rc=256} 09:28:51.780806 --- ParallelTerminationStrategy: PID 1254 died... 09:28:51.801004 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1254): Terminated: ok {rc=0} 09:28:51.846975 --- ParallelTerminationStrategy: PID 1255 died... 09:28:51.866680 run iperf3-srv_10.42.42.10(pid=1255): Terminated {rc=256} 09:28:51.912468 --- ParallelTerminationStrategy: PID 1258 died... 09:28:51.932368 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1258): Terminated: ok {rc=0} 09:28:51.978123 --- ParallelTerminationStrategy: PID 1261 died... 09:28:51.997863 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1261): Terminated: ok {rc=0} 09:28:52.043572 --- ParallelTerminationStrategy: PID 1264 died... 09:28:52.063313 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1264): Terminated: ok {rc=0} 09:28:52.150626 bus /gobi_0: Setting Powered False 09:28:53.248661 bus /gobi_0: Setting Powered False 09:28:54.363887 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2402 gprs:nanobts+band-1900 iperf3.py ---------------------------------------------- 09:28:55.510799 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 09:28:55.522520 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 09:28:55.560721 tst iperf3.py: using LAC 39984 09:28:55.685207 tst iperf3.py: using RAC 204 09:28:55.809396 tst iperf3.py: using CellId 39984 09:28:55.936061 tst iperf3.py: using BVCI 39985 09:28:56.052523 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 09:28:56.063951 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 09:28:56.075364 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 09:28:56.086396 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 09:28:56.097315 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 09:28:56.108179 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 09:28:56.119277 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 09:28:56.130389 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 09:28:56.141575 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 09:28:56.258889 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 09:28:56.459326 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:28:56.761596 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1266): Launched 09:28:57.022909 run iperf3-srv_10.42.42.10(pid=1267): Launched 09:28:57.135820 tst iperf3.py:8: start network... 09:28:57.335432 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:28:57.802063 run create_hlr_db(pid=1268): Launched 09:28:57.916751 bus /gobi_6: Setting Powered False 09:28:58.975599 run create_hlr_db(pid=1268): Terminated: ok {rc=0} 09:28:59.413374 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1270): Launched 09:28:59.733649 run osmo-hlr_10.42.42.2(pid=1271): Launched 09:28:59.855932 run osmo-stp_10.42.42.5: Starting osmo-stp 09:29:00.408152 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1273): Launched 09:29:00.728272 run osmo-stp_10.42.42.5(pid=1274): Launched 09:29:00.907261 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:29:01.566230 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1276): Launched 09:29:01.692560 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:29:01.971794 run patchelf(pid=1277): Launched 09:29:02.163437 run osmo-stp_10.42.42.5(pid=1274): ERR: Terminated: ERROR {rc=1} [trial-2402↪gprs:nanobts+band-1900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1274)] 09:29:02.299503 run osmo-stp_10.42.42.5(pid=1274): stdout: | (launched: 2022-12-14_09:29:00.668928) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:29:02.436193 run osmo-stp_10.42.42.5(pid=1274): stderr: | 20221214092900857 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214092900857 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214092900857 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214092900857 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214092900858 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214092900858 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214092900858 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:29:02.572879 run osmo-stp_10.42.42.5(pid=1274): stdout: | (launched: 2022-12-14_09:29:00.668928) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:29:02.704314 run osmo-stp_10.42.42.5(pid=1274): stderr: | 20221214092900857 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214092900857 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214092900857 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214092900857 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214092900858 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214092900858 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214092900858 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:29:02.859629 run patchelf(pid=1277): Terminating (SIGINT) 09:29:03.038771 run patchelf(pid=1277): Terminated: ok {rc=0} 09:29:03.167833 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1274): Process ended prematurely: osmo-stp_10.42.42.5(pid=1274) [trial-2402↪gprs:nanobts+band-1900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1274)] [trial-2402↪gprs:nanobts+band-1900↪iperf3.py:8] 09:29:03.178316 tst iperf3.py:8: Test FAILED (7.7 sec) 09:29:03.206900 run osmo-hlr_10.42.42.2(pid=1271): ERR: Terminated: ERROR {rc=237} [trial-2402↪gprs:nanobts+band-1900↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1271)] 09:29:03.257280 run osmo-hlr_10.42.42.2(pid=1271): stdout: | (launched: 2022-12-14_09:28:59.674560) 09:29:03.309455 run osmo-hlr_10.42.42.2(pid=1271): stderr: | 20221214092859866 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214092859866 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214092859866 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214092859866 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214092859866 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214092859866 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214092859879 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/gprs:nanobts+band-1900/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214092859887 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214092859888 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214092859888 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:29:03.361835 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1266): Terminating (SIGTERM) 09:29:03.403859 run iperf3-srv_10.42.42.10(pid=1267): Terminating (SIGTERM) 09:29:03.445986 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1270): Terminating (SIGTERM) 09:29:03.488171 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1273): Terminating (SIGTERM) 09:29:03.530459 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1276): Terminating (SIGTERM) 09:29:03.572607 --- ParallelTerminationStrategy: PID 1266 died... 09:29:03.593107 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1266): Terminated: ok {rc=0} 09:29:03.639541 --- ParallelTerminationStrategy: PID 1267 died... 09:29:03.659276 run iperf3-srv_10.42.42.10(pid=1267): Terminated {rc=256} 09:29:03.705432 --- ParallelTerminationStrategy: PID 1270 died... 09:29:03.725083 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1270): Terminated: ok {rc=0} 09:29:03.771215 --- ParallelTerminationStrategy: PID 1273 died... 09:29:03.790930 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1273): Terminated: ok {rc=0} 09:29:03.837345 --- ParallelTerminationStrategy: PID 1276 died... 09:29:03.856745 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1276): Terminated: ok {rc=0} 09:29:03.945256 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2402 gprs:nanobts+band-1900 iperf3m4.py ---------------------------------------------- 09:29:05.094316 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 09:29:05.106204 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 09:29:05.146857 tst iperf3m4.py: using LAC 39985 09:29:05.275777 tst iperf3m4.py: using RAC 205 09:29:05.401319 tst iperf3m4.py: using CellId 39985 09:29:05.526284 tst iperf3m4.py: using BVCI 39986 09:29:05.642921 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 09:29:05.654189 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 09:29:05.665363 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 09:29:05.676441 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 09:29:05.688101 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 09:29:05.699777 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 09:29:05.711596 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 09:29:05.723162 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 09:29:05.734890 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 09:29:05.855300 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 09:29:05.974079 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 09:29:06.091884 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 09:29:06.211601 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 09:29:06.428008 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:29:06.752802 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1278): Launched 09:29:07.032531 run iperf3-srv_10.42.42.10(pid=1279): Launched 09:29:07.153224 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 09:29:07.368315 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:29:07.690946 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1280): Launched 09:29:07.970888 run iperf3-srv_10.42.42.10(pid=1281): Launched 09:29:08.091694 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 09:29:08.306949 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:29:08.629856 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1282): Launched 09:29:08.910425 run iperf3-srv_10.42.42.10(pid=1283): Launched 09:29:09.030696 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 09:29:09.246104 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:29:09.568668 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1284): Launched 09:29:09.847833 run iperf3-srv_10.42.42.10(pid=1285): Launched 09:29:09.968335 tst iperf3m4.py:8: start network... 09:29:10.184151 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:29:10.685420 run create_hlr_db(pid=1286): Launched 09:29:10.815707 bus /gobi_6: Setting Powered False 09:29:11.878947 run create_hlr_db(pid=1286): Terminated: ok {rc=0} 09:29:12.325618 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1288): Launched 09:29:12.647139 run osmo-hlr_10.42.42.2(pid=1289): Launched 09:29:12.772028 run osmo-stp_10.42.42.5: Starting osmo-stp 09:29:13.324355 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1291): Launched 09:29:13.646401 run osmo-stp_10.42.42.5(pid=1292): Launched 09:29:13.770506 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:29:14.324042 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1294): Launched 09:29:14.448248 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:29:14.719663 run patchelf(pid=1295): Launched 09:29:14.899668 run osmo-stp_10.42.42.5(pid=1292): ERR: Terminated: ERROR {rc=1} [trial-2402↪gprs:nanobts+band-1900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1292)] 09:29:15.035390 run osmo-stp_10.42.42.5(pid=1292): stdout: | (launched: 2022-12-14_09:29:13.586875) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:29:15.172399 run osmo-stp_10.42.42.5(pid=1292): stderr: | 20221214092913775 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214092913776 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214092913776 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214092913776 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214092913777 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214092913777 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214092913777 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:29:15.309370 run osmo-stp_10.42.42.5(pid=1292): stdout: | (launched: 2022-12-14_09:29:13.586875) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:29:15.440713 run osmo-stp_10.42.42.5(pid=1292): stderr: | 20221214092913775 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214092913776 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214092913776 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214092913776 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214092913777 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214092913777 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214092913777 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:29:15.595828 run patchelf(pid=1295): Terminating (SIGINT) 09:29:15.774569 run patchelf(pid=1295): Terminated: ok {rc=0} 09:29:15.905067 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1292): Process ended prematurely: osmo-stp_10.42.42.5(pid=1292) [trial-2402↪gprs:nanobts+band-1900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1292)] [trial-2402↪gprs:nanobts+band-1900↪iperf3m4.py:8] 09:29:15.915764 tst iperf3m4.py:8: Test FAILED (10.9 sec) 09:29:15.952249 run osmo-hlr_10.42.42.2(pid=1289): ERR: Terminated: ERROR {rc=237} [trial-2402↪gprs:nanobts+band-1900↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1289)] 09:29:16.002294 run osmo-hlr_10.42.42.2(pid=1289): stdout: | (launched: 2022-12-14_09:29:12.587283) 09:29:16.062753 run osmo-hlr_10.42.42.2(pid=1289): stderr: | 20221214092912781 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214092912781 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214092912782 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214092912782 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214092912782 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214092912782 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214092912794 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/gprs:nanobts+band-1900/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214092912803 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214092912803 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214092912803 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:29:16.116939 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1278): Terminating (SIGTERM) 09:29:16.159525 run iperf3-srv_10.42.42.10(pid=1279): Terminating (SIGTERM) 09:29:16.201874 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1280): Terminating (SIGTERM) 09:29:16.244857 run iperf3-srv_10.42.42.10(pid=1281): Terminating (SIGTERM) 09:29:16.290574 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1282): Terminating (SIGTERM) 09:29:16.333919 run iperf3-srv_10.42.42.10(pid=1283): Terminating (SIGTERM) 09:29:16.376697 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1284): Terminating (SIGTERM) 09:29:16.419297 run iperf3-srv_10.42.42.10(pid=1285): Terminating (SIGTERM) 09:29:16.461762 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1288): Terminating (SIGTERM) 09:29:16.504289 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1291): Terminating (SIGTERM) 09:29:16.547234 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1294): Terminating (SIGTERM) 09:29:16.590089 --- ParallelTerminationStrategy: PID 1278 died... 09:29:16.610534 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1278): Terminated: ok {rc=0} 09:29:16.659063 --- ParallelTerminationStrategy: PID 1279 died... 09:29:16.679318 run iperf3-srv_10.42.42.10(pid=1279): Terminated {rc=256} 09:29:16.726840 --- ParallelTerminationStrategy: PID 1280 died... 09:29:16.748292 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1280): Terminated: ok {rc=0} 09:29:16.794268 --- ParallelTerminationStrategy: PID 1281 died... 09:29:16.814623 run iperf3-srv_10.42.42.10(pid=1281): Terminated {rc=256} 09:29:16.860830 --- ParallelTerminationStrategy: PID 1282 died... 09:29:16.881611 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1282): Terminated: ok {rc=0} 09:29:16.928299 --- ParallelTerminationStrategy: PID 1283 died... 09:29:16.949310 run iperf3-srv_10.42.42.10(pid=1283): Terminated {rc=256} 09:29:16.995405 --- ParallelTerminationStrategy: PID 1284 died... 09:29:17.016179 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1284): Terminated: ok {rc=0} 09:29:17.062758 --- ParallelTerminationStrategy: PID 1285 died... 09:29:17.083553 run iperf3-srv_10.42.42.10(pid=1285): Terminated {rc=256} 09:29:17.130289 --- ParallelTerminationStrategy: PID 1288 died... 09:29:17.150370 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1288): Terminated: ok {rc=0} 09:29:17.195733 --- ParallelTerminationStrategy: PID 1291 died... 09:29:17.215756 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1291): Terminated: ok {rc=0} 09:29:17.260712 --- ParallelTerminationStrategy: PID 1294 died... 09:29:17.280159 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1294): Terminated: ok {rc=0} 09:29:17.366722 bus /gobi_4: Setting Powered False 09:29:18.465106 bus /gobi_4: Setting Powered False 09:29:19.579007 bus /gobi_1: Setting Powered False 09:29:20.676084 bus /gobi_1: Setting Powered False 09:29:21.789325 bus /gobi_0: Setting Powered False 09:29:22.886880 bus /gobi_0: Setting Powered False 09:29:24.000107 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2402 gprs:nanobts+band-1900 ping.py ---------------------------------------------- 09:29:25.102909 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 09:29:25.114319 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 09:29:25.153218 tst ping.py: using LAC 39986 09:29:25.278974 tst ping.py: using RAC 206 09:29:25.399794 tst ping.py: using CellId 39986 09:29:25.517373 tst ping.py: using BVCI 39987 09:29:25.623821 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 09:29:25.634800 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 09:29:25.645534 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 09:29:25.656134 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 09:29:25.667183 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 09:29:25.678065 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 09:29:25.689122 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 09:29:25.700051 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 09:29:25.812833 tst ping.py:19: start network... 09:29:26.024661 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:29:26.513507 run create_hlr_db(pid=1296): Launched 09:29:26.642402 bus /gobi_6: Setting Powered False 09:29:27.704596 run create_hlr_db(pid=1296): Terminated: ok {rc=0} 09:29:28.125171 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1298): Launched 09:29:28.419508 run osmo-hlr_10.42.42.2(pid=1299): Launched 09:29:28.530824 run osmo-stp_10.42.42.5: Starting osmo-stp 09:29:29.048218 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1301): Launched 09:29:29.343232 run osmo-stp_10.42.42.5(pid=1302): Launched 09:29:29.454820 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:29:29.963440 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1304): Launched 09:29:30.075664 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:29:30.326370 run patchelf(pid=1305): Launched 09:29:30.490413 run osmo-stp_10.42.42.5(pid=1302): ERR: Terminated: ERROR {rc=1} [trial-2402↪gprs:nanobts+band-1900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1302)] 09:29:30.615636 run osmo-stp_10.42.42.5(pid=1302): stdout: | (launched: 2022-12-14_09:29:29.287932) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:29:30.742230 run osmo-stp_10.42.42.5(pid=1302): stderr: | 20221214092929452 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214092929452 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214092929453 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214092929453 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214092929454 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214092929454 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214092929454 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:29:30.887050 run osmo-stp_10.42.42.5(pid=1302): stdout: | (launched: 2022-12-14_09:29:29.287932) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:29:31.010734 run osmo-stp_10.42.42.5(pid=1302): stderr: | 20221214092929452 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214092929452 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214092929453 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214092929453 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214092929454 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214092929454 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214092929454 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:29:31.157197 run patchelf(pid=1305): Terminating (SIGINT) 09:29:31.326160 run patchelf(pid=1305): Terminated: ok {rc=0} 09:29:31.448669 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=1302): Process ended prematurely: osmo-stp_10.42.42.5(pid=1302) [trial-2402↪gprs:nanobts+band-1900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1302)] [trial-2402↪gprs:nanobts+band-1900↪ping.py:22] 09:29:31.458691 tst ping.py:22: Test FAILED (6.3 sec) 09:29:31.486644 run osmo-hlr_10.42.42.2(pid=1299): ERR: Terminated: ERROR {rc=237} [trial-2402↪gprs:nanobts+band-1900↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1299)] 09:29:31.538088 run osmo-hlr_10.42.42.2(pid=1299): stdout: | (launched: 2022-12-14_09:29:28.364217) 09:29:31.591105 run osmo-hlr_10.42.42.2(pid=1299): stderr: | 20221214092928534 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214092928534 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214092928534 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214092928534 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214092928534 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214092928534 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214092928547 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/gprs:nanobts+band-1900/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214092928556 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214092928556 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214092928556 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:29:31.642654 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1298): Terminating (SIGTERM) 09:29:31.684492 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1301): Terminating (SIGTERM) 09:29:31.726043 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1304): Terminating (SIGTERM) 09:29:31.768713 --- ParallelTerminationStrategy: PID 1298 died... 09:29:31.790048 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1298): Terminated: ok {rc=0} 09:29:31.837971 --- ParallelTerminationStrategy: PID 1301 died... 09:29:31.858719 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1301): Terminated: ok {rc=0} 09:29:31.905613 --- ParallelTerminationStrategy: PID 1304 died... 09:29:31.926587 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1304): Terminated: ok {rc=0} 09:29:32.014454 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2402 gprs:nanobts+band-1900 ping_idle_ping.py ---------------------------------------------- 09:29:33.099639 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 09:29:33.111562 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 09:29:33.154299 tst ping_idle_ping.py: using LAC 39987 09:29:33.279358 tst ping_idle_ping.py: using RAC 207 09:29:33.403652 tst ping_idle_ping.py: using CellId 39987 09:29:33.532100 tst ping_idle_ping.py: using BVCI 39988 09:29:33.648301 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 09:29:33.659565 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 09:29:33.670768 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 09:29:33.681832 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 09:29:33.692832 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 09:29:33.703877 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 09:29:33.715032 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 09:29:33.726137 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 09:29:33.841842 tst ping_idle_ping.py:24: start network... 09:29:34.056177 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:29:34.549931 run create_hlr_db(pid=1306): Launched 09:29:34.678884 bus /gobi_6: Setting Powered False 09:29:35.742020 run create_hlr_db(pid=1306): Terminated: ok {rc=0} 09:29:36.166971 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1308): Launched 09:29:36.463621 run osmo-hlr_10.42.42.2(pid=1309): Launched 09:29:36.577020 run osmo-stp_10.42.42.5: Starting osmo-stp 09:29:37.101869 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1311): Launched 09:29:37.398227 run osmo-stp_10.42.42.5(pid=1312): Launched 09:29:37.510329 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:29:38.023805 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1314): Launched 09:29:38.136913 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:29:38.387756 run patchelf(pid=1315): Launched 09:29:38.552717 run osmo-stp_10.42.42.5(pid=1312): ERR: Terminated: ERROR {rc=1} [trial-2402↪gprs:nanobts+band-1900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1312)] 09:29:38.678697 run osmo-stp_10.42.42.5(pid=1312): stdout: | (launched: 2022-12-14_09:29:37.342415) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:29:38.806073 run osmo-stp_10.42.42.5(pid=1312): stderr: | 20221214092937510 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214092937510 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214092937510 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214092937511 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214092937511 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214092937511 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214092937511 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:29:38.933829 run osmo-stp_10.42.42.5(pid=1312): stdout: | (launched: 2022-12-14_09:29:37.342415) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:29:39.055909 run osmo-stp_10.42.42.5(pid=1312): stderr: | 20221214092937510 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214092937510 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214092937510 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214092937511 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214092937511 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214092937511 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214092937511 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:29:39.199827 run patchelf(pid=1315): Terminating (SIGINT) 09:29:39.366186 run patchelf(pid=1315): Terminated: ok {rc=0} 09:29:39.486000 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=1312): Process ended prematurely: osmo-stp_10.42.42.5(pid=1312) [trial-2402↪gprs:nanobts+band-1900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1312)] [trial-2402↪gprs:nanobts+band-1900↪ping_idle_ping.py:27] 09:29:39.494800 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 09:29:39.521481 run osmo-hlr_10.42.42.2(pid=1309): ERR: Terminated: ERROR {rc=237} [trial-2402↪gprs:nanobts+band-1900↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1309)] 09:29:39.569662 run osmo-hlr_10.42.42.2(pid=1309): stdout: | (launched: 2022-12-14_09:29:36.407885) 09:29:39.619009 run osmo-hlr_10.42.42.2(pid=1309): stderr: | 20221214092936579 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214092936579 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214092936579 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214092936579 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214092936579 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214092936579 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214092936592 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/gprs:nanobts+band-1900/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214092936602 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214092936602 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214092936602 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:29:39.668836 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1308): Terminating (SIGTERM) 09:29:39.708835 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1311): Terminating (SIGTERM) 09:29:39.748549 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1314): Terminating (SIGTERM) 09:29:39.788483 --- ParallelTerminationStrategy: PID 1308 died... 09:29:39.807907 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1308): Terminated: ok {rc=0} 09:29:39.851925 --- ParallelTerminationStrategy: PID 1311 died... 09:29:39.870919 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1311): Terminated: ok {rc=0} 09:29:39.914379 --- ParallelTerminationStrategy: PID 1314 died... 09:29:39.933334 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1314): Terminated: ok {rc=0} 09:29:40.018168 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2402 gprs:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 gprs:nanobts+band-1900+mod-bts0-egprs --------------------------------------------------------------------- 09:29:41.319806 tst gprs:nanobts+band-1900+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:29:41.327019 tst gprs:nanobts+band-1900+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 09:29:41.351782 tst gprs:nanobts+band-1900+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 09:29:41.391392 tst gprs:nanobts+band-1900+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 09:29:41.479882 tst gprs:nanobts+band-1900+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 09:29:41.504176 tst gprs:nanobts+band-1900+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 09:29:41.543493 tst gprs:nanobts+band-1900+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 09:29:42.141172 tst gprs:nanobts+band-1900+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2402 gprs:nanobts+band-1900+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 09:29:42.192086 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:29:42.203400 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 09:29:42.244425 tst cs_paging_gprs_active.py: using LAC 39988 09:29:42.372288 tst cs_paging_gprs_active.py: using RAC 208 09:29:42.499591 tst cs_paging_gprs_active.py: using CellId 39988 09:29:42.626992 tst cs_paging_gprs_active.py: using BVCI 39989 09:29:42.744532 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:29:42.756096 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:29:42.767241 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:29:42.778433 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:29:42.789555 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:29:42.800617 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:29:42.812056 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:29:42.823148 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:29:42.834479 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:29:42.950610 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:29:43.068918 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 09:29:43.285036 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:29:43.606310 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1320): Launched 09:29:43.884800 run iperf3-srv_10.42.42.10(pid=1321): Launched 09:29:44.005278 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 09:29:44.220324 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:29:44.541778 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1322): Launched 09:29:44.821501 run iperf3-srv_10.42.42.10(pid=1323): Launched 09:29:44.941147 tst cs_paging_gprs_active.py:38: start network... 09:29:45.158169 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:29:45.655412 run create_hlr_db(pid=1324): Launched 09:29:45.785930 bus /gobi_6: Setting Powered False 09:29:46.846440 run create_hlr_db(pid=1324): Terminated: ok {rc=0} 09:29:47.293346 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1326): Launched 09:29:47.614863 run osmo-hlr_10.42.42.2(pid=1327): Launched 09:29:47.735871 run osmo-stp_10.42.42.5: Starting osmo-stp 09:29:48.287731 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1329): Launched 09:29:48.610048 run osmo-stp_10.42.42.5(pid=1330): Launched 09:29:48.731815 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:29:49.287645 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1332): Launched 09:29:49.410200 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:29:49.682291 run patchelf(pid=1333): Launched 09:29:49.860345 run osmo-stp_10.42.42.5(pid=1330): ERR: Terminated: ERROR {rc=1} [trial-2402↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1330)] 09:29:49.996133 run osmo-stp_10.42.42.5(pid=1330): stdout: | (launched: 2022-12-14_09:29:48.550335) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:29:50.133506 run osmo-stp_10.42.42.5(pid=1330): stderr: | 20221214092948740 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214092948740 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214092948740 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214092948741 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214092948741 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214092948741 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214092948741 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:29:50.270642 run osmo-stp_10.42.42.5(pid=1330): stdout: | (launched: 2022-12-14_09:29:48.550335) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:29:50.402159 run osmo-stp_10.42.42.5(pid=1330): stderr: | 20221214092948740 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214092948740 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214092948740 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214092948741 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214092948741 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214092948741 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214092948741 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:29:50.558227 run patchelf(pid=1333): Terminating (SIGINT) 09:29:50.736919 run patchelf(pid=1333): Terminated: ok {rc=0} 09:29:50.866021 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=1330): Process ended prematurely: osmo-stp_10.42.42.5(pid=1330) [trial-2402↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1330)] [trial-2402↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 09:29:50.876234 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 09:29:50.904709 run osmo-hlr_10.42.42.2(pid=1327): ERR: Terminated: ERROR {rc=237} [trial-2402↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1327)] 09:29:50.954857 run osmo-hlr_10.42.42.2(pid=1327): stdout: | (launched: 2022-12-14_09:29:47.555319) 09:29:51.006731 run osmo-hlr_10.42.42.2(pid=1327): stderr: | 20221214092947750 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214092947750 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214092947750 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214092947750 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214092947750 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214092947751 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214092947764 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/gprs:nanobts+band-1900+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214092947773 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214092947773 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214092947773 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:29:51.059411 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1320): Terminating (SIGTERM) 09:29:51.101329 run iperf3-srv_10.42.42.10(pid=1321): Terminating (SIGTERM) 09:29:51.142729 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1322): Terminating (SIGTERM) 09:29:51.184206 run iperf3-srv_10.42.42.10(pid=1323): Terminating (SIGTERM) 09:29:51.225708 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1326): Terminating (SIGTERM) 09:29:51.267220 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1329): Terminating (SIGTERM) 09:29:51.308715 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1332): Terminating (SIGTERM) 09:29:51.350451 --- ParallelTerminationStrategy: PID 1320 died... 09:29:51.370201 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1320): Terminated: ok {rc=0} 09:29:51.416222 --- ParallelTerminationStrategy: PID 1321 died... 09:29:51.435679 run iperf3-srv_10.42.42.10(pid=1321): Terminated {rc=256} 09:29:51.481295 --- ParallelTerminationStrategy: PID 1322 died... 09:29:51.500634 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1322): Terminated: ok {rc=0} 09:29:51.546438 --- ParallelTerminationStrategy: PID 1323 died... 09:29:51.565885 run iperf3-srv_10.42.42.10(pid=1323): Terminated {rc=256} 09:29:51.611284 --- ParallelTerminationStrategy: PID 1326 died... 09:29:51.630697 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1326): Terminated: ok {rc=0} 09:29:51.676226 --- ParallelTerminationStrategy: PID 1329 died... 09:29:51.695697 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1329): Terminated: ok {rc=0} 09:29:51.741336 --- ParallelTerminationStrategy: PID 1332 died... 09:29:51.760475 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1332): Terminated: ok {rc=0} 09:29:51.847150 bus /gobi_0: Setting Powered False 09:29:52.944534 bus /gobi_0: Setting Powered False 09:29:54.062461 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2402 gprs:nanobts+band-1900+mod-bts0-egprs iperf3.py ---------------------------------------------- 09:29:55.204711 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:29:55.216499 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 09:29:55.259563 tst iperf3.py: using LAC 39989 09:29:55.386605 tst iperf3.py: using RAC 209 09:29:55.513833 tst iperf3.py: using CellId 39989 09:29:55.640866 tst iperf3.py: using BVCI 39990 09:29:55.757359 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:29:55.768752 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:29:55.779925 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:29:55.791152 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:29:55.802361 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:29:55.813496 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:29:55.824777 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:29:55.835948 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:29:55.847397 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:29:55.965036 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 09:29:56.181611 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:29:56.505124 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1334): Launched 09:29:56.786354 run iperf3-srv_10.42.42.10(pid=1335): Launched 09:29:56.906803 tst iperf3.py:8: start network... 09:29:57.124078 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:29:57.622960 run create_hlr_db(pid=1336): Launched 09:29:57.753549 bus /gobi_6: Setting Powered False 09:29:58.817676 run create_hlr_db(pid=1336): Terminated: ok {rc=0} 09:29:59.247444 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1338): Launched 09:29:59.548687 run osmo-hlr_10.42.42.2(pid=1339): Launched 09:29:59.668922 run osmo-stp_10.42.42.5: Starting osmo-stp 09:30:00.191004 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1342): Launched 09:30:00.491470 run osmo-stp_10.42.42.5(pid=1343): Launched 09:30:00.606414 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:30:01.156431 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1345): Launched 09:30:01.312109 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:30:01.577763 run patchelf(pid=1349): Launched 09:30:01.766235 run osmo-stp_10.42.42.5(pid=1343): ERR: Terminated: ERROR {rc=1} [trial-2402↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1343)] 09:30:01.896900 run osmo-stp_10.42.42.5(pid=1343): stdout: | (launched: 2022-12-14_09:30:00.435205) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:30:02.029501 run osmo-stp_10.42.42.5(pid=1343): stderr: | 20221214093000602 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214093000602 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214093000602 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214093000603 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214093000603 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214093000603 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214093000603 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:30:02.162821 run osmo-stp_10.42.42.5(pid=1343): stdout: | (launched: 2022-12-14_09:30:00.435205) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:30:02.289583 run osmo-stp_10.42.42.5(pid=1343): stderr: | 20221214093000602 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214093000602 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214093000602 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214093000603 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214093000603 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214093000603 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214093000603 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:30:02.436708 run patchelf(pid=1349): Terminating (SIGINT) 09:30:02.605809 run patchelf(pid=1349): Terminated: ok {rc=0} 09:30:02.727755 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1343): Process ended prematurely: osmo-stp_10.42.42.5(pid=1343) [trial-2402↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1343)] [trial-2402↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8] 09:30:02.737299 tst iperf3.py:8: Test FAILED (7.6 sec) 09:30:02.764243 run osmo-hlr_10.42.42.2(pid=1339): ERR: Terminated: ERROR {rc=237} [trial-2402↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1339)] 09:30:02.813146 run osmo-hlr_10.42.42.2(pid=1339): stdout: | (launched: 2022-12-14_09:29:59.492428) 09:30:02.863191 run osmo-hlr_10.42.42.2(pid=1339): stderr: | 20221214092959664 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214092959664 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214092959664 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214092959664 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214092959664 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214092959664 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214092959675 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/gprs:nanobts+band-1900+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214092959688 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214092959688 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214092959688 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:30:02.913872 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1334): Terminating (SIGTERM) 09:30:02.955475 run iperf3-srv_10.42.42.10(pid=1335): Terminating (SIGTERM) 09:30:02.996184 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1338): Terminating (SIGTERM) 09:30:03.036515 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1342): Terminating (SIGTERM) 09:30:03.076710 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1345): Terminating (SIGTERM) 09:30:03.117680 --- ParallelTerminationStrategy: PID 1334 died... 09:30:03.137691 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1334): Terminated: ok {rc=0} 09:30:03.182343 --- ParallelTerminationStrategy: PID 1335 died... 09:30:03.201821 run iperf3-srv_10.42.42.10(pid=1335): Terminated {rc=256} 09:30:03.246359 --- ParallelTerminationStrategy: PID 1338 died... 09:30:03.265890 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1338): Terminated: ok {rc=0} 09:30:03.310412 --- ParallelTerminationStrategy: PID 1342 died... 09:30:03.329848 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1342): Terminated: ok {rc=0} 09:30:03.374208 --- ParallelTerminationStrategy: PID 1345 died... 09:30:03.393678 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1345): Terminated: ok {rc=0} 09:30:03.480385 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2402 gprs:nanobts+band-1900+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 09:30:04.625913 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:30:04.637521 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 09:30:04.679079 tst iperf3m4.py: using LAC 39990 09:30:04.806382 tst iperf3m4.py: using RAC 210 09:30:04.933891 tst iperf3m4.py: using CellId 39990 09:30:05.060586 tst iperf3m4.py: using BVCI 39991 09:30:05.180097 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:30:05.191765 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:30:05.202970 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:30:05.214261 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:30:05.225429 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:30:05.236621 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:30:05.248035 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:30:05.259206 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:30:05.270557 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:30:05.386324 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:30:05.503849 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:30:05.621560 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:30:05.737856 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 09:30:05.939385 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:30:06.242434 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1350): Launched 09:30:06.504739 run iperf3-srv_10.42.42.10(pid=1351): Launched 09:30:06.617861 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 09:30:06.818728 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:30:07.121658 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1352): Launched 09:30:07.384839 run iperf3-srv_10.42.42.10(pid=1353): Launched 09:30:07.498274 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 09:30:07.698920 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:30:08.002072 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1354): Launched 09:30:08.264617 run iperf3-srv_10.42.42.10(pid=1355): Launched 09:30:08.377408 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 09:30:08.578326 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:30:08.881153 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1356): Launched 09:30:09.144705 run iperf3-srv_10.42.42.10(pid=1357): Launched 09:30:09.257938 tst iperf3m4.py:8: start network... 09:30:09.458670 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:30:09.926619 run create_hlr_db(pid=1358): Launched 09:30:10.041930 bus /gobi_6: Setting Powered False 09:30:11.102160 run create_hlr_db(pid=1358): Terminated: ok {rc=0} 09:30:11.523663 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1360): Launched 09:30:11.825703 run osmo-hlr_10.42.42.2(pid=1361): Launched 09:30:11.940593 run osmo-stp_10.42.42.5: Starting osmo-stp 09:30:12.474969 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1363): Launched 09:30:12.776091 run osmo-stp_10.42.42.5(pid=1364): Launched 09:30:12.891430 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:30:13.412661 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1366): Launched 09:30:13.528134 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:30:13.783145 run patchelf(pid=1367): Launched 09:30:13.949934 run osmo-stp_10.42.42.5(pid=1364): ERR: Terminated: ERROR {rc=1} [trial-2402↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1364)] 09:30:14.076854 run osmo-stp_10.42.42.5(pid=1364): stdout: | (launched: 2022-12-14_09:30:12.719761) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:30:14.205694 run osmo-stp_10.42.42.5(pid=1364): stderr: | 20221214093012886 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214093012886 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214093012886 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214093012887 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214093012887 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214093012887 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214093012887 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:30:14.334242 run osmo-stp_10.42.42.5(pid=1364): stdout: | (launched: 2022-12-14_09:30:12.719761) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:30:14.457452 run osmo-stp_10.42.42.5(pid=1364): stderr: | 20221214093012886 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214093012886 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214093012886 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214093012887 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214093012887 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214093012887 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214093012887 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:30:14.603183 run patchelf(pid=1367): Terminating (SIGINT) 09:30:14.771274 run patchelf(pid=1367): Terminated: ok {rc=0} 09:30:14.892557 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1364): Process ended prematurely: osmo-stp_10.42.42.5(pid=1364) [trial-2402↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1364)] [trial-2402↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8] 09:30:14.902132 tst iperf3m4.py:8: Test FAILED (10.3 sec) 09:30:14.929433 run osmo-hlr_10.42.42.2(pid=1361): ERR: Terminated: ERROR {rc=237} [trial-2402↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1361)] 09:30:14.977393 run osmo-hlr_10.42.42.2(pid=1361): stdout: | (launched: 2022-12-14_09:30:11.768708) 09:30:15.026746 run osmo-hlr_10.42.42.2(pid=1361): stderr: | 20221214093011944 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214093011944 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214093011944 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214093011944 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214093011944 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214093011944 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214093011955 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/gprs:nanobts+band-1900+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214093011964 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214093011964 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214093011964 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:30:15.076311 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1350): Terminating (SIGTERM) 09:30:15.116159 run iperf3-srv_10.42.42.10(pid=1351): Terminating (SIGTERM) 09:30:15.156336 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1352): Terminating (SIGTERM) 09:30:15.196056 run iperf3-srv_10.42.42.10(pid=1353): Terminating (SIGTERM) 09:30:15.235761 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1354): Terminating (SIGTERM) 09:30:15.275408 run iperf3-srv_10.42.42.10(pid=1355): Terminating (SIGTERM) 09:30:15.314825 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1356): Terminating (SIGTERM) 09:30:15.354282 run iperf3-srv_10.42.42.10(pid=1357): Terminating (SIGTERM) 09:30:15.393676 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1360): Terminating (SIGTERM) 09:30:15.433202 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1363): Terminating (SIGTERM) 09:30:15.472724 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1366): Terminating (SIGTERM) 09:30:15.512442 --- ParallelTerminationStrategy: PID 1350 died... 09:30:15.531892 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1350): Terminated: ok {rc=0} 09:30:15.575899 --- ParallelTerminationStrategy: PID 1351 died... 09:30:15.594826 run iperf3-srv_10.42.42.10(pid=1351): Terminated {rc=256} 09:30:15.638564 --- ParallelTerminationStrategy: PID 1352 died... 09:30:15.657446 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1352): Terminated: ok {rc=0} 09:30:15.701172 --- ParallelTerminationStrategy: PID 1353 died... 09:30:15.719874 run iperf3-srv_10.42.42.10(pid=1353): Terminated {rc=256} 09:30:15.763590 --- ParallelTerminationStrategy: PID 1354 died... 09:30:15.782395 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1354): Terminated: ok {rc=0} 09:30:15.826581 --- ParallelTerminationStrategy: PID 1355 died... 09:30:15.847632 run iperf3-srv_10.42.42.10(pid=1355): Terminated {rc=256} 09:30:15.892745 --- ParallelTerminationStrategy: PID 1356 died... 09:30:15.911882 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1356): Terminated: ok {rc=0} 09:30:15.969569 --- ParallelTerminationStrategy: PID 1357 died... 09:30:15.988606 run iperf3-srv_10.42.42.10(pid=1357): Terminated {rc=256} 09:30:16.032922 --- ParallelTerminationStrategy: PID 1360 died... 09:30:16.052472 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1360): Terminated: ok {rc=0} 09:30:16.097315 --- ParallelTerminationStrategy: PID 1363 died... 09:30:16.116518 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1363): Terminated: ok {rc=0} 09:30:16.161266 --- ParallelTerminationStrategy: PID 1366 died... 09:30:16.180546 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1366): Terminated: ok {rc=0} 09:30:16.265527 bus /gobi_4: Setting Powered False 09:30:17.363297 bus /gobi_4: Setting Powered False 09:30:18.478990 bus /gobi_1: Setting Powered False 09:30:19.578049 bus /gobi_1: Setting Powered False 09:30:20.693809 bus /gobi_0: Setting Powered False 09:30:21.792198 bus /gobi_0: Setting Powered False 09:30:22.908783 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2402 gprs:nanobts+band-1900+mod-bts0-egprs ping.py ---------------------------------------------- 09:30:24.012666 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:30:24.024811 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 09:30:24.066498 tst ping.py: using LAC 39991 09:30:24.191074 tst ping.py: using RAC 211 09:30:24.315796 tst ping.py: using CellId 39991 09:30:24.439518 tst ping.py: using BVCI 39992 09:30:24.547652 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:30:24.558915 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:30:24.569952 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:30:24.580873 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:30:24.592590 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:30:24.603900 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:30:24.615265 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:30:24.626485 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:30:24.743892 tst ping.py:19: start network... 09:30:24.954906 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:30:25.444288 run create_hlr_db(pid=1368): Launched 09:30:25.571548 bus /gobi_6: Setting Powered False 09:30:26.633338 run create_hlr_db(pid=1368): Terminated: ok {rc=0} 09:30:27.051947 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1370): Launched 09:30:27.346558 run osmo-hlr_10.42.42.2(pid=1371): Launched 09:30:27.458028 run osmo-stp_10.42.42.5: Starting osmo-stp 09:30:27.972181 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1373): Launched 09:30:28.266176 run osmo-stp_10.42.42.5(pid=1374): Launched 09:30:28.377468 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:30:28.884938 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1376): Launched 09:30:28.997956 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:30:29.246820 run patchelf(pid=1377): Launched 09:30:29.411180 run osmo-stp_10.42.42.5(pid=1374): ERR: Terminated: ERROR {rc=1} [trial-2402↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1374)] 09:30:29.536398 run osmo-stp_10.42.42.5(pid=1374): stdout: | (launched: 2022-12-14_09:30:28.210987) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:30:29.663163 run osmo-stp_10.42.42.5(pid=1374): stderr: | 20221214093028378 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214093028378 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214093028379 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214093028379 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214093028380 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214093028380 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214093028380 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:30:29.790014 run osmo-stp_10.42.42.5(pid=1374): stdout: | (launched: 2022-12-14_09:30:28.210987) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:30:29.911643 run osmo-stp_10.42.42.5(pid=1374): stderr: | 20221214093028378 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214093028378 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214093028379 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214093028379 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214093028380 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214093028380 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214093028380 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:30:30.055395 run patchelf(pid=1377): Terminating (SIGINT) 09:30:30.220933 run patchelf(pid=1377): Terminated: ok {rc=0} 09:30:30.339824 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=1374): Process ended prematurely: osmo-stp_10.42.42.5(pid=1374) [trial-2402↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1374)] [trial-2402↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22] 09:30:30.348741 tst ping.py:22: Test FAILED (6.3 sec) 09:30:30.375467 run osmo-hlr_10.42.42.2(pid=1371): ERR: Terminated: ERROR {rc=237} [trial-2402↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1371)] 09:30:30.423538 run osmo-hlr_10.42.42.2(pid=1371): stdout: | (launched: 2022-12-14_09:30:27.291350) 09:30:30.473093 run osmo-hlr_10.42.42.2(pid=1371): stderr: | 20221214093027464 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214093027464 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214093027464 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214093027464 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214093027464 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214093027464 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214093027475 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/gprs:nanobts+band-1900+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214093027485 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214093027485 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214093027485 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:30:30.523009 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1370): Terminating (SIGTERM) 09:30:30.562867 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1373): Terminating (SIGTERM) 09:30:30.602542 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1376): Terminating (SIGTERM) 09:30:30.642627 --- ParallelTerminationStrategy: PID 1370 died... 09:30:30.662304 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1370): Terminated: ok {rc=0} 09:30:30.706502 --- ParallelTerminationStrategy: PID 1373 died... 09:30:30.725493 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1373): Terminated: ok {rc=0} 09:30:30.769227 --- ParallelTerminationStrategy: PID 1376 died... 09:30:30.788103 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1376): Terminated: ok {rc=0} 09:30:30.881672 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2402 gprs:nanobts+band-1900+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 09:30:31.975942 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:30:31.989302 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 09:30:32.033153 tst ping_idle_ping.py: using LAC 39992 09:30:32.153207 tst ping_idle_ping.py: using RAC 212 09:30:32.276065 tst ping_idle_ping.py: using CellId 39992 09:30:32.393745 tst ping_idle_ping.py: using BVCI 39993 09:30:32.503877 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:30:32.515057 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:30:32.526239 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:30:32.537267 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:30:32.548849 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:30:32.560684 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:30:32.572557 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:30:32.584376 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:30:32.699225 tst ping_idle_ping.py:24: start network... 09:30:32.896837 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:30:33.362971 run create_hlr_db(pid=1378): Launched 09:30:33.476212 bus /gobi_6: Setting Powered False 09:30:34.540051 run create_hlr_db(pid=1378): Terminated: ok {rc=0} 09:30:34.982514 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1380): Launched 09:30:35.298909 run osmo-hlr_10.42.42.2(pid=1381): Launched 09:30:35.421113 run osmo-stp_10.42.42.5: Starting osmo-stp 09:30:35.971595 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1383): Launched 09:30:36.288253 run osmo-stp_10.42.42.5(pid=1384): Launched 09:30:36.408245 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:30:36.954225 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1386): Launched 09:30:37.075075 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:30:37.342961 run patchelf(pid=1387): Launched 09:30:37.521952 run osmo-stp_10.42.42.5(pid=1384): ERR: Terminated: ERROR {rc=1} [trial-2402↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1384)] 09:30:37.648456 run osmo-stp_10.42.42.5(pid=1384): stdout: | (launched: 2022-12-14_09:30:36.229804) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:30:37.776599 run osmo-stp_10.42.42.5(pid=1384): stderr: | 20221214093036418 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214093036418 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214093036418 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214093036419 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214093036419 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214093036419 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214093036419 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:30:37.904373 run osmo-stp_10.42.42.5(pid=1384): stdout: | (launched: 2022-12-14_09:30:36.229804) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:30:38.026829 run osmo-stp_10.42.42.5(pid=1384): stderr: | 20221214093036418 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214093036418 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214093036418 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214093036419 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214093036419 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214093036419 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214093036419 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:30:38.171321 run patchelf(pid=1387): Terminating (SIGINT) 09:30:38.337327 run patchelf(pid=1387): Terminated: ok {rc=0} 09:30:38.456629 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=1384): Process ended prematurely: osmo-stp_10.42.42.5(pid=1384) [trial-2402↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1384)] [trial-2402↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27] 09:30:38.465760 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 09:30:38.492211 run osmo-hlr_10.42.42.2(pid=1381): ERR: Terminated: ERROR {rc=237} [trial-2402↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1381)] 09:30:38.540121 run osmo-hlr_10.42.42.2(pid=1381): stdout: | (launched: 2022-12-14_09:30:35.240330) 09:30:38.589435 run osmo-hlr_10.42.42.2(pid=1381): stderr: | 20221214093035433 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214093035433 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214093035433 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214093035433 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214093035433 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214093035433 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214093035446 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/gprs:nanobts+band-1900+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214093035454 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214093035454 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214093035454 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:30:38.639265 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1380): Terminating (SIGTERM) 09:30:38.678929 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1383): Terminating (SIGTERM) 09:30:38.718773 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1386): Terminating (SIGTERM) 09:30:38.758579 --- ParallelTerminationStrategy: PID 1380 died... 09:30:38.778088 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1380): Terminated: ok {rc=0} 09:30:38.822004 --- ParallelTerminationStrategy: PID 1383 died... 09:30:38.840882 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1383): Terminated: ok {rc=0} 09:30:38.884848 --- ParallelTerminationStrategy: PID 1386 died... 09:30:38.904347 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1386): Terminated: ok {rc=0} 09:30:38.989959 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2402 gprs:nanobts+band-1900+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 gprs:nanobts+band-1900+mod-bts0-dynts-ipa --------------------------------------------------------------------- 09:30:40.282857 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:30:40.289642 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 09:30:40.313190 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 09:30:40.352093 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 09:30:40.436787 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 09:30:40.460477 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 09:30:40.498661 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 09:30:41.094891 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2402 gprs:nanobts+band-1900+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 09:30:41.143307 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:30:41.154242 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 09:30:41.211840 tst cs_paging_gprs_active.py: using LAC 39993 09:30:41.327109 tst cs_paging_gprs_active.py: using RAC 213 09:30:41.442748 tst cs_paging_gprs_active.py: using CellId 39993 09:30:41.561457 tst cs_paging_gprs_active.py: using BVCI 39994 09:30:41.672101 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:30:41.683298 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:30:41.694153 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:30:41.704876 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:30:41.715989 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:30:41.727119 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:30:41.738453 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:30:41.749547 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:30:41.760831 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:30:41.875968 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:30:41.993818 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 09:30:42.209966 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:30:42.531719 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1392): Launched 09:30:42.812052 run iperf3-srv_10.42.42.10(pid=1393): Launched 09:30:42.931574 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 09:30:43.147942 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:30:43.469725 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1394): Launched 09:30:43.748551 run iperf3-srv_10.42.42.10(pid=1395): Launched 09:30:43.869745 tst cs_paging_gprs_active.py:38: start network... 09:30:44.084934 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:30:44.583055 run create_hlr_db(pid=1396): Launched 09:30:44.713688 bus /gobi_6: Setting Powered False 09:30:45.777183 run create_hlr_db(pid=1396): Terminated: ok {rc=0} 09:30:46.250372 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1398): Launched 09:30:46.580390 run osmo-hlr_10.42.42.2(pid=1399): Launched 09:30:46.842719 run osmo-stp_10.42.42.5: Starting osmo-stp 09:30:47.462207 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1401): Launched 09:30:47.784531 run osmo-stp_10.42.42.5(pid=1402): Launched 09:30:47.905466 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:30:48.458182 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1404): Launched 09:30:48.580127 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:30:48.851496 run patchelf(pid=1405): Launched 09:30:49.029769 run osmo-stp_10.42.42.5(pid=1402): ERR: Terminated: ERROR {rc=1} [trial-2402↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1402)] 09:30:49.165167 run osmo-stp_10.42.42.5(pid=1402): stdout: | (launched: 2022-12-14_09:30:47.725063) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:30:49.301980 run osmo-stp_10.42.42.5(pid=1402): stderr: | 20221214093047915 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214093047915 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214093047915 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214093047916 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214093047916 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214093047916 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214093047916 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:30:49.439154 run osmo-stp_10.42.42.5(pid=1402): stdout: | (launched: 2022-12-14_09:30:47.725063) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:30:49.571416 run osmo-stp_10.42.42.5(pid=1402): stderr: | 20221214093047915 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214093047915 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214093047915 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214093047916 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214093047916 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214093047916 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214093047916 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:30:49.727694 run patchelf(pid=1405): Terminating (SIGINT) 09:30:49.906529 run patchelf(pid=1405): Terminated: ok {rc=0} 09:30:50.035648 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=1402): Process ended prematurely: osmo-stp_10.42.42.5(pid=1402) [trial-2402↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1402)] [trial-2402↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 09:30:50.045913 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 09:30:50.074581 run osmo-hlr_10.42.42.2(pid=1399): ERR: Terminated: ERROR {rc=237} [trial-2402↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1399)] 09:30:50.124541 run osmo-hlr_10.42.42.2(pid=1399): stdout: | (launched: 2022-12-14_09:30:46.515586) 09:30:50.176328 run osmo-hlr_10.42.42.2(pid=1399): stderr: | 20221214093046860 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214093046860 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214093046860 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214093046860 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214093046860 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214093046860 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214093046887 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214093046906 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214093046906 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214093046906 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:30:50.228497 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1392): Terminating (SIGTERM) 09:30:50.270184 run iperf3-srv_10.42.42.10(pid=1393): Terminating (SIGTERM) 09:30:50.311736 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1394): Terminating (SIGTERM) 09:30:50.353451 run iperf3-srv_10.42.42.10(pid=1395): Terminating (SIGTERM) 09:30:50.395071 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1398): Terminating (SIGTERM) 09:30:50.436752 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1401): Terminating (SIGTERM) 09:30:50.478307 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1404): Terminating (SIGTERM) 09:30:50.520114 --- ParallelTerminationStrategy: PID 1392 died... 09:30:50.540328 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1392): Terminated: ok {rc=0} 09:30:50.586289 --- ParallelTerminationStrategy: PID 1393 died... 09:30:50.605760 run iperf3-srv_10.42.42.10(pid=1393): Terminated {rc=256} 09:30:50.651395 --- ParallelTerminationStrategy: PID 1394 died... 09:30:50.670946 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1394): Terminated: ok {rc=0} 09:30:50.716576 --- ParallelTerminationStrategy: PID 1395 died... 09:30:50.736088 run iperf3-srv_10.42.42.10(pid=1395): Terminated {rc=256} 09:30:50.781640 --- ParallelTerminationStrategy: PID 1398 died... 09:30:50.801277 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1398): Terminated: ok {rc=0} 09:30:50.846899 --- ParallelTerminationStrategy: PID 1401 died... 09:30:50.866334 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1401): Terminated: ok {rc=0} 09:30:50.911966 --- ParallelTerminationStrategy: PID 1404 died... 09:30:50.931524 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1404): Terminated: ok {rc=0} 09:30:51.017729 bus /gobi_0: Setting Powered False 09:30:52.115387 bus /gobi_0: Setting Powered False 09:30:53.230347 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2402 gprs:nanobts+band-1900+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 09:30:54.374472 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:30:54.386289 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 09:30:54.448402 tst iperf3.py: using LAC 39994 09:30:54.568301 tst iperf3.py: using RAC 214 09:30:54.691515 tst iperf3.py: using CellId 39994 09:30:54.809830 tst iperf3.py: using BVCI 39995 09:30:54.926667 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:30:54.938240 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:30:54.949513 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:30:54.960788 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:30:54.972062 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:30:54.984064 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:30:54.995582 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:30:55.006803 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:30:55.018340 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:30:55.136168 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 09:30:55.351677 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:30:55.673522 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1407): Launched 09:30:55.951608 run iperf3-srv_10.42.42.10(pid=1408): Launched 09:30:56.072354 tst iperf3.py:8: start network... 09:30:56.287644 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:30:56.784893 run create_hlr_db(pid=1409): Launched 09:30:56.913715 bus /gobi_6: Setting Powered False 09:30:57.977048 run create_hlr_db(pid=1409): Terminated: ok {rc=0} 09:30:58.403972 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1411): Launched 09:30:58.705078 run osmo-hlr_10.42.42.2(pid=1412): Launched 09:30:58.819706 run osmo-stp_10.42.42.5: Starting osmo-stp 09:30:59.355169 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1414): Launched 09:30:59.655531 run osmo-stp_10.42.42.5(pid=1415): Launched 09:30:59.769340 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:31:00.286245 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1417): Launched 09:31:00.400447 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:31:00.654752 run patchelf(pid=1418): Launched 09:31:00.821104 run osmo-stp_10.42.42.5(pid=1415): ERR: Terminated: ERROR {rc=1} [trial-2402↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1415)] 09:31:00.958892 run osmo-stp_10.42.42.5(pid=1415): stdout: | (launched: 2022-12-14_09:30:59.599428) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:31:01.091579 run osmo-stp_10.42.42.5(pid=1415): stderr: | 20221214093059766 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214093059766 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214093059766 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214093059767 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214093059767 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214093059767 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214093059767 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:31:01.223705 run osmo-stp_10.42.42.5(pid=1415): stdout: | (launched: 2022-12-14_09:30:59.599428) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:31:01.350548 run osmo-stp_10.42.42.5(pid=1415): stderr: | 20221214093059766 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214093059766 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214093059766 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214093059767 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214093059767 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214093059767 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214093059767 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:31:01.499967 run patchelf(pid=1418): Terminating (SIGINT) 09:31:01.671933 run patchelf(pid=1418): Terminated: ok {rc=0} 09:31:01.797387 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1415): Process ended prematurely: osmo-stp_10.42.42.5(pid=1415) [trial-2402↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1415)] [trial-2402↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8] 09:31:01.807991 tst iperf3.py:8: Test FAILED (7.5 sec) 09:31:01.836197 run osmo-hlr_10.42.42.2(pid=1412): ERR: Terminated: ERROR {rc=237} [trial-2402↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1412)] 09:31:01.887285 run osmo-hlr_10.42.42.2(pid=1412): stdout: | (launched: 2022-12-14_09:30:58.648814) 09:31:01.938991 run osmo-hlr_10.42.42.2(pid=1412): stderr: | 20221214093058822 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214093058822 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214093058822 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214093058822 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214093058822 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214093058822 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214093058838 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214093058846 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214093058847 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214093058847 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:31:01.991084 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1407): Terminating (SIGTERM) 09:31:02.033653 run iperf3-srv_10.42.42.10(pid=1408): Terminating (SIGTERM) 09:31:02.078230 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1411): Terminating (SIGTERM) 09:31:02.120709 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1414): Terminating (SIGTERM) 09:31:02.161944 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1417): Terminating (SIGTERM) 09:31:02.203436 --- ParallelTerminationStrategy: PID 1407 died... 09:31:02.224765 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1407): Terminated: ok {rc=0} 09:31:02.273540 --- ParallelTerminationStrategy: PID 1408 died... 09:31:02.292858 run iperf3-srv_10.42.42.10(pid=1408): Terminated {rc=256} 09:31:02.338657 --- ParallelTerminationStrategy: PID 1411 died... 09:31:02.358378 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1411): Terminated: ok {rc=0} 09:31:02.403925 --- ParallelTerminationStrategy: PID 1414 died... 09:31:02.423419 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1414): Terminated: ok {rc=0} 09:31:02.469031 --- ParallelTerminationStrategy: PID 1417 died... 09:31:02.488466 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1417): Terminated: ok {rc=0} 09:31:02.574932 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2402 gprs:nanobts+band-1900+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 09:31:03.717910 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:31:03.729469 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 09:31:03.793398 tst iperf3m4.py: using LAC 39995 09:31:03.921388 tst iperf3m4.py: using RAC 215 09:31:04.047265 tst iperf3m4.py: using CellId 39995 09:31:04.176833 tst iperf3m4.py: using BVCI 39996 09:31:04.295709 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:31:04.307204 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:31:04.318475 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:31:04.329931 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:31:04.341640 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:31:04.353396 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:31:04.365230 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:31:04.377008 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:31:04.389136 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:31:04.506686 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:31:04.623990 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:31:04.744223 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:31:04.862285 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 09:31:05.064178 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:31:05.367088 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1419): Launched 09:31:05.628415 run iperf3-srv_10.42.42.10(pid=1420): Launched 09:31:05.741491 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 09:31:05.941866 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:31:06.243668 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1421): Launched 09:31:06.504190 run iperf3-srv_10.42.42.10(pid=1422): Launched 09:31:06.616218 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 09:31:06.816017 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:31:07.116621 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1423): Launched 09:31:07.377694 run iperf3-srv_10.42.42.10(pid=1424): Launched 09:31:07.489945 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 09:31:07.689915 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:31:07.991049 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1425): Launched 09:31:08.253545 run iperf3-srv_10.42.42.10(pid=1426): Launched 09:31:08.366035 tst iperf3m4.py:8: start network... 09:31:08.566041 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:31:09.030412 run create_hlr_db(pid=1427): Launched 09:31:09.145592 bus /gobi_6: Setting Powered False 09:31:10.206379 run create_hlr_db(pid=1427): Terminated: ok {rc=0} 09:31:10.644005 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1429): Launched 09:31:10.966227 run osmo-hlr_10.42.42.2(pid=1430): Launched 09:31:11.088807 run osmo-stp_10.42.42.5: Starting osmo-stp 09:31:11.641666 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1432): Launched 09:31:11.961909 run osmo-stp_10.42.42.5(pid=1433): Launched 09:31:12.084897 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:31:12.637208 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1435): Launched 09:31:12.759126 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:31:13.032016 run patchelf(pid=1436): Launched 09:31:13.209545 run osmo-stp_10.42.42.5(pid=1433): ERR: Terminated: ERROR {rc=1} [trial-2402↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1433)] 09:31:13.345179 run osmo-stp_10.42.42.5(pid=1433): stdout: | (launched: 2022-12-14_09:31:11.902357) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:31:13.481828 run osmo-stp_10.42.42.5(pid=1433): stderr: | 20221214093112090 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214093112090 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214093112090 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214093112090 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214093112091 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214093112091 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214093112091 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:31:13.618910 run osmo-stp_10.42.42.5(pid=1433): stdout: | (launched: 2022-12-14_09:31:11.902357) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:31:13.750487 run osmo-stp_10.42.42.5(pid=1433): stderr: | 20221214093112090 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214093112090 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214093112090 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214093112090 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214093112091 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214093112091 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214093112091 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:31:13.906043 run patchelf(pid=1436): Terminating (SIGINT) 09:31:14.085566 run patchelf(pid=1436): Terminated: ok {rc=0} 09:31:14.214306 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1433): Process ended prematurely: osmo-stp_10.42.42.5(pid=1433) [trial-2402↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1433)] [trial-2402↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8] 09:31:14.224390 tst iperf3m4.py:8: Test FAILED (10.5 sec) 09:31:14.253011 run osmo-hlr_10.42.42.2(pid=1430): ERR: Terminated: ERROR {rc=237} [trial-2402↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1430)] 09:31:14.302962 run osmo-hlr_10.42.42.2(pid=1430): stdout: | (launched: 2022-12-14_09:31:10.906583) 09:31:14.354447 run osmo-hlr_10.42.42.2(pid=1430): stderr: | 20221214093111101 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214093111101 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214093111101 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214093111101 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214093111101 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214093111101 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214093111114 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214093111122 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214093111123 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214093111123 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:31:14.406169 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1419): Terminating (SIGTERM) 09:31:14.447451 run iperf3-srv_10.42.42.10(pid=1420): Terminating (SIGTERM) 09:31:14.488573 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1421): Terminating (SIGTERM) 09:31:14.529917 run iperf3-srv_10.42.42.10(pid=1422): Terminating (SIGTERM) 09:31:14.571232 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1423): Terminating (SIGTERM) 09:31:14.612242 run iperf3-srv_10.42.42.10(pid=1424): Terminating (SIGTERM) 09:31:14.653335 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1425): Terminating (SIGTERM) 09:31:14.694387 run iperf3-srv_10.42.42.10(pid=1426): Terminating (SIGTERM) 09:31:14.735412 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1429): Terminating (SIGTERM) 09:31:14.776593 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1432): Terminating (SIGTERM) 09:31:14.817983 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1435): Terminating (SIGTERM) 09:31:14.859716 --- ParallelTerminationStrategy: PID 1419 died... 09:31:14.879738 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1419): Terminated: ok {rc=0} 09:31:14.925824 --- ParallelTerminationStrategy: PID 1420 died... 09:31:14.945060 run iperf3-srv_10.42.42.10(pid=1420): Terminated {rc=256} 09:31:14.991049 --- ParallelTerminationStrategy: PID 1421 died... 09:31:15.010433 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1421): Terminated: ok {rc=0} 09:31:15.055831 --- ParallelTerminationStrategy: PID 1422 died... 09:31:15.075340 run iperf3-srv_10.42.42.10(pid=1422): Terminated {rc=256} 09:31:15.120725 --- ParallelTerminationStrategy: PID 1423 died... 09:31:15.140104 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1423): Terminated: ok {rc=0} 09:31:15.185972 --- ParallelTerminationStrategy: PID 1424 died... 09:31:15.205381 run iperf3-srv_10.42.42.10(pid=1424): Terminated {rc=256} 09:31:15.250896 --- ParallelTerminationStrategy: PID 1425 died... 09:31:15.270407 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1425): Terminated: ok {rc=0} 09:31:15.315959 --- ParallelTerminationStrategy: PID 1426 died... 09:31:15.335151 run iperf3-srv_10.42.42.10(pid=1426): Terminated {rc=256} 09:31:15.380759 --- ParallelTerminationStrategy: PID 1429 died... 09:31:15.400138 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1429): Terminated: ok {rc=0} 09:31:15.445974 --- ParallelTerminationStrategy: PID 1432 died... 09:31:15.465548 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1432): Terminated: ok {rc=0} 09:31:15.511137 --- ParallelTerminationStrategy: PID 1435 died... 09:31:15.530792 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1435): Terminated: ok {rc=0} 09:31:15.618540 bus /gobi_4: Setting Powered False 09:31:16.715479 bus /gobi_4: Setting Powered False 09:31:17.831820 bus /gobi_1: Setting Powered False 09:31:18.930751 bus /gobi_1: Setting Powered False 09:31:20.049090 bus /gobi_0: Setting Powered False 09:31:21.147757 bus /gobi_0: Setting Powered False 09:31:22.260535 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2402 gprs:nanobts+band-1900+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 09:31:23.361831 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:31:23.374075 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 09:31:23.437671 tst ping.py: using LAC 39996 09:31:23.562581 tst ping.py: using RAC 216 09:31:23.688401 tst ping.py: using CellId 39996 09:31:23.812476 tst ping.py: using BVCI 39997 09:31:23.928597 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:31:23.940215 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:31:23.951515 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:31:23.962793 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:31:23.974018 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:31:23.985355 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:31:23.997197 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:31:24.008522 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:31:24.125664 tst ping.py:19: start network... 09:31:24.336730 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:31:24.825073 run create_hlr_db(pid=1437): Launched 09:31:24.952713 bus /gobi_6: Setting Powered False 09:31:26.016012 run create_hlr_db(pid=1437): Terminated: ok {rc=0} 09:31:26.439105 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1439): Launched 09:31:26.735082 run osmo-hlr_10.42.42.2(pid=1440): Launched 09:31:26.846971 run osmo-stp_10.42.42.5: Starting osmo-stp 09:31:27.377662 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1442): Launched 09:31:27.673751 run osmo-stp_10.42.42.5(pid=1443): Launched 09:31:27.786973 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:31:28.297227 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1446): Launched 09:31:28.410081 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:31:28.659282 run patchelf(pid=1447): Launched 09:31:28.824157 run osmo-stp_10.42.42.5(pid=1443): ERR: Terminated: ERROR {rc=1} [trial-2402↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1443)] 09:31:28.948788 run osmo-stp_10.42.42.5(pid=1443): stdout: | (launched: 2022-12-14_09:31:27.618667) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:31:29.075179 run osmo-stp_10.42.42.5(pid=1443): stderr: | 20221214093127785 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214093127786 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214093127786 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214093127786 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214093127787 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214093127787 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214093127787 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:31:29.201521 run osmo-stp_10.42.42.5(pid=1443): stdout: | (launched: 2022-12-14_09:31:27.618667) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:31:29.322169 run osmo-stp_10.42.42.5(pid=1443): stderr: | 20221214093127785 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214093127786 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214093127786 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214093127786 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214093127787 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214093127787 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214093127787 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:31:29.465243 run patchelf(pid=1447): Terminating (SIGINT) 09:31:29.630294 run patchelf(pid=1447): Terminated: ok {rc=0} 09:31:29.748928 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=1443): Process ended prematurely: osmo-stp_10.42.42.5(pid=1443) [trial-2402↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1443)] [trial-2402↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22] 09:31:29.758019 tst ping.py:22: Test FAILED (6.4 sec) 09:31:29.784490 run osmo-hlr_10.42.42.2(pid=1440): ERR: Terminated: ERROR {rc=237} [trial-2402↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1440)] 09:31:29.832845 run osmo-hlr_10.42.42.2(pid=1440): stdout: | (launched: 2022-12-14_09:31:26.680054) 09:31:29.882304 run osmo-hlr_10.42.42.2(pid=1440): stderr: | 20221214093126850 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214093126850 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214093126850 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214093126850 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214093126850 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214093126850 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214093126862 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214093126873 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214093126874 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214093126874 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:31:29.932130 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1439): Terminating (SIGTERM) 09:31:29.971813 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1442): Terminating (SIGTERM) 09:31:30.011497 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1446): Terminating (SIGTERM) 09:31:30.051283 --- ParallelTerminationStrategy: PID 1439 died... 09:31:30.070662 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1439): Terminated: ok {rc=0} 09:31:30.114668 --- ParallelTerminationStrategy: PID 1442 died... 09:31:30.133490 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1442): Terminated: ok {rc=0} 09:31:30.177496 --- ParallelTerminationStrategy: PID 1446 died... 09:31:30.196304 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1446): Terminated: ok {rc=0} 09:31:30.279195 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2402 gprs:nanobts+band-1900+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 09:31:31.362301 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:31:31.374530 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 09:31:31.438725 tst ping_idle_ping.py: using LAC 39997 09:31:31.601119 tst ping_idle_ping.py: using RAC 217 09:31:31.720749 tst ping_idle_ping.py: using CellId 39997 09:31:31.848421 tst ping_idle_ping.py: using BVCI 39998 09:31:31.966784 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:31:31.979621 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:31:31.991954 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:31:32.004619 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:31:32.017756 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:31:32.030833 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:31:32.044014 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:31:32.057204 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:31:32.178823 tst ping_idle_ping.py:24: start network... 09:31:32.392791 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:31:32.885744 run create_hlr_db(pid=1448): Launched 09:31:33.015160 bus /gobi_6: Setting Powered False 09:31:34.078565 run create_hlr_db(pid=1448): Terminated: ok {rc=0} 09:31:34.502001 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1450): Launched 09:31:34.798673 run osmo-hlr_10.42.42.2(pid=1451): Launched 09:31:34.910875 run osmo-stp_10.42.42.5: Starting osmo-stp 09:31:35.430957 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1453): Launched 09:31:35.724221 run osmo-stp_10.42.42.5(pid=1454): Launched 09:31:35.836405 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:31:36.345168 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1456): Launched 09:31:36.457901 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:31:36.707317 run patchelf(pid=1457): Launched 09:31:36.870452 run osmo-stp_10.42.42.5(pid=1454): ERR: Terminated: ERROR {rc=1} [trial-2402↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1454)] 09:31:36.994782 run osmo-stp_10.42.42.5(pid=1454): stdout: | (launched: 2022-12-14_09:31:35.669429) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:31:37.120849 run osmo-stp_10.42.42.5(pid=1454): stderr: | 20221214093135835 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214093135835 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214093135835 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214093135836 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214093135837 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214093135837 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214093135837 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:31:37.247190 run osmo-stp_10.42.42.5(pid=1454): stdout: | (launched: 2022-12-14_09:31:35.669429) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:31:37.368068 run osmo-stp_10.42.42.5(pid=1454): stderr: | 20221214093135835 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214093135835 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214093135835 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214093135836 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214093135837 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214093135837 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214093135837 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:31:37.511223 run patchelf(pid=1457): Terminating (SIGINT) 09:31:37.676230 run patchelf(pid=1457): Terminated: ok {rc=0} 09:31:37.794959 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=1454): Process ended prematurely: osmo-stp_10.42.42.5(pid=1454) [trial-2402↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1454)] [trial-2402↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 09:31:37.803908 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 09:31:37.830161 run osmo-hlr_10.42.42.2(pid=1451): ERR: Terminated: ERROR {rc=237} [trial-2402↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1451)] 09:31:37.877969 run osmo-hlr_10.42.42.2(pid=1451): stdout: | (launched: 2022-12-14_09:31:34.743788) 09:31:37.927047 run osmo-hlr_10.42.42.2(pid=1451): stderr: | 20221214093134916 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214093134916 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214093134916 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214093134916 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214093134916 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214093134916 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214093134929 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214093134937 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214093134938 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214093134938 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:31:37.977033 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1450): Terminating (SIGTERM) 09:31:38.016405 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1453): Terminating (SIGTERM) 09:31:38.055641 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1456): Terminating (SIGTERM) 09:31:38.094955 --- ParallelTerminationStrategy: PID 1450 died... 09:31:38.114061 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1450): Terminated: ok {rc=0} 09:31:38.157343 --- ParallelTerminationStrategy: PID 1453 died... 09:31:38.175735 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1453): Terminated: ok {rc=0} 09:31:38.219136 --- ParallelTerminationStrategy: PID 1456 died... 09:31:38.237717 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1456): Terminated: ok {rc=0} 09:31:38.319508 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2402 gprs:nanobts+band-1900+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any --------------------------------------------------------------------- 09:31:39.615094 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:31:39.623598 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 09:31:39.648408 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 09:31:39.684289 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 09:31:39.737487 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 09:31:39.761728 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 09:31:39.797011 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 09:31:40.361444 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2402 dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 09:31:40.367749 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 09:31:40.380421 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 09:31:40.444742 tst switch_tch_pdch.py: using LAC 39998 09:31:40.569148 tst switch_tch_pdch.py: using RAC 218 09:31:40.692147 tst switch_tch_pdch.py: using CellId 39998 09:31:40.815805 tst switch_tch_pdch.py: using BVCI 39999 09:31:40.929758 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 09:31:40.941781 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 09:31:40.953583 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 09:31:40.965402 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 09:31:40.977297 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 09:31:40.989102 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 09:31:41.001074 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 09:31:41.013499 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 09:31:41.129232 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 09:31:41.244319 tst switch_tch_pdch.py:51: start network... 09:31:41.441472 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:31:41.899115 run create_hlr_db(pid=1461): Launched 09:31:42.011800 bus /gobi_6: Setting Powered False 09:31:43.075204 run create_hlr_db(pid=1461): Terminated: ok {rc=0} 09:31:43.514893 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1463): Launched 09:31:43.830636 run osmo-hlr_10.42.42.2(pid=1464): Launched 09:31:43.950712 run osmo-stp_10.42.42.5: Starting osmo-stp 09:31:44.495132 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1466): Launched 09:31:44.808821 run osmo-stp_10.42.42.5(pid=1467): Launched 09:31:44.927162 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:31:45.471284 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1469): Launched 09:31:45.591170 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:31:45.869370 run patchelf(pid=1470): Launched 09:31:46.073721 run osmo-stp_10.42.42.5(pid=1467): ERR: Terminated: ERROR {rc=1} [trial-2402↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1467)] 09:31:46.209841 run osmo-stp_10.42.42.5(pid=1467): stdout: | (launched: 2022-12-14_09:31:44.750540) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:31:46.347193 run osmo-stp_10.42.42.5(pid=1467): stderr: | 20221214093144940 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214093144940 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214093144940 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214093144941 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214093144941 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214093144942 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214093144942 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:31:46.484537 run osmo-stp_10.42.42.5(pid=1467): stdout: | (launched: 2022-12-14_09:31:44.750540) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:31:46.616515 run osmo-stp_10.42.42.5(pid=1467): stderr: | 20221214093144940 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214093144940 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214093144940 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214093144941 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214093144941 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214093144942 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214093144942 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:31:46.772262 run patchelf(pid=1470): Terminating (SIGINT) 09:31:46.952254 run patchelf(pid=1470): Terminated: ok {rc=0} 09:31:47.082020 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=1467): Process ended prematurely: osmo-stp_10.42.42.5(pid=1467) [trial-2402↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1467)] [trial-2402↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54] 09:31:47.092682 tst switch_tch_pdch.py:54: Test FAILED (6.7 sec) 09:31:47.121961 run osmo-hlr_10.42.42.2(pid=1464): ERR: Terminated: ERROR {rc=237} [trial-2402↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1464)] 09:31:47.173299 run osmo-hlr_10.42.42.2(pid=1464): stdout: | (launched: 2022-12-14_09:31:43.772103) 09:31:47.225374 run osmo-hlr_10.42.42.2(pid=1464): stderr: | 20221214093143965 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214093143965 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214093143966 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214093143966 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214093143966 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214093143966 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214093143978 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214093143987 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214093143987 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214093143987 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:31:47.277562 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1463): Terminating (SIGTERM) 09:31:47.319266 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1466): Terminating (SIGTERM) 09:31:47.360760 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1469): Terminating (SIGTERM) 09:31:47.403055 --- ParallelTerminationStrategy: PID 1463 died... 09:31:47.422978 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1463): Terminated: ok {rc=0} 09:31:47.468664 --- ParallelTerminationStrategy: PID 1466 died... 09:31:47.488229 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1466): Terminated: ok {rc=0} 09:31:47.533794 --- ParallelTerminationStrategy: PID 1469 died... 09:31:47.553200 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1469): Terminated: ok {rc=0} 09:31:47.639713 bus /gobi_0: Setting Powered False 09:31:48.737720 bus /gobi_0: Setting Powered False 09:31:49.852492 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2402 dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 sms:nanobts+band-900 --------------------------------------------------------------------- 09:31:51.096708 tst sms:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:31:51.102107 tst sms:nanobts+band-900: Verifying 1 x bts (candidates: 11) 09:31:51.134808 tst sms:nanobts+band-900: Verifying 6 x ip_address (candidates: 9) 09:31:51.162313 tst sms:nanobts+band-900: Verifying 2 x modem (candidates: 12) 09:31:51.214462 tst sms:nanobts+band-900: Reserving 1 x bts (candidates: 11) 09:31:51.247060 tst sms:nanobts+band-900: Reserving 6 x ip_address (candidates: 9) 09:31:51.273987 tst sms:nanobts+band-900: Reserving 2 x modem (candidates: 12) 09:31:51.823891 tst sms:nanobts+band-900: RESERVED RESOURCES for sms: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2402 sms:nanobts+band-900 mo_mt_sms.py ---------------------------------------------- 09:31:51.829046 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 09:31:51.840026 tst sms:nanobts+band-900: Using 1 x bts (candidates: 1) 09:31:51.886223 tst mo_mt_sms.py: using LAC 39999 09:31:52.011887 tst mo_mt_sms.py: using RAC 219 09:31:52.136729 tst mo_mt_sms.py: using CellId 39999 09:31:52.259880 tst mo_mt_sms.py: using BVCI 40000 09:31:52.374002 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 09:31:52.385087 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 09:31:52.396053 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 09:31:52.406974 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 09:31:52.417974 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 09:31:52.428886 tst sms:nanobts+band-900: Using 1 x modem (candidates: 2) 09:31:52.544264 tst sms:nanobts+band-900: Using 1 x modem (candidates: 2) 09:31:52.661467 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:31:53.149698 run create_hlr_db(pid=1474): Launched 09:31:53.276481 bus /gobi_6: Setting Powered False 09:31:54.341229 run create_hlr_db(pid=1474): Terminated: ok {rc=0} 09:31:54.761941 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1476): Launched 09:31:55.055700 run osmo-hlr_10.42.42.2(pid=1477): Launched 09:31:55.166445 run osmo-stp_10.42.42.5: Starting osmo-stp 09:31:55.683076 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1479): Launched 09:31:55.977214 run osmo-stp_10.42.42.5(pid=1480): Launched 09:31:56.088516 run osmo-msc_10.42.42.6: Starting osmo-msc 09:31:56.620583 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1482): Launched 09:31:56.915483 run osmo-msc_10.42.42.6(pid=1483): Launched 09:31:57.079560 run osmo-stp_10.42.42.5(pid=1480): ERR: Terminated: ERROR {rc=1} [trial-2402↪sms:nanobts+band-900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1480)] 09:31:57.204205 run osmo-stp_10.42.42.5(pid=1480): stdout: | (launched: 2022-12-14_09:31:55.922365) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:31:57.328540 run osmo-stp_10.42.42.5(pid=1480): stderr: | 20221214093156090 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214093156090 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214093156090 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214093156091 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214093156091 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214093156091 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214093156091 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:31:57.451428 run osmo-stp_10.42.42.5(pid=1480): stdout: | (launched: 2022-12-14_09:31:55.922365) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:31:57.568321 run osmo-stp_10.42.42.5(pid=1480): stderr: | 20221214093156090 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214093156090 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214093156090 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214093156091 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214093156091 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214093156091 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214093156091 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:31:57.707796 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=1480): Process ended prematurely: osmo-stp_10.42.42.5(pid=1480) [trial-2402↪sms:nanobts+band-900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1480)] [trial-2402↪sms:nanobts+band-900↪mo_mt_sms.py:16] 09:31:57.716027 tst mo_mt_sms.py:16: Test FAILED (5.9 sec) 09:31:57.741759 run osmo-hlr_10.42.42.2(pid=1477): ERR: Terminated: ERROR {rc=237} [trial-2402↪sms:nanobts+band-900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1477)] 09:31:57.790074 run osmo-hlr_10.42.42.2(pid=1477): stdout: | (launched: 2022-12-14_09:31:55.000809) 09:31:57.838897 run osmo-hlr_10.42.42.2(pid=1477): stderr: | 20221214093155172 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214093155172 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214093155172 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214093155172 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214093155172 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214093155172 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214093155183 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/sms:nanobts+band-900/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214093155192 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214093155192 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214093155192 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:31:57.907397 run osmo-msc_10.42.42.6(pid=1483): ERR: Terminated: ERROR {rc=2} [trial-2402↪sms:nanobts+band-900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1483)] 09:31:57.954147 run osmo-msc_10.42.42.6(pid=1483): stdout: | (launched: 2022-12-14_09:31:56.860363) 09:31:58.002879 run osmo-msc_10.42.42.6(pid=1483): stderr: | 20221214093157126 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214093157126 DLGLOBAL DEBUG validating counter group 0x7f1bd713ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214093157126 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214093157126 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214093157126 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214093157127 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214093157128 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214093157129 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214093157129 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214093157129 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:31:58.052648 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1476): Terminating (SIGTERM) 09:31:58.091836 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1479): Terminating (SIGTERM) 09:31:58.130985 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1482): Terminating (SIGTERM) 09:31:58.170381 --- ParallelTerminationStrategy: PID 1476 died... 09:31:58.189449 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1476): Terminated: ok {rc=0} 09:31:58.233062 --- ParallelTerminationStrategy: PID 1479 died... 09:31:58.251751 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1479): Terminated: ok {rc=0} 09:31:58.295135 --- ParallelTerminationStrategy: PID 1482 died... 09:31:58.313994 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1482): Terminated: ok {rc=0} 09:31:58.398877 bus /sierra_3: Setting Powered False 09:31:59.495617 bus /sierra_3: Setting Powered False 09:32:00.606020 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2402 sms:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 nitb_ussd:nanobts+band-900 --------------------------------------------------------------------- 09:32:01.877849 tst nitb_ussd:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:32:01.883591 tst nitb_ussd:nanobts+band-900: Verifying 1 x bts (candidates: 11) 09:32:01.927528 tst nitb_ussd:nanobts+band-900: Verifying 1 x ip_address (candidates: 9) 09:32:01.936938 tst nitb_ussd:nanobts+band-900: Verifying 1 x modem (candidates: 12) 09:32:01.979945 tst nitb_ussd:nanobts+band-900: Reserving 1 x bts (candidates: 11) 09:32:02.012565 tst nitb_ussd:nanobts+band-900: Reserving 1 x ip_address (candidates: 9) 09:32:02.020287 tst nitb_ussd:nanobts+band-900: Reserving 1 x modem (candidates: 12) 09:32:02.536733 tst nitb_ussd:nanobts+band-900: RESERVED RESOURCES for nitb_ussd: bts NanoBTS-ONW-900 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2402 nitb_ussd:nanobts+band-900 assert_extension.py ---------------------------------------------- 09:32:02.541928 tst nitb_ussd:nanobts+band-900: Using 1 x ip_address (candidates: 1) 09:32:02.552568 tst nitb_ussd:nanobts+band-900: Using 1 x bts (candidates: 1) 09:32:02.598451 tst assert_extension.py: using LAC 40000 09:32:02.716926 tst assert_extension.py: using RAC 220 09:32:02.833110 tst assert_extension.py: using CellId 40000 09:32:02.957405 tst assert_extension.py: using BVCI 40001 09:32:03.071925 tst nitb_ussd:nanobts+band-900: Using 1 x modem (candidates: 1) 09:32:03.187842 tst assert_extension.py:10: start nitb and bts... 09:32:03.385414 run osmo-nitb_10.42.42.2: Starting osmo-nitb 09:32:03.989542 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=1488): Launched 09:32:04.285343 run osmo-nitb_10.42.42.2(pid=1489): Launched 09:32:04.448734 run osmo-nitb_10.42.42.2(pid=1489): ERR: Terminated: ERROR {rc=2} [trial-2402↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=1489)] 09:32:04.581787 run osmo-nitb_10.42.42.2(pid=1489): stdout: | (launched: 2022-12-14_09:32:04.230248) 09:32:04.715999 run osmo-nitb_10.42.42.2(pid=1489): stderr: | (launched: 2022-12-14_09:32:04.273990) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 09:32:04.850040 run osmo-nitb_10.42.42.2(pid=1489): stdout: | (launched: 2022-12-14_09:32:04.230248) 09:32:04.978814 run osmo-nitb_10.42.42.2(pid=1489): stderr: | (launched: 2022-12-14_09:32:04.273990) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fe4ae4b0268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=1489): Process ended prematurely: osmo-nitb_10.42.42.2(pid=1489) [trial-2402↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=1489)] 09:32:05.396630 tst osmo-nitb_10.42.42.2(pid=1489): stdout: | (launched: 2022-12-14_09:32:04.230248) 09:32:05.515556 tst osmo-nitb_10.42.42.2(pid=1489): stderr: | (launched: 2022-12-14_09:32:04.273990) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 09:32:05.655661 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=1489): Process ended prematurely: osmo-nitb_10.42.42.2(pid=1489) [trial-2402↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=1489)] [trial-2402↪nitb_ussd:nanobts+band-900↪assert_extension.py:12] 09:32:05.664119 tst assert_extension.py:12: Test FAILED (3.1 sec) 09:32:05.670663 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=1488): Terminating (SIGTERM) 09:32:05.879383 --- ParallelTerminationStrategy: PID 1488 died... 09:32:05.899924 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=1488): Terminated: ok {rc=0} 09:32:05.985096 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2402 nitb_ussd:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 ussd:nanobts+band-900 --------------------------------------------------------------------- 09:32:07.160555 tst ussd:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:32:07.165302 tst ussd:nanobts+band-900: Verifying 1 x bts (candidates: 11) 09:32:07.197006 tst ussd:nanobts+band-900: Verifying 6 x ip_address (candidates: 9) 09:32:07.224351 tst ussd:nanobts+band-900: Verifying 1 x modem (candidates: 12) 09:32:07.258771 tst ussd:nanobts+band-900: Reserving 1 x bts (candidates: 11) 09:32:07.290461 tst ussd:nanobts+band-900: Reserving 6 x ip_address (candidates: 9) 09:32:07.316714 tst ussd:nanobts+band-900: Reserving 1 x modem (candidates: 12) 09:32:07.850380 tst ussd:nanobts+band-900: RESERVED RESOURCES for ussd: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2402 ussd:nanobts+band-900 assert_extension.py ---------------------------------------------- 09:32:07.856448 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 09:32:07.867395 tst ussd:nanobts+band-900: Using 1 x bts (candidates: 1) 09:32:07.913758 tst assert_extension.py: using LAC 40001 09:32:08.030314 tst assert_extension.py: using RAC 221 09:32:08.145401 tst assert_extension.py: using CellId 40001 09:32:08.260447 tst assert_extension.py: using BVCI 40002 09:32:08.367190 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 09:32:08.378072 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 09:32:08.388708 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 09:32:08.399363 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 09:32:08.410358 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 09:32:08.421621 tst ussd:nanobts+band-900: Using 1 x modem (candidates: 1) 09:32:08.540825 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:32:09.029732 run create_hlr_db(pid=1493): Launched 09:32:09.158978 bus /sierra_2: Setting Powered False 09:32:10.221646 run create_hlr_db(pid=1493): Terminated: ok {rc=0} 09:32:10.643982 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1495): Launched 09:32:10.939627 run osmo-hlr_10.42.42.2(pid=1496): Launched 09:32:11.052196 run osmo-stp_10.42.42.5: Starting osmo-stp 09:32:11.574042 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1498): Launched 09:32:11.869606 run osmo-stp_10.42.42.5(pid=1499): Launched 09:32:11.981475 run osmo-msc_10.42.42.6: Starting osmo-msc 09:32:12.514595 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1501): Launched 09:32:12.808559 run osmo-msc_10.42.42.6(pid=1502): Launched 09:32:12.972800 run osmo-stp_10.42.42.5(pid=1499): ERR: Terminated: ERROR {rc=1} [trial-2402↪ussd:nanobts+band-900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1499)] 09:32:13.098280 run osmo-stp_10.42.42.5(pid=1499): stdout: | (launched: 2022-12-14_09:32:11.813145) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:32:13.223345 run osmo-stp_10.42.42.5(pid=1499): stderr: | 20221214093211981 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214093211982 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214093211982 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214093211982 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214093211983 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214093211983 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214093211983 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:32:13.346455 run osmo-stp_10.42.42.5(pid=1499): stdout: | (launched: 2022-12-14_09:32:11.813145) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:32:13.463115 run osmo-stp_10.42.42.5(pid=1499): stderr: | 20221214093211981 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214093211982 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214093211982 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214093211982 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214093211983 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214093211983 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214093211983 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:32:13.602525 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=1499): Process ended prematurely: osmo-stp_10.42.42.5(pid=1499) [trial-2402↪ussd:nanobts+band-900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1499)] [trial-2402↪ussd:nanobts+band-900↪assert_extension.py:17] 09:32:13.610843 tst assert_extension.py:17: Test FAILED (5.7 sec) 09:32:13.636754 run osmo-hlr_10.42.42.2(pid=1496): ERR: Terminated: ERROR {rc=237} [trial-2402↪ussd:nanobts+band-900↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1496)] 09:32:13.684711 run osmo-hlr_10.42.42.2(pid=1496): stdout: | (launched: 2022-12-14_09:32:10.884583) 09:32:13.733960 run osmo-hlr_10.42.42.2(pid=1496): stderr: | 20221214093211056 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214093211056 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214093211057 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214093211057 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214093211057 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214093211057 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214093211069 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/ussd:nanobts+band-900/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214093211077 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214093211077 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214093211077 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:32:13.803004 run osmo-msc_10.42.42.6(pid=1502): ERR: Terminated: ERROR {rc=2} [trial-2402↪ussd:nanobts+band-900↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1502)] 09:32:13.850025 run osmo-msc_10.42.42.6(pid=1502): stdout: | (launched: 2022-12-14_09:32:12.753739) 09:32:13.898993 run osmo-msc_10.42.42.6(pid=1502): stderr: | 20221214093213019 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214093213020 DLGLOBAL DEBUG validating counter group 0x7fb284215c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214093213020 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214093213020 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214093213020 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214093213020 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214093213022 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214093213022 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214093213023 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214093213023 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:32:13.948885 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1495): Terminating (SIGTERM) 09:32:13.988565 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1498): Terminating (SIGTERM) 09:32:14.028631 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1501): Terminating (SIGTERM) 09:32:14.068379 --- ParallelTerminationStrategy: PID 1495 died... 09:32:14.087886 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1495): Terminated: ok {rc=0} 09:32:14.131573 --- ParallelTerminationStrategy: PID 1498 died... 09:32:14.150457 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1498): Terminated: ok {rc=0} 09:32:14.194227 --- ParallelTerminationStrategy: PID 1501 died... 09:32:14.213056 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1501): Terminated: ok {rc=0} 09:32:14.298138 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2402 ussd:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 09:32:15.505325 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:32:15.512499 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 09:32:15.543930 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 09:32:15.572170 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 09:32:15.624455 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 09:32:15.658324 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 09:32:15.686759 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 09:32:16.255626 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2402 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 09:32:16.311063 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:32:16.323315 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 09:32:16.392471 tst mo_mt_call.py: using LAC 40002 09:32:16.557168 tst mo_mt_call.py: using RAC 222 09:32:16.684404 tst mo_mt_call.py: using CellId 40002 09:32:16.832884 tst mo_mt_call.py: using BVCI 40003 09:32:16.959775 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:32:16.971683 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:32:16.983558 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:32:16.995346 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:32:17.008084 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:32:17.020728 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 09:32:17.140670 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 09:32:17.258275 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:32:17.728331 run create_hlr_db(pid=1507): Launched 09:32:17.843528 bus /sierra_2: Setting Powered False 09:32:18.903052 run create_hlr_db(pid=1507): Terminated: ok {rc=0} 09:32:19.320701 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1509): Launched 09:32:19.621331 run osmo-hlr_10.42.42.2(pid=1510): Launched 09:32:19.735488 run osmo-stp_10.42.42.5: Starting osmo-stp 09:32:20.264751 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1512): Launched 09:32:20.564550 run osmo-stp_10.42.42.5(pid=1513): Launched 09:32:20.679245 run osmo-msc_10.42.42.6: Starting osmo-msc 09:32:21.222057 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1515): Launched 09:32:21.521863 run osmo-msc_10.42.42.6(pid=1516): Launched 09:32:21.689628 run osmo-stp_10.42.42.5(pid=1513): ERR: Terminated: ERROR {rc=1} [trial-2402↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1513)] 09:32:21.816384 run osmo-stp_10.42.42.5(pid=1513): stdout: | (launched: 2022-12-14_09:32:20.508622) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:32:21.942598 run osmo-stp_10.42.42.5(pid=1513): stderr: | 20221214093220674 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214093220674 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214093220675 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214093220675 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214093220675 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214093220676 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214093220676 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:32:22.067285 run osmo-stp_10.42.42.5(pid=1513): stdout: | (launched: 2022-12-14_09:32:20.508622) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:32:22.186469 run osmo-stp_10.42.42.5(pid=1513): stderr: | 20221214093220674 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214093220674 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214093220675 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214093220675 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214093220675 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214093220676 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214093220676 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:32:22.329244 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1513): Process ended prematurely: osmo-stp_10.42.42.5(pid=1513) [trial-2402↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1513)] [trial-2402↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 09:32:22.338027 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 09:32:22.364406 run osmo-hlr_10.42.42.2(pid=1510): ERR: Terminated: ERROR {rc=237} [trial-2402↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1510)] 09:32:22.412155 run osmo-hlr_10.42.42.2(pid=1510): stdout: | (launched: 2022-12-14_09:32:19.565080) 09:32:22.461269 run osmo-hlr_10.42.42.2(pid=1510): stderr: | 20221214093219738 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214093219738 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214093219738 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214093219738 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214093219738 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214093219738 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214093219751 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214093219759 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214093219759 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214093219759 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:32:22.530284 run osmo-msc_10.42.42.6(pid=1516): ERR: Terminated: ERROR {rc=2} [trial-2402↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1516)] 09:32:22.577183 run osmo-msc_10.42.42.6(pid=1516): stdout: | (launched: 2022-12-14_09:32:21.465492) 09:32:22.626155 run osmo-msc_10.42.42.6(pid=1516): stderr: | 20221214093221734 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214093221734 DLGLOBAL DEBUG validating counter group 0x7f18a0a60c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214093221734 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214093221734 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214093221735 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214093221735 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214093221736 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214093221737 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214093221737 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214093221737 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:32:22.675341 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1509): Terminating (SIGTERM) 09:32:22.714958 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1512): Terminating (SIGTERM) 09:32:22.754562 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1515): Terminating (SIGTERM) 09:32:22.794455 --- ParallelTerminationStrategy: PID 1509 died... 09:32:22.813860 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1509): Terminated: ok {rc=0} 09:32:22.857806 --- ParallelTerminationStrategy: PID 1512 died... 09:32:22.876400 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1512): Terminated: ok {rc=0} 09:32:22.920349 --- ParallelTerminationStrategy: PID 1515 died... 09:32:22.939243 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1515): Terminated: ok {rc=0} 09:32:23.022140 bus /sierra_3: Setting Powered False 09:32:24.117401 bus /sierra_3: Setting Powered False 09:32:25.230782 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2402 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 09:32:26.374923 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:32:26.386976 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 09:32:26.454064 tst mo_mt_call_osmux.py: using LAC 40003 09:32:26.571556 tst mo_mt_call_osmux.py: using RAC 223 09:32:26.690351 tst mo_mt_call_osmux.py: using CellId 40003 09:32:26.809332 tst mo_mt_call_osmux.py: using BVCI 40004 09:32:26.919629 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:32:26.931012 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:32:26.942055 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:32:26.953130 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:32:26.964503 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:32:26.975952 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 09:32:27.094850 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 09:32:27.211948 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:32:27.714480 run create_hlr_db(pid=1518): Launched 09:32:27.846010 bus /sierra_2: Setting Powered False 09:32:28.910170 run create_hlr_db(pid=1518): Terminated: ok {rc=0} 09:32:29.339366 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1520): Launched 09:32:29.639933 run osmo-hlr_10.42.42.2(pid=1521): Launched 09:32:29.755529 run osmo-stp_10.42.42.5: Starting osmo-stp 09:32:30.276435 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1523): Launched 09:32:30.578111 run osmo-stp_10.42.42.5(pid=1524): Launched 09:32:30.692439 run osmo-msc_10.42.42.6: Starting osmo-msc 09:32:31.310013 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1526): Launched 09:32:31.651298 run osmo-msc_10.42.42.6(pid=1527): Launched 09:32:32.096261 run osmo-stp_10.42.42.5(pid=1524): ERR: Terminated: ERROR {rc=1} [trial-2402↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1524)] 09:32:32.306472 run osmo-stp_10.42.42.5(pid=1524): stdout: | (launched: 2022-12-14_09:32:30.521904) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:32:32.433865 run osmo-stp_10.42.42.5(pid=1524): stderr: | 20221214093230687 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214093230687 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214093230688 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214093230688 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214093230689 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214093230689 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214093230689 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:32:32.559312 run osmo-stp_10.42.42.5(pid=1524): stdout: | (launched: 2022-12-14_09:32:30.521904) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:32:32.679027 run osmo-stp_10.42.42.5(pid=1524): stderr: | 20221214093230687 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214093230687 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214093230688 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214093230688 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214093230689 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214093230689 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214093230689 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:32:32.822503 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1524): Process ended prematurely: osmo-stp_10.42.42.5(pid=1524) [trial-2402↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1524)] [trial-2402↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 09:32:32.831386 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 09:32:32.857685 run osmo-hlr_10.42.42.2(pid=1521): ERR: Terminated: ERROR {rc=237} [trial-2402↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1521)] 09:32:32.905554 run osmo-hlr_10.42.42.2(pid=1521): stdout: | (launched: 2022-12-14_09:32:29.584098) 09:32:32.954686 run osmo-hlr_10.42.42.2(pid=1521): stderr: | 20221214093229757 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214093229757 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214093229757 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214093229757 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214093229757 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214093229757 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214093229768 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214093229776 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214093229776 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214093229776 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:32:33.023914 run osmo-msc_10.42.42.6(pid=1527): ERR: Terminated: ERROR {rc=2} [trial-2402↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1527)] 09:32:33.071000 run osmo-msc_10.42.42.6(pid=1527): stdout: | (launched: 2022-12-14_09:32:31.588593) 09:32:33.120803 run osmo-msc_10.42.42.6(pid=1527): stderr: | 20221214093231979 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214093231979 DLGLOBAL DEBUG validating counter group 0x7f241ee9ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214093231979 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214093231979 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214093231979 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214093231979 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214093231984 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214093231985 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214093231985 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214093231986 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:32:33.170280 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1520): Terminating (SIGTERM) 09:32:33.209694 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1523): Terminating (SIGTERM) 09:32:33.249134 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1526): Terminating (SIGTERM) 09:32:33.288841 --- ParallelTerminationStrategy: PID 1520 died... 09:32:33.308090 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1520): Terminated: ok {rc=0} 09:32:33.351925 --- ParallelTerminationStrategy: PID 1523 died... 09:32:33.370817 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1523): Terminated: ok {rc=0} 09:32:33.414700 --- ParallelTerminationStrategy: PID 1526 died... 09:32:33.433469 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1526): Terminated: ok {rc=0} 09:32:33.519133 bus /sierra_3: Setting Powered False 09:32:34.617304 bus /sierra_3: Setting Powered False 09:32:35.729921 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2402 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 09:32:37.000212 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:32:37.009220 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 09:32:37.040577 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 09:32:37.067346 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 09:32:37.119830 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 09:32:37.151270 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 09:32:37.177880 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 09:32:37.731949 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2402 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 09:32:37.783407 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:32:37.795262 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 09:32:37.863168 tst mo_mt_call.py: using LAC 40004 09:32:37.993728 tst mo_mt_call.py: using RAC 224 09:32:38.112359 tst mo_mt_call.py: using CellId 40004 09:32:38.229359 tst mo_mt_call.py: using BVCI 40005 09:32:38.338525 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:32:38.350258 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:32:38.361541 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:32:38.372599 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:32:38.383966 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:32:38.395424 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 09:32:38.511760 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 09:32:38.628773 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:32:39.127027 run create_hlr_db(pid=1532): Launched 09:32:39.257792 bus /sierra_2: Setting Powered False 09:32:40.321802 run create_hlr_db(pid=1532): Terminated: ok {rc=0} 09:32:40.768027 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1534): Launched 09:32:41.088933 run osmo-hlr_10.42.42.2(pid=1535): Launched 09:32:41.210230 run osmo-stp_10.42.42.5: Starting osmo-stp 09:32:41.768866 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1537): Launched 09:32:42.091376 run osmo-stp_10.42.42.5(pid=1538): Launched 09:32:42.213362 run osmo-msc_10.42.42.6: Starting osmo-msc 09:32:42.794498 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1540): Launched 09:32:43.115669 run osmo-msc_10.42.42.6(pid=1541): Launched 09:32:43.295619 run osmo-stp_10.42.42.5(pid=1538): ERR: Terminated: ERROR {rc=1} [trial-2402↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1538)] 09:32:43.430876 run osmo-stp_10.42.42.5(pid=1538): stdout: | (launched: 2022-12-14_09:32:42.031333) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:32:43.566357 run osmo-stp_10.42.42.5(pid=1538): stderr: | 20221214093242220 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214093242220 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214093242220 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214093242221 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214093242221 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214093242221 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214093242221 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:32:43.700520 run osmo-stp_10.42.42.5(pid=1538): stdout: | (launched: 2022-12-14_09:32:42.031333) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:32:43.828142 run osmo-stp_10.42.42.5(pid=1538): stderr: | 20221214093242220 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214093242220 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214093242220 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214093242221 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214093242221 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214093242221 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214093242221 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:32:43.980591 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1538): Process ended prematurely: osmo-stp_10.42.42.5(pid=1538) [trial-2402↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1538)] [trial-2402↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 09:32:43.990323 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 09:32:44.018085 run osmo-hlr_10.42.42.2(pid=1535): ERR: Terminated: ERROR {rc=237} [trial-2402↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1535)] 09:32:44.068305 run osmo-hlr_10.42.42.2(pid=1535): stdout: | (launched: 2022-12-14_09:32:41.029527) 09:32:44.119877 run osmo-hlr_10.42.42.2(pid=1535): stderr: | 20221214093241224 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214093241224 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214093241225 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214093241225 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214093241225 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214093241225 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214093241240 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214093241248 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214093241248 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214093241248 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:32:44.191797 run osmo-msc_10.42.42.6(pid=1541): ERR: Terminated: ERROR {rc=2} [trial-2402↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1541)] 09:32:44.241462 run osmo-msc_10.42.42.6(pid=1541): stdout: | (launched: 2022-12-14_09:32:43.055620) 09:32:44.292654 run osmo-msc_10.42.42.6(pid=1541): stderr: | 20221214093243373 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214093243373 DLGLOBAL DEBUG validating counter group 0x7fd3a1dfac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214093243373 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214093243373 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214093243373 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214093243373 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214093243375 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214093243375 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214093243376 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214093243376 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:32:44.344347 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1534): Terminating (SIGTERM) 09:32:44.385908 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1537): Terminating (SIGTERM) 09:32:44.427830 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1540): Terminating (SIGTERM) 09:32:44.469871 --- ParallelTerminationStrategy: PID 1534 died... 09:32:44.490003 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1534): Terminated: ok {rc=0} 09:32:44.535989 --- ParallelTerminationStrategy: PID 1537 died... 09:32:44.555535 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1537): Terminated: ok {rc=0} 09:32:44.601426 --- ParallelTerminationStrategy: PID 1540 died... 09:32:44.620898 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1540): Terminated: ok {rc=0} 09:32:44.707734 bus /sierra_3: Setting Powered False 09:32:45.802577 bus /sierra_3: Setting Powered False 09:32:46.921133 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2402 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 09:32:48.064537 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:32:48.076523 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 09:32:48.142686 tst mo_mt_call_osmux.py: using LAC 40005 09:32:48.261139 tst mo_mt_call_osmux.py: using RAC 225 09:32:48.385687 tst mo_mt_call_osmux.py: using CellId 40005 09:32:48.504722 tst mo_mt_call_osmux.py: using BVCI 40006 09:32:48.613761 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:32:48.625142 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:32:48.636084 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:32:48.647228 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:32:48.658766 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:32:48.670192 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 09:32:48.789093 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 09:32:48.906186 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:32:49.407451 run create_hlr_db(pid=1543): Launched 09:32:49.537765 bus /sierra_2: Setting Powered False 09:32:50.602003 run create_hlr_db(pid=1543): Terminated: ok {rc=0} 09:32:51.049563 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1545): Launched 09:32:51.371276 run osmo-hlr_10.42.42.2(pid=1546): Launched 09:32:51.493089 run osmo-stp_10.42.42.5: Starting osmo-stp 09:32:52.044125 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1548): Launched 09:32:52.365283 run osmo-stp_10.42.42.5(pid=1549): Launched 09:32:52.487633 run osmo-msc_10.42.42.6: Starting osmo-msc 09:32:53.067577 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1551): Launched 09:32:53.389164 run osmo-msc_10.42.42.6(pid=1552): Launched 09:32:53.567083 run osmo-stp_10.42.42.5(pid=1549): ERR: Terminated: ERROR {rc=1} [trial-2402↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1549)] 09:32:53.701262 run osmo-stp_10.42.42.5(pid=1549): stdout: | (launched: 2022-12-14_09:32:52.305900) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:32:53.836545 run osmo-stp_10.42.42.5(pid=1549): stderr: | 20221214093252494 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214093252494 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214093252494 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214093252495 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214093252495 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214093252495 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214093252495 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:32:53.970075 run osmo-stp_10.42.42.5(pid=1549): stdout: | (launched: 2022-12-14_09:32:52.305900) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:32:54.098275 run osmo-stp_10.42.42.5(pid=1549): stderr: | 20221214093252494 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214093252494 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214093252494 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214093252495 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214093252495 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214093252495 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214093252495 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:32:54.250603 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1549): Process ended prematurely: osmo-stp_10.42.42.5(pid=1549) [trial-2402↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1549)] [trial-2402↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 09:32:54.260088 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 09:32:54.287787 run osmo-hlr_10.42.42.2(pid=1546): ERR: Terminated: ERROR {rc=237} [trial-2402↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1546)] 09:32:54.337963 run osmo-hlr_10.42.42.2(pid=1546): stdout: | (launched: 2022-12-14_09:32:51.311779) 09:32:54.389759 run osmo-hlr_10.42.42.2(pid=1546): stderr: | 20221214093251505 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214093251505 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214093251505 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214093251505 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214093251505 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214093251506 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214093251520 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214093251530 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214093251530 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214093251530 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:32:54.462158 run osmo-msc_10.42.42.6(pid=1552): ERR: Terminated: ERROR {rc=2} [trial-2402↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1552)] 09:32:54.512226 run osmo-msc_10.42.42.6(pid=1552): stdout: | (launched: 2022-12-14_09:32:53.329326) 09:32:54.563839 run osmo-msc_10.42.42.6(pid=1552): stderr: | 20221214093253648 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214093253648 DLGLOBAL DEBUG validating counter group 0x7fd7c9183c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214093253648 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214093253648 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214093253649 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214093253649 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214093253650 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214093253651 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214093253651 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214093253651 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:32:54.615708 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1545): Terminating (SIGTERM) 09:32:54.657283 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1548): Terminating (SIGTERM) 09:32:54.699158 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1551): Terminating (SIGTERM) 09:32:54.741183 --- ParallelTerminationStrategy: PID 1545 died... 09:32:54.761113 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1545): Terminated: ok {rc=0} 09:32:54.806640 --- ParallelTerminationStrategy: PID 1548 died... 09:32:54.826054 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1548): Terminated: ok {rc=0} 09:32:54.871560 --- ParallelTerminationStrategy: PID 1551 died... 09:32:54.890898 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1551): Terminated: ok {rc=0} 09:32:54.978461 bus /sierra_3: Setting Powered False 09:32:56.076101 bus /sierra_3: Setting Powered False 09:32:57.190366 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2402 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 09:32:58.443540 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:32:58.453317 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 09:32:58.486184 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 09:32:58.513679 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 09:32:58.567527 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 09:32:58.602036 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 09:32:58.629377 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 09:32:59.178427 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2402 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 09:32:59.231127 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:32:59.242974 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 09:32:59.311459 tst mo_mt_call.py: using LAC 40006 09:32:59.437946 tst mo_mt_call.py: using RAC 226 09:32:59.566049 tst mo_mt_call.py: using CellId 40006 09:32:59.693969 tst mo_mt_call.py: using BVCI 40007 09:32:59.812223 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:32:59.823926 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:32:59.835367 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:32:59.846811 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:32:59.858659 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:32:59.870344 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 09:32:59.987472 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 09:33:00.106934 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:33:00.607202 run create_hlr_db(pid=1557): Launched 09:33:00.730264 bus /sierra_2: Setting Powered False 09:33:01.793498 run create_hlr_db(pid=1557): Terminated: ok {rc=0} 09:33:02.293586 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1560): Launched 09:33:02.605612 run osmo-hlr_10.42.42.2(pid=1561): Launched 09:33:02.719137 run osmo-stp_10.42.42.5: Starting osmo-stp 09:33:03.247313 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1563): Launched 09:33:03.547021 run osmo-stp_10.42.42.5(pid=1564): Launched 09:33:03.660246 run osmo-msc_10.42.42.6: Starting osmo-msc 09:33:04.200579 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1566): Launched 09:33:04.501616 run osmo-msc_10.42.42.6(pid=1567): Launched 09:33:04.669513 run osmo-stp_10.42.42.5(pid=1564): ERR: Terminated: ERROR {rc=1} [trial-2402↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1564)] 09:33:04.796887 run osmo-stp_10.42.42.5(pid=1564): stdout: | (launched: 2022-12-14_09:33:03.491264) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:33:04.924320 run osmo-stp_10.42.42.5(pid=1564): stderr: | 20221214093303659 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214093303659 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214093303660 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214093303660 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214093303661 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214093303661 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214093303661 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:33:05.049467 run osmo-stp_10.42.42.5(pid=1564): stdout: | (launched: 2022-12-14_09:33:03.491264) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:33:05.169069 run osmo-stp_10.42.42.5(pid=1564): stderr: | 20221214093303659 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214093303659 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214093303660 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214093303660 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214093303661 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214093303661 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214093303661 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:33:05.311847 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1564): Process ended prematurely: osmo-stp_10.42.42.5(pid=1564) [trial-2402↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1564)] [trial-2402↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 09:33:05.320729 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 09:33:05.347141 run osmo-hlr_10.42.42.2(pid=1561): ERR: Terminated: ERROR {rc=237} [trial-2402↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1561)] 09:33:05.395086 run osmo-hlr_10.42.42.2(pid=1561): stdout: | (launched: 2022-12-14_09:33:02.549221) 09:33:05.444768 run osmo-hlr_10.42.42.2(pid=1561): stderr: | 20221214093302722 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214093302722 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214093302722 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214093302722 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214093302722 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214093302722 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214093302734 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214093302743 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214093302743 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214093302743 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:33:05.513981 run osmo-msc_10.42.42.6(pid=1567): ERR: Terminated: ERROR {rc=2} [trial-2402↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1567)] 09:33:05.561142 run osmo-msc_10.42.42.6(pid=1567): stdout: | (launched: 2022-12-14_09:33:04.445469) 09:33:05.610205 run osmo-msc_10.42.42.6(pid=1567): stderr: | 20221214093304715 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214093304715 DLGLOBAL DEBUG validating counter group 0x7f4271168c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214093304715 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214093304715 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214093304715 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214093304716 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214093304717 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214093304718 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214093304718 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214093304718 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:33:05.659561 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1560): Terminating (SIGTERM) 09:33:05.699055 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1563): Terminating (SIGTERM) 09:33:05.738531 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1566): Terminating (SIGTERM) 09:33:05.778311 --- ParallelTerminationStrategy: PID 1560 died... 09:33:05.797681 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1560): Terminated: ok {rc=0} 09:33:05.841387 --- ParallelTerminationStrategy: PID 1563 died... 09:33:05.860137 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1563): Terminated: ok {rc=0} 09:33:05.903600 --- ParallelTerminationStrategy: PID 1566 died... 09:33:05.922389 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1566): Terminated: ok {rc=0} 09:33:06.007532 bus /sierra_3: Setting Powered False 09:33:07.106544 bus /sierra_3: Setting Powered False 09:33:08.221222 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2402 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 09:33:09.368462 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:33:09.380922 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 09:33:09.451873 tst mo_mt_call_osmux.py: using LAC 40007 09:33:09.580915 tst mo_mt_call_osmux.py: using RAC 227 09:33:09.709807 tst mo_mt_call_osmux.py: using CellId 40007 09:33:09.836533 tst mo_mt_call_osmux.py: using BVCI 40008 09:33:09.954283 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:33:09.966258 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:33:09.978032 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:33:09.989888 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:33:10.001888 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:33:10.013817 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 09:33:10.129479 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 09:33:10.253167 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:33:10.754761 run create_hlr_db(pid=1569): Launched 09:33:10.886440 bus /sierra_2: Setting Powered False 09:33:11.950090 run create_hlr_db(pid=1569): Terminated: ok {rc=0} 09:33:12.399139 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1571): Launched 09:33:12.723310 run osmo-hlr_10.42.42.2(pid=1572): Launched 09:33:12.845553 run osmo-stp_10.42.42.5: Starting osmo-stp 09:33:13.406257 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1574): Launched 09:33:13.727474 run osmo-stp_10.42.42.5(pid=1575): Launched 09:33:13.849212 run osmo-msc_10.42.42.6: Starting osmo-msc 09:33:14.430326 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1577): Launched 09:33:14.754525 run osmo-msc_10.42.42.6(pid=1578): Launched 09:33:14.932683 run osmo-stp_10.42.42.5(pid=1575): ERR: Terminated: ERROR {rc=1} [trial-2402↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1575)] 09:33:15.067794 run osmo-stp_10.42.42.5(pid=1575): stdout: | (launched: 2022-12-14_09:33:13.668229) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:33:15.203264 run osmo-stp_10.42.42.5(pid=1575): stderr: | 20221214093313856 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214093313856 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214093313856 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214093313857 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214093313857 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214093313857 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214093313857 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:33:15.337658 run osmo-stp_10.42.42.5(pid=1575): stdout: | (launched: 2022-12-14_09:33:13.668229) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:33:15.465707 run osmo-stp_10.42.42.5(pid=1575): stderr: | 20221214093313856 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214093313856 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214093313856 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214093313857 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214093313857 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214093313857 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214093313857 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:33:15.618471 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1575): Process ended prematurely: osmo-stp_10.42.42.5(pid=1575) [trial-2402↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1575)] [trial-2402↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 09:33:15.628239 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 09:33:15.656274 run osmo-hlr_10.42.42.2(pid=1572): ERR: Terminated: ERROR {rc=237} [trial-2402↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1572)] 09:33:15.706274 run osmo-hlr_10.42.42.2(pid=1572): stdout: | (launched: 2022-12-14_09:33:12.663804) 09:33:15.757850 run osmo-hlr_10.42.42.2(pid=1572): stderr: | 20221214093312858 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214093312858 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214093312858 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214093312858 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214093312858 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214093312858 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214093312871 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214093312879 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214093312879 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214093312879 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:33:15.834582 run osmo-msc_10.42.42.6(pid=1578): ERR: Terminated: ERROR {rc=2} [trial-2402↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1578)] 09:33:15.896110 run osmo-msc_10.42.42.6(pid=1578): stdout: | (launched: 2022-12-14_09:33:14.694954) 09:33:15.957453 run osmo-msc_10.42.42.6(pid=1578): stderr: | 20221214093315013 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214093315013 DLGLOBAL DEBUG validating counter group 0x7efd484b0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214093315013 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214093315013 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214093315013 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214093315014 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214093315015 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214093315016 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214093315016 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214093315016 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:33:16.013889 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1571): Terminating (SIGTERM) 09:33:16.072678 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1574): Terminating (SIGTERM) 09:33:16.117304 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1577): Terminating (SIGTERM) 09:33:16.161819 --- ParallelTerminationStrategy: PID 1571 died... 09:33:16.186599 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1571): Terminated: ok {rc=0} 09:33:16.245322 --- ParallelTerminationStrategy: PID 1574 died... 09:33:16.270853 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1574): Terminated: ok {rc=0} 09:33:16.320215 --- ParallelTerminationStrategy: PID 1577 died... 09:33:16.341668 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1577): Terminated: ok {rc=0} 09:33:16.431162 bus /sierra_3: Setting Powered False 09:33:17.529560 bus /sierra_3: Setting Powered False 09:33:18.645829 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2402 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 09:33:19.892383 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:33:19.900025 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 09:33:19.931903 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 09:33:19.959453 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 09:33:20.011868 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 09:33:20.044661 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 09:33:20.071433 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 09:33:20.620034 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2402 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 09:33:20.669736 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:33:20.680915 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 09:33:20.747805 tst mo_mt_call.py: using LAC 40008 09:33:20.866240 tst mo_mt_call.py: using RAC 228 09:33:20.984165 tst mo_mt_call.py: using CellId 40008 09:33:21.106410 tst mo_mt_call.py: using BVCI 40009 09:33:21.216705 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:33:21.227936 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:33:21.239048 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:33:21.250260 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:33:21.261800 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:33:21.273304 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 09:33:21.388320 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 09:33:21.507458 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:33:22.006294 run create_hlr_db(pid=1583): Launched 09:33:22.136445 bus /sierra_2: Setting Powered False 09:33:23.200369 run create_hlr_db(pid=1583): Terminated: ok {rc=0} 09:33:23.628739 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1585): Launched 09:33:23.951487 run osmo-hlr_10.42.42.2(pid=1586): Launched 09:33:24.073722 run osmo-stp_10.42.42.5: Starting osmo-stp 09:33:24.634524 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1588): Launched 09:33:24.955965 run osmo-stp_10.42.42.5(pid=1589): Launched 09:33:25.077897 run osmo-msc_10.42.42.6: Starting osmo-msc 09:33:25.657197 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1591): Launched 09:33:25.977714 run osmo-msc_10.42.42.6(pid=1592): Launched 09:33:26.156640 run osmo-stp_10.42.42.5(pid=1589): ERR: Terminated: ERROR {rc=1} [trial-2402↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1589)] 09:33:26.291636 run osmo-stp_10.42.42.5(pid=1589): stdout: | (launched: 2022-12-14_09:33:24.896497) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:33:26.427526 run osmo-stp_10.42.42.5(pid=1589): stderr: | 20221214093325084 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214093325084 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214093325085 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214093325085 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214093325086 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214093325086 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214093325086 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:33:26.563685 run osmo-stp_10.42.42.5(pid=1589): stdout: | (launched: 2022-12-14_09:33:24.896497) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:33:26.691282 run osmo-stp_10.42.42.5(pid=1589): stderr: | 20221214093325084 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214093325084 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214093325085 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214093325085 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214093325086 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214093325086 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214093325086 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:33:26.844501 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1589): Process ended prematurely: osmo-stp_10.42.42.5(pid=1589) [trial-2402↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1589)] [trial-2402↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 09:33:26.854165 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 09:33:26.881839 run osmo-hlr_10.42.42.2(pid=1586): ERR: Terminated: ERROR {rc=237} [trial-2402↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1586)] 09:33:26.931577 run osmo-hlr_10.42.42.2(pid=1586): stdout: | (launched: 2022-12-14_09:33:23.892314) 09:33:26.982758 run osmo-hlr_10.42.42.2(pid=1586): stderr: | 20221214093324085 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214093324085 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214093324085 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214093324085 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214093324086 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214093324086 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214093324099 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214093324110 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214093324110 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214093324110 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:33:27.055018 run osmo-msc_10.42.42.6(pid=1592): ERR: Terminated: ERROR {rc=2} [trial-2402↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1592)] 09:33:27.104723 run osmo-msc_10.42.42.6(pid=1592): stdout: | (launched: 2022-12-14_09:33:25.918131) 09:33:27.155750 run osmo-msc_10.42.42.6(pid=1592): stderr: | 20221214093326235 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214093326235 DLGLOBAL DEBUG validating counter group 0x7f3b24891c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214093326236 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214093326236 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214093326236 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214093326236 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214093326238 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214093326238 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214093326238 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214093326238 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:33:27.207011 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1585): Terminating (SIGTERM) 09:33:27.248269 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1588): Terminating (SIGTERM) 09:33:27.289827 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1591): Terminating (SIGTERM) 09:33:27.331374 --- ParallelTerminationStrategy: PID 1585 died... 09:33:27.351307 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1585): Terminated: ok {rc=0} 09:33:27.397141 --- ParallelTerminationStrategy: PID 1588 died... 09:33:27.416284 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1588): Terminated: ok {rc=0} 09:33:27.462437 --- ParallelTerminationStrategy: PID 1591 died... 09:33:27.481972 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1591): Terminated: ok {rc=0} 09:33:27.569631 bus /sierra_3: Setting Powered False 09:33:28.667443 bus /sierra_3: Setting Powered False 09:33:29.784120 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2402 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 09:33:30.942377 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:33:30.955403 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 09:33:31.029334 tst mo_mt_call_osmux.py: using LAC 40009 09:33:31.167415 tst mo_mt_call_osmux.py: using RAC 229 09:33:31.292740 tst mo_mt_call_osmux.py: using CellId 40009 09:33:31.419461 tst mo_mt_call_osmux.py: using BVCI 40010 09:33:31.539045 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:33:31.551412 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:33:31.564854 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:33:31.577183 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:33:31.590159 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:33:31.602971 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 09:33:31.734801 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 09:33:31.886817 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:33:32.429817 run create_hlr_db(pid=1594): Launched 09:33:32.560115 bus /sierra_2: Setting Powered False 09:33:33.624461 run create_hlr_db(pid=1594): Terminated: ok {rc=0} 09:33:34.072069 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1596): Launched 09:33:34.394346 run osmo-hlr_10.42.42.2(pid=1597): Launched 09:33:34.515260 run osmo-stp_10.42.42.5: Starting osmo-stp 09:33:35.071149 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1599): Launched 09:33:35.394694 run osmo-stp_10.42.42.5(pid=1600): Launched 09:33:35.515758 run osmo-msc_10.42.42.6: Starting osmo-msc 09:33:36.096617 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1602): Launched 09:33:36.418551 run osmo-msc_10.42.42.6(pid=1603): Launched 09:33:36.597195 run osmo-stp_10.42.42.5(pid=1600): ERR: Terminated: ERROR {rc=1} [trial-2402↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1600)] 09:33:36.734491 run osmo-stp_10.42.42.5(pid=1600): stdout: | (launched: 2022-12-14_09:33:35.335021) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:33:36.870902 run osmo-stp_10.42.42.5(pid=1600): stderr: | 20221214093335524 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214093335524 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214093335525 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214093335525 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214093335526 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214093335526 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214093335526 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:33:37.005159 run osmo-stp_10.42.42.5(pid=1600): stdout: | (launched: 2022-12-14_09:33:35.335021) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:33:37.133291 run osmo-stp_10.42.42.5(pid=1600): stderr: | 20221214093335524 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214093335524 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214093335525 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214093335525 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214093335526 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214093335526 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214093335526 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:33:37.286071 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1600): Process ended prematurely: osmo-stp_10.42.42.5(pid=1600) [trial-2402↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1600)] [trial-2402↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 09:33:37.295679 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 09:33:37.323408 run osmo-hlr_10.42.42.2(pid=1597): ERR: Terminated: ERROR {rc=237} [trial-2402↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1597)] 09:33:37.373228 run osmo-hlr_10.42.42.2(pid=1597): stdout: | (launched: 2022-12-14_09:33:34.334742) 09:33:37.424579 run osmo-hlr_10.42.42.2(pid=1597): stderr: | 20221214093334530 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214093334530 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214093334530 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214093334530 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214093334530 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214093334530 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214093334543 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214093334551 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214093334551 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214093334551 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:33:37.496352 run osmo-msc_10.42.42.6(pid=1603): ERR: Terminated: ERROR {rc=2} [trial-2402↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1603)] 09:33:37.545894 run osmo-msc_10.42.42.6(pid=1603): stdout: | (launched: 2022-12-14_09:33:36.358566) 09:33:37.597112 run osmo-msc_10.42.42.6(pid=1603): stderr: | 20221214093336677 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214093336678 DLGLOBAL DEBUG validating counter group 0x7f608f8c0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214093336678 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214093336678 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214093336678 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214093336678 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214093336680 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214093336680 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214093336680 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214093336680 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:33:37.648637 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1596): Terminating (SIGTERM) 09:33:37.690236 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1599): Terminating (SIGTERM) 09:33:37.731544 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1602): Terminating (SIGTERM) 09:33:37.773273 --- ParallelTerminationStrategy: PID 1596 died... 09:33:37.793304 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1596): Terminated: ok {rc=0} 09:33:37.839196 --- ParallelTerminationStrategy: PID 1599 died... 09:33:37.858744 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1599): Terminated: ok {rc=0} 09:33:37.904626 --- ParallelTerminationStrategy: PID 1602 died... 09:33:37.924125 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1602): Terminated: ok {rc=0} 09:33:38.011052 bus /sierra_3: Setting Powered False 09:33:39.108209 bus /sierra_3: Setting Powered False 09:33:40.221732 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2402 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 09:33:41.464103 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:33:41.471253 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 09:33:41.502952 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 09:33:41.530012 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 09:33:41.580905 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 09:33:41.614089 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 09:33:41.641615 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 09:33:42.190493 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2402 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 09:33:42.238216 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:33:42.249435 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 09:33:42.315374 tst mo_mt_call.py: using LAC 40010 09:33:42.434197 tst mo_mt_call.py: using RAC 230 09:33:42.554203 tst mo_mt_call.py: using CellId 40010 09:33:42.674436 tst mo_mt_call.py: using BVCI 40011 09:33:42.785574 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:33:42.796685 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:33:42.807748 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:33:42.818707 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:33:42.830152 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:33:42.841489 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 09:33:42.962198 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 09:33:43.082288 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:33:43.549329 run create_hlr_db(pid=1608): Launched 09:33:43.664210 bus /sierra_2: Setting Powered False 09:33:44.723227 run create_hlr_db(pid=1608): Terminated: ok {rc=0} 09:33:45.162720 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1610): Launched 09:33:45.484852 run osmo-hlr_10.42.42.2(pid=1611): Launched 09:33:45.607388 run osmo-stp_10.42.42.5: Starting osmo-stp 09:33:46.198618 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1613): Launched 09:33:46.535328 run osmo-stp_10.42.42.5(pid=1614): Launched 09:33:46.766877 run osmo-msc_10.42.42.6: Starting osmo-msc 09:33:47.533593 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1616): Launched 09:33:47.855167 run osmo-msc_10.42.42.6(pid=1617): Launched 09:33:48.034245 run osmo-stp_10.42.42.5(pid=1614): ERR: Terminated: ERROR {rc=1} [trial-2402↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1614)] 09:33:48.170115 run osmo-stp_10.42.42.5(pid=1614): stdout: | (launched: 2022-12-14_09:33:46.474768) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:33:48.305193 run osmo-stp_10.42.42.5(pid=1614): stderr: | 20221214093346776 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214093346777 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214093346779 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214093346779 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214093346781 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214093346781 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214093346782 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:33:48.438876 run osmo-stp_10.42.42.5(pid=1614): stdout: | (launched: 2022-12-14_09:33:46.474768) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:33:48.565935 run osmo-stp_10.42.42.5(pid=1614): stderr: | 20221214093346776 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214093346777 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214093346779 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214093346779 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214093346781 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214093346781 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214093346782 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:33:48.717923 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1614): Process ended prematurely: osmo-stp_10.42.42.5(pid=1614) [trial-2402↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1614)] [trial-2402↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 09:33:48.727282 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 09:33:48.754712 run osmo-hlr_10.42.42.2(pid=1611): ERR: Terminated: ERROR {rc=237} [trial-2402↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1611)] 09:33:48.804188 run osmo-hlr_10.42.42.2(pid=1611): stdout: | (launched: 2022-12-14_09:33:45.425406) 09:33:48.855162 run osmo-hlr_10.42.42.2(pid=1611): stderr: | 20221214093345620 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214093345620 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214093345620 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214093345620 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214093345620 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214093345620 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214093345632 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214093345640 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214093345640 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214093345640 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:33:48.926821 run osmo-msc_10.42.42.6(pid=1617): ERR: Terminated: ERROR {rc=2} [trial-2402↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1617)] 09:33:48.976115 run osmo-msc_10.42.42.6(pid=1617): stdout: | (launched: 2022-12-14_09:33:47.795595) 09:33:49.027040 run osmo-msc_10.42.42.6(pid=1617): stderr: | 20221214093348114 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214093348114 DLGLOBAL DEBUG validating counter group 0x7f6b39ac0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214093348114 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214093348114 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214093348114 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214093348115 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214093348116 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214093348117 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214093348117 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214093348117 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:33:49.078688 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1610): Terminating (SIGTERM) 09:33:49.120064 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1613): Terminating (SIGTERM) 09:33:49.161277 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1616): Terminating (SIGTERM) 09:33:49.202743 --- ParallelTerminationStrategy: PID 1610 died... 09:33:49.222584 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1610): Terminated: ok {rc=0} 09:33:49.268096 --- ParallelTerminationStrategy: PID 1613 died... 09:33:49.287446 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1613): Terminated: ok {rc=0} 09:33:49.333161 --- ParallelTerminationStrategy: PID 1616 died... 09:33:49.352467 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1616): Terminated: ok {rc=0} 09:33:49.439060 bus /sierra_3: Setting Powered False 09:33:50.537154 bus /sierra_3: Setting Powered False 09:33:51.653048 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2402 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 09:33:52.797860 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:33:52.809881 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 09:33:52.875126 tst mo_mt_call_osmux.py: using LAC 40011 09:33:52.991821 tst mo_mt_call_osmux.py: using RAC 231 09:33:53.110125 tst mo_mt_call_osmux.py: using CellId 40011 09:33:53.228154 tst mo_mt_call_osmux.py: using BVCI 40012 09:33:53.337627 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:33:53.348808 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:33:53.359943 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:33:53.370939 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:33:53.382329 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:33:53.393667 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 09:33:53.509374 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 09:33:53.630250 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:33:54.131066 run create_hlr_db(pid=1619): Launched 09:33:54.262216 bus /sierra_2: Setting Powered False 09:33:55.325700 run create_hlr_db(pid=1619): Terminated: ok {rc=0} 09:33:55.754220 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1621): Launched 09:33:56.054583 run osmo-hlr_10.42.42.2(pid=1622): Launched 09:33:56.168408 run osmo-stp_10.42.42.5: Starting osmo-stp 09:33:56.700710 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1624): Launched 09:33:57.001880 run osmo-stp_10.42.42.5(pid=1625): Launched 09:33:57.115541 run osmo-msc_10.42.42.6: Starting osmo-msc 09:33:57.658706 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1627): Launched 09:33:57.958512 run osmo-msc_10.42.42.6(pid=1628): Launched 09:33:58.126581 run osmo-stp_10.42.42.5(pid=1625): ERR: Terminated: ERROR {rc=1} [trial-2402↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1625)] 09:33:58.253726 run osmo-stp_10.42.42.5(pid=1625): stdout: | (launched: 2022-12-14_09:33:56.945273) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:33:58.380680 run osmo-stp_10.42.42.5(pid=1625): stderr: | 20221214093357115 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214093357115 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214093357115 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214093357116 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214093357116 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214093357116 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214093357116 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:33:58.505419 run osmo-stp_10.42.42.5(pid=1625): stdout: | (launched: 2022-12-14_09:33:56.945273) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:33:58.624588 run osmo-stp_10.42.42.5(pid=1625): stderr: | 20221214093357115 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214093357115 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214093357115 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214093357116 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214093357116 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214093357116 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214093357116 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:33:58.767440 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1625): Process ended prematurely: osmo-stp_10.42.42.5(pid=1625) [trial-2402↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1625)] [trial-2402↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 09:33:58.776077 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 09:33:58.802454 run osmo-hlr_10.42.42.2(pid=1622): ERR: Terminated: ERROR {rc=237} [trial-2402↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1622)] 09:33:58.850386 run osmo-hlr_10.42.42.2(pid=1622): stdout: | (launched: 2022-12-14_09:33:55.998594) 09:33:58.899645 run osmo-hlr_10.42.42.2(pid=1622): stderr: | 20221214093356170 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214093356170 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214093356170 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214093356170 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214093356170 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214093356170 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214093356186 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214093356196 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214093356196 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214093356196 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:33:58.968751 run osmo-msc_10.42.42.6(pid=1628): ERR: Terminated: ERROR {rc=2} [trial-2402↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1628)] 09:33:59.016056 run osmo-msc_10.42.42.6(pid=1628): stdout: | (launched: 2022-12-14_09:33:57.902421) 09:33:59.065239 run osmo-msc_10.42.42.6(pid=1628): stderr: | 20221214093358170 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214093358170 DLGLOBAL DEBUG validating counter group 0x7f04251dfc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214093358170 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214093358170 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214093358170 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214093358171 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214093358172 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214093358173 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214093358173 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214093358173 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:33:59.114898 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1621): Terminating (SIGTERM) 09:33:59.154281 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1624): Terminating (SIGTERM) 09:33:59.193604 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1627): Terminating (SIGTERM) 09:33:59.233314 --- ParallelTerminationStrategy: PID 1621 died... 09:33:59.252513 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1621): Terminated: ok {rc=0} 09:33:59.296026 --- ParallelTerminationStrategy: PID 1624 died... 09:33:59.314747 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1624): Terminated: ok {rc=0} 09:33:59.358329 --- ParallelTerminationStrategy: PID 1627 died... 09:33:59.377145 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1627): Terminated: ok {rc=0} 09:33:59.462657 bus /sierra_3: Setting Powered False 09:34:00.560481 bus /sierra_3: Setting Powered False 09:34:01.676486 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2402 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 09:34:02.923849 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:34:02.930707 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 09:34:02.962310 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 6 x ip_address (candidates: 9) 09:34:02.989583 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 2 x modem (candidates: 12) 09:34:03.040345 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 09:34:03.073905 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 6 x ip_address (candidates: 9) 09:34:03.101588 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 2 x modem (candidates: 12) 09:34:03.656157 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2402 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call.py ---------------------------------------------- 09:34:03.707110 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 09:34:03.718979 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 09:34:03.767845 tst mo_mt_call.py: using LAC 40012 09:34:03.892086 tst mo_mt_call.py: using RAC 232 09:34:04.018363 tst mo_mt_call.py: using CellId 40012 09:34:04.145065 tst mo_mt_call.py: using BVCI 40013 09:34:04.261495 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 09:34:04.273376 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 09:34:04.285007 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 09:34:04.296707 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 09:34:04.308573 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 09:34:04.320341 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 09:34:04.435983 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 09:34:04.551204 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:34:05.019145 run create_hlr_db(pid=1633): Launched 09:34:05.134491 bus /sierra_2: Setting Powered False 09:34:06.194481 run create_hlr_db(pid=1633): Terminated: ok {rc=0} 09:34:06.633680 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1635): Launched 09:34:06.958151 run osmo-hlr_10.42.42.2(pid=1636): Launched 09:34:07.083520 run osmo-stp_10.42.42.5: Starting osmo-stp 09:34:07.642857 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1638): Launched 09:34:07.964276 run osmo-stp_10.42.42.5(pid=1639): Launched 09:34:08.087048 run osmo-msc_10.42.42.6: Starting osmo-msc 09:34:08.667258 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1641): Launched 09:34:08.989618 run osmo-msc_10.42.42.6(pid=1642): Launched 09:34:09.170586 run osmo-stp_10.42.42.5(pid=1639): ERR: Terminated: ERROR {rc=1} [trial-2402↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1639)] 09:34:09.306101 run osmo-stp_10.42.42.5(pid=1639): stdout: | (launched: 2022-12-14_09:34:07.905021) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:34:09.441890 run osmo-stp_10.42.42.5(pid=1639): stderr: | 20221214093408091 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214093408091 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214093408091 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214093408092 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214093408092 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214093408092 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214093408092 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:34:09.575675 run osmo-stp_10.42.42.5(pid=1639): stdout: | (launched: 2022-12-14_09:34:07.905021) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:34:09.703163 run osmo-stp_10.42.42.5(pid=1639): stderr: | 20221214093408091 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214093408091 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214093408091 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214093408092 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214093408092 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214093408092 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214093408092 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:34:09.855670 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1639): Process ended prematurely: osmo-stp_10.42.42.5(pid=1639) [trial-2402↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1639)] [trial-2402↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8] 09:34:09.865140 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 09:34:09.892768 run osmo-hlr_10.42.42.2(pid=1636): ERR: Terminated: ERROR {rc=237} [trial-2402↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1636)] 09:34:09.942208 run osmo-hlr_10.42.42.2(pid=1636): stdout: | (launched: 2022-12-14_09:34:06.897651) 09:34:09.993519 run osmo-hlr_10.42.42.2(pid=1636): stderr: | 20221214093407091 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214093407091 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214093407092 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214093407092 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214093407092 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214093407092 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214093407103 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214093407113 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214093407114 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214093407114 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:34:10.065122 run osmo-msc_10.42.42.6(pid=1642): ERR: Terminated: ERROR {rc=2} [trial-2402↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1642)] 09:34:10.114844 run osmo-msc_10.42.42.6(pid=1642): stdout: | (launched: 2022-12-14_09:34:08.929990) 09:34:10.166557 run osmo-msc_10.42.42.6(pid=1642): stderr: | 20221214093409249 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214093409249 DLGLOBAL DEBUG validating counter group 0x7f7839e57c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214093409249 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214093409249 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214093409249 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214093409249 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214093409251 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214093409251 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214093409252 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214093409252 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:34:10.217991 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1635): Terminating (SIGTERM) 09:34:10.259071 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1638): Terminating (SIGTERM) 09:34:10.300110 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1641): Terminating (SIGTERM) 09:34:10.341678 --- ParallelTerminationStrategy: PID 1635 died... 09:34:10.361004 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1635): Terminated: ok {rc=0} 09:34:10.407045 --- ParallelTerminationStrategy: PID 1638 died... 09:34:10.426509 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1638): Terminated: ok {rc=0} 09:34:10.472221 --- ParallelTerminationStrategy: PID 1641 died... 09:34:10.491757 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1641): Terminated: ok {rc=0} 09:34:10.578417 bus /sierra_3: Setting Powered False 09:34:11.676012 bus /sierra_3: Setting Powered False 09:34:12.791936 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2402 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call_osmux.py ---------------------------------------------- 09:34:13.939544 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 09:34:13.952121 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 09:34:14.002959 tst mo_mt_call_osmux.py: using LAC 40013 09:34:14.128357 tst mo_mt_call_osmux.py: using RAC 233 09:34:14.245868 tst mo_mt_call_osmux.py: using CellId 40013 09:34:14.365193 tst mo_mt_call_osmux.py: using BVCI 40014 09:34:14.476070 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 09:34:14.487607 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 09:34:14.498989 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 09:34:14.510273 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 09:34:14.521917 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 09:34:14.533370 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 09:34:14.647829 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 09:34:14.768206 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:34:15.270530 run create_hlr_db(pid=1644): Launched 09:34:15.401042 bus /sierra_2: Setting Powered False 09:34:16.463448 run create_hlr_db(pid=1644): Terminated: ok {rc=0} 09:34:16.920085 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1646): Launched 09:34:17.269062 run osmo-hlr_10.42.42.2(pid=1647): Launched 09:34:17.386099 run osmo-stp_10.42.42.5: Starting osmo-stp 09:34:17.916388 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1649): Launched 09:34:18.219317 run osmo-stp_10.42.42.5(pid=1650): Launched 09:34:18.333762 run osmo-msc_10.42.42.6: Starting osmo-msc 09:34:18.877512 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1652): Launched 09:34:19.179517 run osmo-msc_10.42.42.6(pid=1653): Launched 09:34:19.348871 run osmo-stp_10.42.42.5(pid=1650): ERR: Terminated: ERROR {rc=1} [trial-2402↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1650)] 09:34:19.476799 run osmo-stp_10.42.42.5(pid=1650): stdout: | (launched: 2022-12-14_09:34:18.162776) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:34:19.604478 run osmo-stp_10.42.42.5(pid=1650): stderr: | 20221214093418330 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214093418330 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214093418330 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214093418331 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214093418331 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214093418331 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214093418331 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:34:19.729890 run osmo-stp_10.42.42.5(pid=1650): stdout: | (launched: 2022-12-14_09:34:18.162776) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:34:19.849672 run osmo-stp_10.42.42.5(pid=1650): stderr: | 20221214093418330 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214093418330 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214093418330 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214093418331 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214093418331 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214093418331 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214093418331 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:34:19.992776 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1650): Process ended prematurely: osmo-stp_10.42.42.5(pid=1650) [trial-2402↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1650)] [trial-2402↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8] 09:34:20.001901 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 09:34:20.028355 run osmo-hlr_10.42.42.2(pid=1647): ERR: Terminated: ERROR {rc=237} [trial-2402↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1647)] 09:34:20.076375 run osmo-hlr_10.42.42.2(pid=1647): stdout: | (launched: 2022-12-14_09:34:17.212232) 09:34:20.125929 run osmo-hlr_10.42.42.2(pid=1647): stderr: | 20221214093417384 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214093417384 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214093417384 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214093417384 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214093417384 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214093417384 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214093417396 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214093417404 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214093417404 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214093417404 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:34:20.195020 run osmo-msc_10.42.42.6(pid=1653): ERR: Terminated: ERROR {rc=2} [trial-2402↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1653)] 09:34:20.242108 run osmo-msc_10.42.42.6(pid=1653): stdout: | (launched: 2022-12-14_09:34:19.122620) 09:34:20.291231 run osmo-msc_10.42.42.6(pid=1653): stderr: | 20221214093419391 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214093419392 DLGLOBAL DEBUG validating counter group 0x7f3d3a5c0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214093419392 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214093419392 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214093419392 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214093419392 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214093419394 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214093419394 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214093419394 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214093419395 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:34:20.341084 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1646): Terminating (SIGTERM) 09:34:20.380855 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1649): Terminating (SIGTERM) 09:34:20.420427 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1652): Terminating (SIGTERM) 09:34:20.460463 --- ParallelTerminationStrategy: PID 1646 died... 09:34:20.480003 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1646): Terminated: ok {rc=0} 09:34:20.524125 --- ParallelTerminationStrategy: PID 1649 died... 09:34:20.543118 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1649): Terminated: ok {rc=0} 09:34:20.587066 --- ParallelTerminationStrategy: PID 1652 died... 09:34:20.605847 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1652): Terminated: ok {rc=0} 09:34:20.691294 bus /sierra_3: Setting Powered False 09:34:21.790180 bus /sierra_3: Setting Powered False 09:34:22.904044 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2402 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 emergency:nanobts+band-900 --------------------------------------------------------------------- 09:34:24.159499 tst emergency:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:34:24.164795 tst emergency:nanobts+band-900: Verifying 1 x bts (candidates: 11) 09:34:24.196456 tst emergency:nanobts+band-900: Verifying 6 x ip_address (candidates: 9) 09:34:24.224078 tst emergency:nanobts+band-900: Verifying 4 x modem (candidates: 12) 09:34:24.313373 tst emergency:nanobts+band-900: Reserving 1 x bts (candidates: 11) 09:34:24.345550 tst emergency:nanobts+band-900: Reserving 6 x ip_address (candidates: 9) 09:34:24.371847 tst emergency:nanobts+band-900: Reserving 4 x modem (candidates: 12) 09:34:24.949818 tst emergency:nanobts+band-900: RESERVED RESOURCES for emergency: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2402 emergency:nanobts+band-900 emergency_mo_mt_call.py ---------------------------------------------- 09:34:24.954831 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 09:34:24.965555 tst emergency:nanobts+band-900: Using 1 x bts (candidates: 1) 09:34:25.012540 tst emergency_mo_mt_call.py: using LAC 40014 09:34:25.128917 tst emergency_mo_mt_call.py: using RAC 234 09:34:25.243314 tst emergency_mo_mt_call.py: using CellId 40014 09:34:25.366753 tst emergency_mo_mt_call.py: using BVCI 40015 09:34:25.481653 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 09:34:25.492819 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 09:34:25.503887 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 09:34:25.514934 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 09:34:25.526071 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 09:34:25.537186 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 09:34:25.652460 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 09:34:25.770661 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:34:26.262171 run create_hlr_db(pid=1659): Launched 09:34:26.391195 bus /sierra_2: Setting Powered False 09:34:27.453953 run create_hlr_db(pid=1659): Terminated: ok {rc=0} 09:34:27.877350 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1661): Launched 09:34:28.173843 run osmo-hlr_10.42.42.2(pid=1662): Launched 09:34:28.284591 run osmo-stp_10.42.42.5: Starting osmo-stp 09:34:28.790311 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1664): Launched 09:34:29.085091 run osmo-stp_10.42.42.5(pid=1665): Launched 09:34:29.206340 tst emergency_mo_mt_call.py: using MSISDN 8611 09:34:29.356016 run osmo-msc_10.42.42.6: Starting osmo-msc 09:34:29.885845 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1667): Launched 09:34:30.180669 run osmo-msc_10.42.42.6(pid=1668): Launched 09:34:30.344798 run osmo-stp_10.42.42.5(pid=1665): ERR: Terminated: ERROR {rc=1} [trial-2402↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1665)] 09:34:30.470106 run osmo-stp_10.42.42.5(pid=1665): stdout: | (launched: 2022-12-14_09:34:29.029926) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:34:30.595217 run osmo-stp_10.42.42.5(pid=1665): stderr: | 20221214093429197 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214093429197 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214093429197 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214093429198 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214093429199 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214093429199 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214093429199 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:34:30.718245 run osmo-stp_10.42.42.5(pid=1665): stdout: | (launched: 2022-12-14_09:34:29.029926) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:34:30.835985 run osmo-stp_10.42.42.5(pid=1665): stderr: | 20221214093429197 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214093429197 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214093429197 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214093429198 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214093429199 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214093429199 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214093429199 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:34:31.006049 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=1665): Process ended prematurely: osmo-stp_10.42.42.5(pid=1665) [trial-2402↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1665)] [trial-2402↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19] 09:34:31.014679 tst emergency_mo_mt_call.py:19: Test FAILED (6.1 sec) 09:34:31.044313 run osmo-hlr_10.42.42.2(pid=1662): ERR: Terminated: ERROR {rc=237} [trial-2402↪emergency:nanobts+band-900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1662)] 09:34:31.096200 run osmo-hlr_10.42.42.2(pid=1662): stdout: | (launched: 2022-12-14_09:34:28.118763) 09:34:31.147907 run osmo-hlr_10.42.42.2(pid=1662): stderr: | 20221214093428289 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214093428289 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214093428289 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214093428289 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214093428289 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214093428289 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214093428301 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/emergency:nanobts+band-900/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214093428310 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214093428310 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214093428311 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:34:31.220991 run osmo-msc_10.42.42.6(pid=1668): ERR: Terminated: ERROR {rc=2} [trial-2402↪emergency:nanobts+band-900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1668)] 09:34:31.270485 run osmo-msc_10.42.42.6(pid=1668): stdout: | (launched: 2022-12-14_09:34:30.125642) 09:34:31.322194 run osmo-msc_10.42.42.6(pid=1668): stderr: | 20221214093430391 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214093430392 DLGLOBAL DEBUG validating counter group 0x7f27b97a1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214093430392 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214093430392 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214093430392 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214093430392 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214093430394 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214093430395 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214093430395 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214093430395 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:34:31.374351 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1661): Terminating (SIGTERM) 09:34:31.417258 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1664): Terminating (SIGTERM) 09:34:31.460388 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1667): Terminating (SIGTERM) 09:34:31.502654 --- ParallelTerminationStrategy: PID 1661 died... 09:34:31.523586 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1661): Terminated: ok {rc=0} 09:34:31.569830 --- ParallelTerminationStrategy: PID 1664 died... 09:34:31.590738 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1664): Terminated: ok {rc=0} 09:34:31.636781 --- ParallelTerminationStrategy: PID 1667 died... 09:34:31.657591 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1667): Terminated: ok {rc=0} 09:34:31.744360 bus /sierra_3: Setting Powered False 09:34:32.842136 bus /sierra_3: Setting Powered False 09:34:33.956227 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2402 emergency:nanobts+band-900 emergency_preemptive_call.py ---------------------------------------------- 09:34:35.043243 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 09:34:35.054704 tst emergency:nanobts+band-900: Using 1 x bts (candidates: 1) 09:34:35.103767 tst emergency_preemptive_call.py: using LAC 40015 09:34:35.221632 tst emergency_preemptive_call.py: using RAC 235 09:34:35.346808 tst emergency_preemptive_call.py: using CellId 40015 09:34:35.472798 tst emergency_preemptive_call.py: using BVCI 40016 09:34:35.587741 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 09:34:35.598964 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 09:34:35.610314 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 09:34:35.621547 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 09:34:35.632689 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 09:34:35.644034 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 09:34:35.759086 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 09:34:35.873742 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 09:34:35.990298 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 09:34:36.104234 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:34:36.563776 run create_hlr_db(pid=1670): Launched 09:34:36.676512 bus /sierra_2: Setting Powered False 09:34:37.735889 run create_hlr_db(pid=1670): Terminated: ok {rc=0} 09:34:38.170387 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1672): Launched 09:34:38.487395 run osmo-hlr_10.42.42.2(pid=1673): Launched 09:34:38.607848 run osmo-stp_10.42.42.5: Starting osmo-stp 09:34:39.157801 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1675): Launched 09:34:39.475213 run osmo-stp_10.42.42.5(pid=1676): Launched 09:34:39.604620 tst emergency_preemptive_call.py: using MSISDN 8612 09:34:39.766937 run osmo-msc_10.42.42.6: Starting osmo-msc 09:34:40.335987 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1678): Launched 09:34:40.653256 run osmo-msc_10.42.42.6(pid=1679): Launched 09:34:40.828170 run osmo-stp_10.42.42.5(pid=1676): ERR: Terminated: ERROR {rc=1} [trial-2402↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1676)] 09:34:40.961141 run osmo-stp_10.42.42.5(pid=1676): stdout: | (launched: 2022-12-14_09:34:39.416255) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:34:41.095304 run osmo-stp_10.42.42.5(pid=1676): stderr: | 20221214093439604 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214093439605 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214093439605 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214093439605 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214093439606 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214093439606 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214093439606 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:34:41.228469 run osmo-stp_10.42.42.5(pid=1676): stdout: | (launched: 2022-12-14_09:34:39.416255) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:34:41.354989 run osmo-stp_10.42.42.5(pid=1676): stderr: | 20221214093439604 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214093439605 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214093439605 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214093439605 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214093439606 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214093439606 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214093439606 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:34:41.505264 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=1676): Process ended prematurely: osmo-stp_10.42.42.5(pid=1676) [trial-2402↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1676)] [trial-2402↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32] 09:34:41.514306 tst emergency_preemptive_call.py:32: Test FAILED (6.5 sec) 09:34:41.542011 run osmo-hlr_10.42.42.2(pid=1673): ERR: Terminated: ERROR {rc=237} [trial-2402↪emergency:nanobts+band-900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1673)] 09:34:41.592392 run osmo-hlr_10.42.42.2(pid=1673): stdout: | (launched: 2022-12-14_09:34:38.428575) 09:34:41.644530 run osmo-hlr_10.42.42.2(pid=1673): stderr: | 20221214093438621 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214093438622 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214093438622 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214093438622 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214093438622 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214093438622 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214093438634 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/emergency:nanobts+band-900/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214093438642 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214093438643 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214093438643 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:34:41.717255 run osmo-msc_10.42.42.6(pid=1679): ERR: Terminated: ERROR {rc=2} [trial-2402↪emergency:nanobts+band-900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1679)] 09:34:41.767492 run osmo-msc_10.42.42.6(pid=1679): stdout: | (launched: 2022-12-14_09:34:40.594396) 09:34:41.819305 run osmo-msc_10.42.42.6(pid=1679): stderr: | 20221214093440913 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214093440914 DLGLOBAL DEBUG validating counter group 0x7fd41abc0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214093440914 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214093440914 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214093440914 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214093440914 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214093440916 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214093440916 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214093440916 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214093440917 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:34:41.871619 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1672): Terminating (SIGTERM) 09:34:41.913483 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1675): Terminating (SIGTERM) 09:34:41.955892 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1678): Terminating (SIGTERM) 09:34:41.998375 --- ParallelTerminationStrategy: PID 1672 died... 09:34:42.018752 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1672): Terminated: ok {rc=0} 09:34:42.064893 --- ParallelTerminationStrategy: PID 1675 died... 09:34:42.084411 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1675): Terminated: ok {rc=0} 09:34:42.130308 --- ParallelTerminationStrategy: PID 1678 died... 09:34:42.149938 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1678): Terminated: ok {rc=0} 09:34:42.235871 bus /sierra_9: Setting Powered False 09:34:43.332517 bus /sierra_9: Setting Powered False 09:34:44.444643 bus /sierra_8: Setting Powered False 09:34:45.540557 bus /sierra_8: Setting Powered False 09:34:46.653954 bus /sierra_3: Setting Powered False 09:34:47.749157 bus /sierra_3: Setting Powered False 09:34:48.864190 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2402 emergency:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 gprs:nanobts+band-900 --------------------------------------------------------------------- 09:34:50.140566 tst gprs:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:34:50.145801 tst gprs:nanobts+band-900: Verifying 1 x bts (candidates: 11) 09:34:50.177378 tst gprs:nanobts+band-900: Verifying 9 x ip_address (candidates: 9) 09:34:50.216341 tst gprs:nanobts+band-900: Verifying 4 x modem (candidates: 12) 09:34:50.303373 tst gprs:nanobts+band-900: Reserving 1 x bts (candidates: 11) 09:34:50.336155 tst gprs:nanobts+band-900: Reserving 9 x ip_address (candidates: 9) 09:34:50.374343 tst gprs:nanobts+band-900: Reserving 4 x modem (candidates: 12) 09:34:50.962060 tst gprs:nanobts+band-900: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2402 gprs:nanobts+band-900 cs_paging_gprs_active.py ---------------------------------------------- 09:34:51.011186 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 09:34:51.021891 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 09:34:51.071835 tst cs_paging_gprs_active.py: using LAC 40016 09:34:51.190491 tst cs_paging_gprs_active.py: using RAC 236 09:34:51.306225 tst cs_paging_gprs_active.py: using CellId 40016 09:34:51.425472 tst cs_paging_gprs_active.py: using BVCI 40017 09:34:51.536619 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 09:34:51.547346 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 09:34:51.558010 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 09:34:51.568390 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 09:34:51.578868 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 09:34:51.589864 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 09:34:51.601166 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 09:34:51.612130 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 09:34:51.623110 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 09:34:51.743445 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 09:34:51.867134 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 09:34:52.083832 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:34:52.406645 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1684): Launched 09:34:52.687007 run iperf3-srv_10.42.42.10(pid=1685): Launched 09:34:52.807311 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 09:34:53.023790 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:34:53.347478 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1686): Launched 09:34:53.628283 run iperf3-srv_10.42.42.10(pid=1687): Launched 09:34:53.748398 tst cs_paging_gprs_active.py:38: start network... 09:34:53.965034 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:34:54.464775 run create_hlr_db(pid=1688): Launched 09:34:54.594973 bus /sierra_2: Setting Powered False 09:34:55.658306 run create_hlr_db(pid=1688): Terminated: ok {rc=0} 09:34:56.086909 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1690): Launched 09:34:56.387573 run osmo-hlr_10.42.42.2(pid=1691): Launched 09:34:56.502373 run osmo-stp_10.42.42.5: Starting osmo-stp 09:34:57.035588 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1693): Launched 09:34:57.337972 run osmo-stp_10.42.42.5(pid=1694): Launched 09:34:57.452140 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:34:57.975268 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1696): Launched 09:34:58.090983 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:34:58.347090 run patchelf(pid=1697): Launched 09:34:58.514157 run osmo-stp_10.42.42.5(pid=1694): ERR: Terminated: ERROR {rc=1} [trial-2402↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1694)] 09:34:58.641481 run osmo-stp_10.42.42.5(pid=1694): stdout: | (launched: 2022-12-14_09:34:57.281296) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:34:58.770515 run osmo-stp_10.42.42.5(pid=1694): stderr: | 20221214093457449 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214093457449 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214093457449 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214093457450 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214093457450 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214093457450 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214093457450 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:34:58.899892 run osmo-stp_10.42.42.5(pid=1694): stdout: | (launched: 2022-12-14_09:34:57.281296) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:34:59.023688 run osmo-stp_10.42.42.5(pid=1694): stderr: | 20221214093457449 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214093457449 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214093457449 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214093457450 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214093457450 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214093457450 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214093457450 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:34:59.170103 run patchelf(pid=1697): Terminating (SIGINT) 09:34:59.338635 run patchelf(pid=1697): Terminated: ok {rc=0} 09:34:59.459942 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=1694): Process ended prematurely: osmo-stp_10.42.42.5(pid=1694) [trial-2402↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1694)] [trial-2402↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38] 09:34:59.469810 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 09:34:59.496575 run osmo-hlr_10.42.42.2(pid=1691): ERR: Terminated: ERROR {rc=237} [trial-2402↪gprs:nanobts+band-900↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1691)] 09:34:59.545165 run osmo-hlr_10.42.42.2(pid=1691): stdout: | (launched: 2022-12-14_09:34:56.331206) 09:34:59.594402 run osmo-hlr_10.42.42.2(pid=1691): stderr: | 20221214093456502 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214093456502 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214093456502 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214093456502 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214093456502 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214093456502 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214093456515 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/gprs:nanobts+band-900/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214093456525 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214093456525 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214093456526 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:34:59.644196 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1684): Terminating (SIGTERM) 09:34:59.683728 run iperf3-srv_10.42.42.10(pid=1685): Terminating (SIGTERM) 09:34:59.723039 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1686): Terminating (SIGTERM) 09:34:59.762788 run iperf3-srv_10.42.42.10(pid=1687): Terminating (SIGTERM) 09:34:59.802193 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1690): Terminating (SIGTERM) 09:34:59.841853 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1693): Terminating (SIGTERM) 09:34:59.881390 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1696): Terminating (SIGTERM) 09:34:59.921857 --- ParallelTerminationStrategy: PID 1684 died... 09:34:59.941413 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1684): Terminated: ok {rc=0} 09:34:59.985413 --- ParallelTerminationStrategy: PID 1685 died... 09:35:00.004032 run iperf3-srv_10.42.42.10(pid=1685): Terminated {rc=256} 09:35:00.047608 --- ParallelTerminationStrategy: PID 1686 died... 09:35:00.066249 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1686): Terminated: ok {rc=0} 09:35:00.109747 --- ParallelTerminationStrategy: PID 1687 died... 09:35:00.128296 run iperf3-srv_10.42.42.10(pid=1687): Terminated {rc=256} 09:35:00.171831 --- ParallelTerminationStrategy: PID 1690 died... 09:35:00.190676 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1690): Terminated: ok {rc=0} 09:35:00.234096 --- ParallelTerminationStrategy: PID 1693 died... 09:35:00.252859 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1693): Terminated: ok {rc=0} 09:35:00.296242 --- ParallelTerminationStrategy: PID 1696 died... 09:35:00.315139 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1696): Terminated: ok {rc=0} 09:35:00.400033 bus /gobi_0: Setting Powered False 09:35:01.508095 bus /gobi_0: Setting Powered False 09:35:02.644294 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2402 gprs:nanobts+band-900 iperf3.py ---------------------------------------------- 09:35:03.787878 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 09:35:03.799116 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 09:35:03.850548 tst iperf3.py: using LAC 40017 09:35:03.978394 tst iperf3.py: using RAC 237 09:35:04.105926 tst iperf3.py: using CellId 40017 09:35:04.226448 tst iperf3.py: using BVCI 40018 09:35:04.337816 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 09:35:04.348474 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 09:35:04.359007 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 09:35:04.369432 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 09:35:04.379741 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 09:35:04.390421 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 09:35:04.401881 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 09:35:04.413292 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 09:35:04.424126 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 09:35:04.541804 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 09:35:04.758519 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:35:05.081586 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1701): Launched 09:35:05.362067 run iperf3-srv_10.42.42.10(pid=1702): Launched 09:35:05.482519 tst iperf3.py:8: start network... 09:35:05.699647 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:35:06.200477 run create_hlr_db(pid=1703): Launched 09:35:06.330829 bus /gobi_6: Setting Powered False 09:35:07.394949 run create_hlr_db(pid=1703): Terminated: ok {rc=0} 09:35:07.827341 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1705): Launched 09:35:08.130678 run osmo-hlr_10.42.42.2(pid=1706): Launched 09:35:08.245321 run osmo-stp_10.42.42.5: Starting osmo-stp 09:35:08.772026 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1708): Launched 09:35:09.074545 run osmo-stp_10.42.42.5(pid=1709): Launched 09:35:09.189184 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:35:09.710916 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1711): Launched 09:35:09.825524 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:35:10.080669 run patchelf(pid=1712): Launched 09:35:10.247354 run osmo-stp_10.42.42.5(pid=1709): ERR: Terminated: ERROR {rc=1} [trial-2402↪gprs:nanobts+band-900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1709)] 09:35:10.374548 run osmo-stp_10.42.42.5(pid=1709): stdout: | (launched: 2022-12-14_09:35:09.017934) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:35:10.503704 run osmo-stp_10.42.42.5(pid=1709): stderr: | 20221214093509184 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214093509184 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214093509184 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214093509185 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214093509185 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214093509185 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214093509185 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:35:10.632868 run osmo-stp_10.42.42.5(pid=1709): stdout: | (launched: 2022-12-14_09:35:09.017934) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:35:10.756370 run osmo-stp_10.42.42.5(pid=1709): stderr: | 20221214093509184 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214093509184 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214093509184 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214093509185 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214093509185 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214093509185 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214093509185 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:35:10.902814 run patchelf(pid=1712): Terminating (SIGINT) 09:35:11.071386 run patchelf(pid=1712): Terminated: ok {rc=0} 09:35:11.192702 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1709): Process ended prematurely: osmo-stp_10.42.42.5(pid=1709) [trial-2402↪gprs:nanobts+band-900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1709)] [trial-2402↪gprs:nanobts+band-900↪iperf3.py:8] 09:35:11.202299 tst iperf3.py:8: Test FAILED (7.4 sec) 09:35:11.229313 run osmo-hlr_10.42.42.2(pid=1706): ERR: Terminated: ERROR {rc=237} [trial-2402↪gprs:nanobts+band-900↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1706)] 09:35:11.277204 run osmo-hlr_10.42.42.2(pid=1706): stdout: | (launched: 2022-12-14_09:35:08.073807) 09:35:11.326076 run osmo-hlr_10.42.42.2(pid=1706): stderr: | 20221214093508246 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214093508247 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214093508247 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214093508247 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214093508247 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214093508247 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214093508259 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/gprs:nanobts+band-900/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214093508267 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214093508267 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214093508267 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:35:11.375517 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1701): Terminating (SIGTERM) 09:35:11.415219 run iperf3-srv_10.42.42.10(pid=1702): Terminating (SIGTERM) 09:35:11.454675 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1705): Terminating (SIGTERM) 09:35:11.494213 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1708): Terminating (SIGTERM) 09:35:11.533645 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1711): Terminating (SIGTERM) 09:35:11.573622 --- ParallelTerminationStrategy: PID 1701 died... 09:35:11.592809 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1701): Terminated: ok {rc=0} 09:35:11.636508 --- ParallelTerminationStrategy: PID 1702 died... 09:35:11.655254 run iperf3-srv_10.42.42.10(pid=1702): Terminated {rc=256} 09:35:11.698681 --- ParallelTerminationStrategy: PID 1705 died... 09:35:11.717405 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1705): Terminated: ok {rc=0} 09:35:11.760817 --- ParallelTerminationStrategy: PID 1708 died... 09:35:11.779924 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1708): Terminated: ok {rc=0} 09:35:11.823465 --- ParallelTerminationStrategy: PID 1711 died... 09:35:11.842154 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1711): Terminated: ok {rc=0} 09:35:11.924668 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2402 gprs:nanobts+band-900 iperf3m4.py ---------------------------------------------- 09:35:13.070635 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 09:35:13.082382 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 09:35:13.131780 tst iperf3m4.py: using LAC 40018 09:35:13.257816 tst iperf3m4.py: using RAC 238 09:35:13.384127 tst iperf3m4.py: using CellId 40018 09:35:13.512098 tst iperf3m4.py: using BVCI 40019 09:35:13.629817 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 09:35:13.641152 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 09:35:13.652175 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 09:35:13.663354 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 09:35:13.674390 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 09:35:13.685545 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 09:35:13.696667 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 09:35:13.707707 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 09:35:13.719031 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 09:35:13.838707 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 09:35:13.958062 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 09:35:14.073332 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 09:35:14.187662 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 09:35:14.389922 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:35:14.693427 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1713): Launched 09:35:14.955853 run iperf3-srv_10.42.42.10(pid=1714): Launched 09:35:15.068697 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 09:35:15.270322 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:35:15.572850 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1715): Launched 09:35:15.846257 run iperf3-srv_10.42.42.10(pid=1716): Launched 09:35:15.987000 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 09:35:16.247674 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:35:16.600902 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1717): Launched 09:35:16.899828 run iperf3-srv_10.42.42.10(pid=1718): Launched 09:35:17.024904 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 09:35:17.232469 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:35:17.538891 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1719): Launched 09:35:17.802454 run iperf3-srv_10.42.42.10(pid=1720): Launched 09:35:17.915866 tst iperf3m4.py:8: start network... 09:35:18.117022 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:35:18.588707 run create_hlr_db(pid=1721): Launched 09:35:18.703428 bus /gobi_6: Setting Powered False 09:35:19.763727 run create_hlr_db(pid=1721): Terminated: ok {rc=0} 09:35:20.205455 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1723): Launched 09:35:20.530839 run osmo-hlr_10.42.42.2(pid=1724): Launched 09:35:20.654443 run osmo-stp_10.42.42.5: Starting osmo-stp 09:35:21.214239 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1726): Launched 09:35:21.538644 run osmo-stp_10.42.42.5(pid=1727): Launched 09:35:21.661876 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:35:22.220028 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1729): Launched 09:35:22.343084 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:35:22.616363 run patchelf(pid=1730): Launched 09:35:22.794546 run osmo-stp_10.42.42.5(pid=1727): ERR: Terminated: ERROR {rc=1} [trial-2402↪gprs:nanobts+band-900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1727)] 09:35:22.930397 run osmo-stp_10.42.42.5(pid=1727): stdout: | (launched: 2022-12-14_09:35:21.478409) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:35:23.067718 run osmo-stp_10.42.42.5(pid=1727): stderr: | 20221214093521667 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214093521668 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214093521668 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214093521668 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214093521669 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214093521669 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214093521669 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:35:23.205713 run osmo-stp_10.42.42.5(pid=1727): stdout: | (launched: 2022-12-14_09:35:21.478409) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:35:23.338045 run osmo-stp_10.42.42.5(pid=1727): stderr: | 20221214093521667 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214093521668 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214093521668 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214093521668 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214093521669 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214093521669 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214093521669 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:35:23.494544 run patchelf(pid=1730): Terminating (SIGINT) 09:35:23.674954 run patchelf(pid=1730): Terminated: ok {rc=0} 09:35:23.805130 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1727): Process ended prematurely: osmo-stp_10.42.42.5(pid=1727) [trial-2402↪gprs:nanobts+band-900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1727)] [trial-2402↪gprs:nanobts+band-900↪iperf3m4.py:8] 09:35:23.815263 tst iperf3m4.py:8: Test FAILED (10.8 sec) 09:35:23.843761 run osmo-hlr_10.42.42.2(pid=1724): ERR: Terminated: ERROR {rc=237} [trial-2402↪gprs:nanobts+band-900↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1724)] 09:35:23.893357 run osmo-hlr_10.42.42.2(pid=1724): stdout: | (launched: 2022-12-14_09:35:20.470426) 09:35:23.944932 run osmo-hlr_10.42.42.2(pid=1724): stderr: | 20221214093520664 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214093520664 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214093520664 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214093520664 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214093520665 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214093520665 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214093520703 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/gprs:nanobts+band-900/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214093520713 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214093520714 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214093520714 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:35:23.996840 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1713): Terminating (SIGTERM) 09:35:24.038287 run iperf3-srv_10.42.42.10(pid=1714): Terminating (SIGTERM) 09:35:24.079694 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1715): Terminating (SIGTERM) 09:35:24.121583 run iperf3-srv_10.42.42.10(pid=1716): Terminating (SIGTERM) 09:35:24.163220 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1717): Terminating (SIGTERM) 09:35:24.204871 run iperf3-srv_10.42.42.10(pid=1718): Terminating (SIGTERM) 09:35:24.246240 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1719): Terminating (SIGTERM) 09:35:24.287611 run iperf3-srv_10.42.42.10(pid=1720): Terminating (SIGTERM) 09:35:24.328908 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1723): Terminating (SIGTERM) 09:35:24.370531 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1726): Terminating (SIGTERM) 09:35:24.411808 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1729): Terminating (SIGTERM) 09:35:24.453356 --- ParallelTerminationStrategy: PID 1713 died... 09:35:24.473464 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1713): Terminated: ok {rc=0} 09:35:24.519536 --- ParallelTerminationStrategy: PID 1714 died... 09:35:24.539159 run iperf3-srv_10.42.42.10(pid=1714): Terminated {rc=256} 09:35:24.584631 --- ParallelTerminationStrategy: PID 1715 died... 09:35:24.604146 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1715): Terminated: ok {rc=0} 09:35:24.649751 --- ParallelTerminationStrategy: PID 1716 died... 09:35:24.669136 run iperf3-srv_10.42.42.10(pid=1716): Terminated {rc=256} 09:35:24.714578 --- ParallelTerminationStrategy: PID 1717 died... 09:35:24.734027 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1717): Terminated: ok {rc=0} 09:35:24.779505 --- ParallelTerminationStrategy: PID 1718 died... 09:35:24.798978 run iperf3-srv_10.42.42.10(pid=1718): Terminated {rc=256} 09:35:24.844416 --- ParallelTerminationStrategy: PID 1719 died... 09:35:24.863812 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1719): Terminated: ok {rc=0} 09:35:24.909414 --- ParallelTerminationStrategy: PID 1720 died... 09:35:24.928824 run iperf3-srv_10.42.42.10(pid=1720): Terminated {rc=256} 09:35:24.974247 --- ParallelTerminationStrategy: PID 1723 died... 09:35:24.993788 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1723): Terminated: ok {rc=0} 09:35:25.039508 --- ParallelTerminationStrategy: PID 1726 died... 09:35:25.059107 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1726): Terminated: ok {rc=0} 09:35:25.104778 --- ParallelTerminationStrategy: PID 1729 died... 09:35:25.124725 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1729): Terminated: ok {rc=0} 09:35:25.211264 bus /gobi_4: Setting Powered False 09:35:26.308801 bus /gobi_4: Setting Powered False 09:35:27.423617 bus /gobi_1: Setting Powered False 09:35:28.522571 bus /gobi_1: Setting Powered False 09:35:29.634606 bus /gobi_0: Setting Powered False 09:35:30.729405 bus /gobi_0: Setting Powered False 09:35:31.842986 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2402 gprs:nanobts+band-900 ping.py ---------------------------------------------- 09:35:32.945463 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 09:35:32.956759 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 09:35:33.005073 tst ping.py: using LAC 40019 09:35:33.121370 tst ping.py: using RAC 239 09:35:33.237830 tst ping.py: using CellId 40019 09:35:33.356431 tst ping.py: using BVCI 40020 09:35:33.465676 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 09:35:33.476296 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 09:35:33.486864 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 09:35:33.497380 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 09:35:33.507845 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 09:35:33.519293 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 09:35:33.530370 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 09:35:33.541504 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 09:35:33.658422 tst ping.py:19: start network... 09:35:33.871633 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:35:34.362454 run create_hlr_db(pid=1731): Launched 09:35:34.490166 bus /gobi_6: Setting Powered False 09:35:35.552846 run create_hlr_db(pid=1731): Terminated: ok {rc=0} 09:35:35.975332 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1733): Launched 09:35:36.270885 run osmo-hlr_10.42.42.2(pid=1734): Launched 09:35:36.382605 run osmo-stp_10.42.42.5: Starting osmo-stp 09:35:36.892740 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1736): Launched 09:35:37.188291 run osmo-stp_10.42.42.5(pid=1737): Launched 09:35:37.299756 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:35:37.809081 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1739): Launched 09:35:37.922619 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:35:38.173374 run patchelf(pid=1740): Launched 09:35:38.337464 run osmo-stp_10.42.42.5(pid=1737): ERR: Terminated: ERROR {rc=1} [trial-2402↪gprs:nanobts+band-900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1737)] 09:35:38.463046 run osmo-stp_10.42.42.5(pid=1737): stdout: | (launched: 2022-12-14_09:35:37.132651) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:35:38.589922 run osmo-stp_10.42.42.5(pid=1737): stderr: | 20221214093537298 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214093537298 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214093537298 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214093537298 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214093537299 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214093537299 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214093537299 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:35:38.716775 run osmo-stp_10.42.42.5(pid=1737): stdout: | (launched: 2022-12-14_09:35:37.132651) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:35:38.839172 run osmo-stp_10.42.42.5(pid=1737): stderr: | 20221214093537298 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214093537298 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214093537298 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214093537298 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214093537299 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214093537299 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214093537299 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:35:38.982967 run patchelf(pid=1740): Terminating (SIGINT) 09:35:39.149295 run patchelf(pid=1740): Terminated: ok {rc=0} 09:35:39.268660 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=1737): Process ended prematurely: osmo-stp_10.42.42.5(pid=1737) [trial-2402↪gprs:nanobts+band-900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1737)] [trial-2402↪gprs:nanobts+band-900↪ping.py:22] 09:35:39.277589 tst ping.py:22: Test FAILED (6.3 sec) 09:35:39.304159 run osmo-hlr_10.42.42.2(pid=1734): ERR: Terminated: ERROR {rc=237} [trial-2402↪gprs:nanobts+band-900↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1734)] 09:35:39.352296 run osmo-hlr_10.42.42.2(pid=1734): stdout: | (launched: 2022-12-14_09:35:36.215670) 09:35:39.401418 run osmo-hlr_10.42.42.2(pid=1734): stderr: | 20221214093536387 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214093536387 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214093536388 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214093536388 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214093536388 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214093536388 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214093536400 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/gprs:nanobts+band-900/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214093536409 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214093536409 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214093536409 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:35:39.450848 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1733): Terminating (SIGTERM) 09:35:39.490445 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1736): Terminating (SIGTERM) 09:35:39.530037 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1739): Terminating (SIGTERM) 09:35:39.569749 --- ParallelTerminationStrategy: PID 1733 died... 09:35:39.589113 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1733): Terminated: ok {rc=0} 09:35:39.632802 --- ParallelTerminationStrategy: PID 1736 died... 09:35:39.652210 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1736): Terminated: ok {rc=0} 09:35:39.695878 --- ParallelTerminationStrategy: PID 1739 died... 09:35:39.714822 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1739): Terminated: ok {rc=0} 09:35:39.797729 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2402 gprs:nanobts+band-900 ping_idle_ping.py ---------------------------------------------- 09:35:40.883025 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 09:35:40.895337 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 09:35:40.946094 tst ping_idle_ping.py: using LAC 40020 09:35:41.071719 tst ping_idle_ping.py: using RAC 240 09:35:41.201171 tst ping_idle_ping.py: using CellId 40020 09:35:41.325366 tst ping_idle_ping.py: using BVCI 40021 09:35:41.440145 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 09:35:41.451394 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 09:35:41.462635 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 09:35:41.473710 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 09:35:41.484660 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 09:35:41.495716 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 09:35:41.506904 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 09:35:41.518158 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 09:35:41.635236 tst ping_idle_ping.py:24: start network... 09:35:41.848500 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:35:42.366998 run create_hlr_db(pid=1741): Launched 09:35:42.494969 bus /gobi_6: Setting Powered False 09:35:43.558731 run create_hlr_db(pid=1741): Terminated: ok {rc=0} 09:35:43.983250 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1743): Launched 09:35:44.279543 run osmo-hlr_10.42.42.2(pid=1744): Launched 09:35:44.392450 run osmo-stp_10.42.42.5: Starting osmo-stp 09:35:44.907093 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1746): Launched 09:35:45.204399 run osmo-stp_10.42.42.5(pid=1747): Launched 09:35:45.318108 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:35:45.836287 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1749): Launched 09:35:45.979380 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:35:46.240305 run patchelf(pid=1750): Launched 09:35:46.428017 run osmo-stp_10.42.42.5(pid=1747): ERR: Terminated: ERROR {rc=1} [trial-2402↪gprs:nanobts+band-900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1747)] 09:35:46.558510 run osmo-stp_10.42.42.5(pid=1747): stdout: | (launched: 2022-12-14_09:35:45.149022) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:35:46.691565 run osmo-stp_10.42.42.5(pid=1747): stderr: | 20221214093545316 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214093545316 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214093545316 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214093545317 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214093545317 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214093545317 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214093545318 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:35:46.824463 run osmo-stp_10.42.42.5(pid=1747): stdout: | (launched: 2022-12-14_09:35:45.149022) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:35:46.950424 run osmo-stp_10.42.42.5(pid=1747): stderr: | 20221214093545316 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214093545316 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214093545316 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214093545317 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214093545317 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214093545317 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214093545318 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:35:47.099203 run patchelf(pid=1750): Terminating (SIGINT) 09:35:47.269523 run patchelf(pid=1750): Terminated: ok {rc=0} 09:35:47.389440 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=1747): Process ended prematurely: osmo-stp_10.42.42.5(pid=1747) [trial-2402↪gprs:nanobts+band-900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1747)] [trial-2402↪gprs:nanobts+band-900↪ping_idle_ping.py:27] 09:35:47.398359 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 09:35:47.425210 run osmo-hlr_10.42.42.2(pid=1744): ERR: Terminated: ERROR {rc=237} [trial-2402↪gprs:nanobts+band-900↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1744)] 09:35:47.473297 run osmo-hlr_10.42.42.2(pid=1744): stdout: | (launched: 2022-12-14_09:35:44.223907) 09:35:47.523384 run osmo-hlr_10.42.42.2(pid=1744): stderr: | 20221214093544394 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214093544395 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214093544395 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214093544395 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214093544395 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214093544395 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214093544410 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/gprs:nanobts+band-900/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214093544419 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214093544419 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214093544420 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:35:47.573380 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1743): Terminating (SIGTERM) 09:35:47.613561 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1746): Terminating (SIGTERM) 09:35:47.653589 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1749): Terminating (SIGTERM) 09:35:47.694030 --- ParallelTerminationStrategy: PID 1743 died... 09:35:47.713525 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1743): Terminated: ok {rc=0} 09:35:47.757718 --- ParallelTerminationStrategy: PID 1746 died... 09:35:47.776436 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1746): Terminated: ok {rc=0} 09:35:47.820911 --- ParallelTerminationStrategy: PID 1749 died... 09:35:47.839975 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1749): Terminated: ok {rc=0} 09:35:47.926686 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2402 gprs:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 gprs:nanobts+band-900+mod-bts0-egprs --------------------------------------------------------------------- 09:35:49.225209 tst gprs:nanobts+band-900+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:35:49.231489 tst gprs:nanobts+band-900+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 09:35:49.263014 tst gprs:nanobts+band-900+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 09:35:49.301560 tst gprs:nanobts+band-900+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 09:35:49.391147 tst gprs:nanobts+band-900+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 09:35:49.424681 tst gprs:nanobts+band-900+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 09:35:49.462647 tst gprs:nanobts+band-900+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 09:35:50.062982 tst gprs:nanobts+band-900+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2402 gprs:nanobts+band-900+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 09:35:50.115072 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:35:50.127019 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 09:35:50.175088 tst cs_paging_gprs_active.py: using LAC 40021 09:35:50.300023 tst cs_paging_gprs_active.py: using RAC 241 09:35:50.427517 tst cs_paging_gprs_active.py: using CellId 40021 09:35:50.554215 tst cs_paging_gprs_active.py: using BVCI 40022 09:35:50.671441 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:35:50.682999 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:35:50.694316 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:35:50.705558 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:35:50.716765 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:35:50.728065 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:35:50.739397 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:35:50.750589 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:35:50.761935 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:35:50.878124 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:35:50.992791 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 09:35:51.195177 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:35:51.498103 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1756): Launched 09:35:51.761282 run iperf3-srv_10.42.42.10(pid=1757): Launched 09:35:51.874123 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 09:35:52.089186 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:35:52.396533 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1759): Launched 09:35:52.660013 run iperf3-srv_10.42.42.10(pid=1760): Launched 09:35:52.773287 tst cs_paging_gprs_active.py:38: start network... 09:35:52.974733 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:35:53.443232 run create_hlr_db(pid=1761): Launched 09:35:53.558311 bus /gobi_6: Setting Powered False 09:35:54.618386 run create_hlr_db(pid=1761): Terminated: ok {rc=0} 09:35:55.039312 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1763): Launched 09:35:55.341700 run osmo-hlr_10.42.42.2(pid=1764): Launched 09:35:55.455944 run osmo-stp_10.42.42.5: Starting osmo-stp 09:35:55.987098 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1766): Launched 09:35:56.288639 run osmo-stp_10.42.42.5(pid=1767): Launched 09:35:56.403185 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:35:56.922056 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1769): Launched 09:35:57.036747 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:35:57.291725 run patchelf(pid=1770): Launched 09:35:57.458933 run osmo-stp_10.42.42.5(pid=1767): ERR: Terminated: ERROR {rc=1} [trial-2402↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1767)] 09:35:57.585833 run osmo-stp_10.42.42.5(pid=1767): stdout: | (launched: 2022-12-14_09:35:56.232423) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:35:57.714612 run osmo-stp_10.42.42.5(pid=1767): stderr: | 20221214093556399 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214093556399 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214093556400 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214093556400 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214093556401 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214093556401 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214093556401 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:35:57.843456 run osmo-stp_10.42.42.5(pid=1767): stdout: | (launched: 2022-12-14_09:35:56.232423) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:35:57.967465 run osmo-stp_10.42.42.5(pid=1767): stderr: | 20221214093556399 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214093556399 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214093556400 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214093556400 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214093556401 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214093556401 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214093556401 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:35:58.114108 run patchelf(pid=1770): Terminating (SIGINT) 09:35:58.282899 run patchelf(pid=1770): Terminated: ok {rc=0} 09:35:58.404443 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=1767): Process ended prematurely: osmo-stp_10.42.42.5(pid=1767) [trial-2402↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1767)] [trial-2402↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 09:35:58.414046 tst cs_paging_gprs_active.py:38: Test FAILED (8.3 sec) 09:35:58.440789 run osmo-hlr_10.42.42.2(pid=1764): ERR: Terminated: ERROR {rc=237} [trial-2402↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1764)] 09:35:58.489106 run osmo-hlr_10.42.42.2(pid=1764): stdout: | (launched: 2022-12-14_09:35:55.285281) 09:35:58.538550 run osmo-hlr_10.42.42.2(pid=1764): stderr: | 20221214093555456 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214093555456 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214093555456 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214093555456 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214093555456 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214093555456 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214093555468 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/gprs:nanobts+band-900+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214093555476 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214093555476 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214093555476 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:35:58.587844 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1756): Terminating (SIGTERM) 09:35:58.627448 run iperf3-srv_10.42.42.10(pid=1757): Terminating (SIGTERM) 09:35:58.666798 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1759): Terminating (SIGTERM) 09:35:58.706216 run iperf3-srv_10.42.42.10(pid=1760): Terminating (SIGTERM) 09:35:58.745466 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1763): Terminating (SIGTERM) 09:35:58.785260 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1766): Terminating (SIGTERM) 09:35:58.824596 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1769): Terminating (SIGTERM) 09:35:58.864105 --- ParallelTerminationStrategy: PID 1756 died... 09:35:58.883247 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1756): Terminated: ok {rc=0} 09:35:58.926952 --- ParallelTerminationStrategy: PID 1757 died... 09:35:58.945588 run iperf3-srv_10.42.42.10(pid=1757): Terminated {rc=256} 09:35:58.988904 --- ParallelTerminationStrategy: PID 1759 died... 09:35:59.008170 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1759): Terminated: ok {rc=0} 09:35:59.051537 --- ParallelTerminationStrategy: PID 1760 died... 09:35:59.070164 run iperf3-srv_10.42.42.10(pid=1760): Terminated {rc=256} 09:35:59.113581 --- ParallelTerminationStrategy: PID 1763 died... 09:35:59.132155 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1763): Terminated: ok {rc=0} 09:35:59.175895 --- ParallelTerminationStrategy: PID 1766 died... 09:35:59.194582 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1766): Terminated: ok {rc=0} 09:35:59.237984 --- ParallelTerminationStrategy: PID 1769 died... 09:35:59.256785 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1769): Terminated: ok {rc=0} 09:35:59.339311 bus /gobi_0: Setting Powered False 09:36:00.435426 bus /gobi_0: Setting Powered False 09:36:01.550940 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2402 gprs:nanobts+band-900+mod-bts0-egprs iperf3.py ---------------------------------------------- 09:36:02.697985 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:36:02.710052 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 09:36:02.766073 tst iperf3.py: using LAC 40022 09:36:02.891873 tst iperf3.py: using RAC 242 09:36:03.016909 tst iperf3.py: using CellId 40022 09:36:03.141638 tst iperf3.py: using BVCI 40023 09:36:03.258595 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:36:03.270163 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:36:03.281457 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:36:03.292663 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:36:03.303892 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:36:03.315170 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:36:03.326692 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:36:03.338133 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:36:03.349604 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:36:03.466213 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 09:36:03.668207 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:36:03.972745 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1771): Launched 09:36:04.236931 run iperf3-srv_10.42.42.10(pid=1772): Launched 09:36:04.350636 tst iperf3.py:8: start network... 09:36:04.552864 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:36:05.022636 run create_hlr_db(pid=1773): Launched 09:36:05.138245 bus /gobi_6: Setting Powered False 09:36:06.198379 run create_hlr_db(pid=1773): Terminated: ok {rc=0} 09:36:06.638537 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1775): Launched 09:36:06.961854 run osmo-hlr_10.42.42.2(pid=1776): Launched 09:36:07.086142 run osmo-stp_10.42.42.5: Starting osmo-stp 09:36:07.648017 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1778): Launched 09:36:07.970508 run osmo-stp_10.42.42.5(pid=1780): Launched 09:36:08.093780 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:36:08.650855 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1782): Launched 09:36:08.773439 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:36:09.047212 run patchelf(pid=1783): Launched 09:36:09.226437 run osmo-stp_10.42.42.5(pid=1780): ERR: Terminated: ERROR {rc=1} [trial-2402↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1780)] 09:36:09.362907 run osmo-stp_10.42.42.5(pid=1780): stdout: | (launched: 2022-12-14_09:36:07.910557) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:36:09.500779 run osmo-stp_10.42.42.5(pid=1780): stderr: | 20221214093608099 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214093608099 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214093608099 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214093608100 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214093608100 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214093608100 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214093608100 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:36:09.638918 run osmo-stp_10.42.42.5(pid=1780): stdout: | (launched: 2022-12-14_09:36:07.910557) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:36:09.771133 run osmo-stp_10.42.42.5(pid=1780): stderr: | 20221214093608099 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214093608099 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214093608099 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214093608100 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214093608100 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214093608100 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214093608100 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:36:09.927446 run patchelf(pid=1783): Terminating (SIGINT) 09:36:10.108198 run patchelf(pid=1783): Terminated: ok {rc=0} 09:36:10.238426 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1780): Process ended prematurely: osmo-stp_10.42.42.5(pid=1780) [trial-2402↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1780)] [trial-2402↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8] 09:36:10.248439 tst iperf3.py:8: Test FAILED (7.6 sec) 09:36:10.277063 run osmo-hlr_10.42.42.2(pid=1776): ERR: Terminated: ERROR {rc=237} [trial-2402↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1776)] 09:36:10.328132 run osmo-hlr_10.42.42.2(pid=1776): stdout: | (launched: 2022-12-14_09:36:06.902053) 09:36:10.380146 run osmo-hlr_10.42.42.2(pid=1776): stderr: | 20221214093607097 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214093607097 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214093607097 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214093607097 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214093607097 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214093607097 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214093607109 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/gprs:nanobts+band-900+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214093607119 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214093607119 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214093607119 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:36:10.432394 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1771): Terminating (SIGTERM) 09:36:10.474149 run iperf3-srv_10.42.42.10(pid=1772): Terminating (SIGTERM) 09:36:10.515911 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1775): Terminating (SIGTERM) 09:36:10.557814 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1778): Terminating (SIGTERM) 09:36:10.599562 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1782): Terminating (SIGTERM) 09:36:10.641694 --- ParallelTerminationStrategy: PID 1771 died... 09:36:10.661773 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1771): Terminated: ok {rc=0} 09:36:10.708063 --- ParallelTerminationStrategy: PID 1772 died... 09:36:10.727423 run iperf3-srv_10.42.42.10(pid=1772): Terminated {rc=256} 09:36:10.773452 --- ParallelTerminationStrategy: PID 1775 died... 09:36:10.793002 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1775): Terminated: ok {rc=0} 09:36:10.838939 --- ParallelTerminationStrategy: PID 1778 died... 09:36:10.858426 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1778): Terminated: ok {rc=0} 09:36:10.904583 --- ParallelTerminationStrategy: PID 1782 died... 09:36:10.924095 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1782): Terminated: ok {rc=0} 09:36:11.010622 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2402 gprs:nanobts+band-900+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 09:36:12.165056 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:36:12.177130 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 09:36:12.226761 tst iperf3m4.py: using LAC 40023 09:36:12.356153 tst iperf3m4.py: using RAC 243 09:36:12.484550 tst iperf3m4.py: using CellId 40023 09:36:12.611315 tst iperf3m4.py: using BVCI 40024 09:36:12.729024 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:36:12.740748 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:36:12.751996 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:36:12.763180 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:36:12.774808 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:36:12.786568 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:36:12.798585 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:36:12.810235 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:36:12.822116 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:36:12.939860 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:36:13.060772 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:36:13.180467 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:36:13.298323 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 09:36:13.517454 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:36:13.843279 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1784): Launched 09:36:14.126198 run iperf3-srv_10.42.42.10(pid=1785): Launched 09:36:14.247544 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 09:36:14.464437 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:36:14.788793 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1786): Launched 09:36:15.070150 run iperf3-srv_10.42.42.10(pid=1787): Launched 09:36:15.191550 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 09:36:15.408885 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:36:15.733599 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1788): Launched 09:36:16.029763 run iperf3-srv_10.42.42.10(pid=1789): Launched 09:36:16.183461 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 09:36:16.404507 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:36:16.734914 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1790): Launched 09:36:17.032193 run iperf3-srv_10.42.42.10(pid=1791): Launched 09:36:17.167759 tst iperf3m4.py:8: start network... 09:36:17.385539 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:36:17.886821 run create_hlr_db(pid=1792): Launched 09:36:18.018508 bus /gobi_6: Setting Powered False 09:36:19.082461 run create_hlr_db(pid=1792): Terminated: ok {rc=0} 09:36:19.530242 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1794): Launched 09:36:19.855260 run osmo-hlr_10.42.42.2(pid=1795): Launched 09:36:19.978120 run osmo-stp_10.42.42.5: Starting osmo-stp 09:36:20.540926 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1797): Launched 09:36:20.863283 run osmo-stp_10.42.42.5(pid=1798): Launched 09:36:20.985789 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:36:21.542427 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1800): Launched 09:36:21.665106 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:36:21.938433 run patchelf(pid=1801): Launched 09:36:22.116426 run osmo-stp_10.42.42.5(pid=1798): ERR: Terminated: ERROR {rc=1} [trial-2402↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1798)] 09:36:22.252723 run osmo-stp_10.42.42.5(pid=1798): stdout: | (launched: 2022-12-14_09:36:20.803426) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:36:22.389687 run osmo-stp_10.42.42.5(pid=1798): stderr: | 20221214093620992 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214093620992 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214093620993 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214093620993 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214093620994 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214093620994 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214093620994 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:36:22.526663 run osmo-stp_10.42.42.5(pid=1798): stdout: | (launched: 2022-12-14_09:36:20.803426) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:36:22.657971 run osmo-stp_10.42.42.5(pid=1798): stderr: | 20221214093620992 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214093620992 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214093620993 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214093620993 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214093620994 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214093620994 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214093620994 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:36:22.813533 run patchelf(pid=1801): Terminating (SIGINT) 09:36:22.992192 run patchelf(pid=1801): Terminated: ok {rc=0} 09:36:23.121081 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1798): Process ended prematurely: osmo-stp_10.42.42.5(pid=1798) [trial-2402↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1798)] [trial-2402↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8] 09:36:23.131238 tst iperf3m4.py:8: Test FAILED (11.0 sec) 09:36:23.160281 run osmo-hlr_10.42.42.2(pid=1795): ERR: Terminated: ERROR {rc=237} [trial-2402↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1795)] 09:36:23.209957 run osmo-hlr_10.42.42.2(pid=1795): stdout: | (launched: 2022-12-14_09:36:19.794921) 09:36:23.261188 run osmo-hlr_10.42.42.2(pid=1795): stderr: | 20221214093619989 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214093619989 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214093619989 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214093619989 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214093619989 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214093619989 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214093620002 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/gprs:nanobts+band-900+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214093620010 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214093620011 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214093620011 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:36:23.313086 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1784): Terminating (SIGTERM) 09:36:23.354663 run iperf3-srv_10.42.42.10(pid=1785): Terminating (SIGTERM) 09:36:23.396551 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1786): Terminating (SIGTERM) 09:36:23.437835 run iperf3-srv_10.42.42.10(pid=1787): Terminating (SIGTERM) 09:36:23.478870 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1788): Terminating (SIGTERM) 09:36:23.519981 run iperf3-srv_10.42.42.10(pid=1789): Terminating (SIGTERM) 09:36:23.560916 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1790): Terminating (SIGTERM) 09:36:23.602204 run iperf3-srv_10.42.42.10(pid=1791): Terminating (SIGTERM) 09:36:23.643213 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1794): Terminating (SIGTERM) 09:36:23.684353 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1797): Terminating (SIGTERM) 09:36:23.725484 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1800): Terminating (SIGTERM) 09:36:23.766963 --- ParallelTerminationStrategy: PID 1784 died... 09:36:23.786717 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1784): Terminated: ok {rc=0} 09:36:23.832496 --- ParallelTerminationStrategy: PID 1785 died... 09:36:23.851755 run iperf3-srv_10.42.42.10(pid=1785): Terminated {rc=256} 09:36:23.896847 --- ParallelTerminationStrategy: PID 1786 died... 09:36:23.916486 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1786): Terminated: ok {rc=0} 09:36:23.961758 --- ParallelTerminationStrategy: PID 1787 died... 09:36:23.981108 run iperf3-srv_10.42.42.10(pid=1787): Terminated {rc=256} 09:36:24.026168 --- ParallelTerminationStrategy: PID 1788 died... 09:36:24.045409 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1788): Terminated: ok {rc=0} 09:36:24.090558 --- ParallelTerminationStrategy: PID 1789 died... 09:36:24.109812 run iperf3-srv_10.42.42.10(pid=1789): Terminated {rc=256} 09:36:24.155442 --- ParallelTerminationStrategy: PID 1790 died... 09:36:24.174987 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1790): Terminated: ok {rc=0} 09:36:24.220400 --- ParallelTerminationStrategy: PID 1791 died... 09:36:24.239688 run iperf3-srv_10.42.42.10(pid=1791): Terminated {rc=256} 09:36:24.284900 --- ParallelTerminationStrategy: PID 1794 died... 09:36:24.304572 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1794): Terminated: ok {rc=0} 09:36:24.350403 --- ParallelTerminationStrategy: PID 1797 died... 09:36:24.369798 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1797): Terminated: ok {rc=0} 09:36:24.414986 --- ParallelTerminationStrategy: PID 1800 died... 09:36:24.434400 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1800): Terminated: ok {rc=0} 09:36:24.520764 bus /gobi_4: Setting Powered False 09:36:25.618554 bus /gobi_4: Setting Powered False 09:36:26.732290 bus /gobi_1: Setting Powered False 09:36:27.828768 bus /gobi_1: Setting Powered False 09:36:28.942233 bus /gobi_0: Setting Powered False 09:36:30.039118 bus /gobi_0: Setting Powered False 09:36:31.162661 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2402 gprs:nanobts+band-900+mod-bts0-egprs ping.py ---------------------------------------------- 09:36:32.272311 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:36:32.283818 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 09:36:32.334475 tst ping.py: using LAC 40024 09:36:32.461938 tst ping.py: using RAC 244 09:36:32.581397 tst ping.py: using CellId 40024 09:36:32.697554 tst ping.py: using BVCI 40025 09:36:32.815059 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:36:32.826891 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:36:32.838498 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:36:32.850038 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:36:32.861949 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:36:32.873903 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:36:32.886173 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:36:32.897984 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:36:33.017593 tst ping.py:19: start network... 09:36:33.230430 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:36:33.721382 run create_hlr_db(pid=1802): Launched 09:36:33.850182 bus /gobi_6: Setting Powered False 09:36:34.912285 run create_hlr_db(pid=1802): Terminated: ok {rc=0} 09:36:35.334213 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1804): Launched 09:36:35.630203 run osmo-hlr_10.42.42.2(pid=1805): Launched 09:36:35.742615 run osmo-stp_10.42.42.5: Starting osmo-stp 09:36:36.255259 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1807): Launched 09:36:36.550924 run osmo-stp_10.42.42.5(pid=1808): Launched 09:36:36.663378 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:36:37.174428 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1810): Launched 09:36:37.287948 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:36:37.539597 run patchelf(pid=1811): Launched 09:36:37.704675 run osmo-stp_10.42.42.5(pid=1808): ERR: Terminated: ERROR {rc=1} [trial-2402↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1808)] 09:36:37.830599 run osmo-stp_10.42.42.5(pid=1808): stdout: | (launched: 2022-12-14_09:36:36.495124) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:36:37.958030 run osmo-stp_10.42.42.5(pid=1808): stderr: | 20221214093636662 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214093636662 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214093636662 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214093636663 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214093636663 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214093636663 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214093636663 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:36:38.085467 run osmo-stp_10.42.42.5(pid=1808): stdout: | (launched: 2022-12-14_09:36:36.495124) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:36:38.208267 run osmo-stp_10.42.42.5(pid=1808): stderr: | 20221214093636662 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214093636662 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214093636662 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214093636663 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214093636663 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214093636663 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214093636663 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:36:38.353222 run patchelf(pid=1811): Terminating (SIGINT) 09:36:38.519277 run patchelf(pid=1811): Terminated: ok {rc=0} 09:36:38.638597 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=1808): Process ended prematurely: osmo-stp_10.42.42.5(pid=1808) [trial-2402↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1808)] [trial-2402↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22] 09:36:38.647416 tst ping.py:22: Test FAILED (6.4 sec) 09:36:38.674021 run osmo-hlr_10.42.42.2(pid=1805): ERR: Terminated: ERROR {rc=237} [trial-2402↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1805)] 09:36:38.721897 run osmo-hlr_10.42.42.2(pid=1805): stdout: | (launched: 2022-12-14_09:36:35.574830) 09:36:38.771075 run osmo-hlr_10.42.42.2(pid=1805): stderr: | 20221214093635745 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214093635745 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214093635745 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214093635745 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214093635746 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214093635746 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214093635758 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/gprs:nanobts+band-900+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214093635767 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214093635767 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214093635767 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:36:38.820635 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1804): Terminating (SIGTERM) 09:36:38.860265 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1807): Terminating (SIGTERM) 09:36:38.899800 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1810): Terminating (SIGTERM) 09:36:38.939688 --- ParallelTerminationStrategy: PID 1804 died... 09:36:38.959216 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1804): Terminated: ok {rc=0} 09:36:39.003380 --- ParallelTerminationStrategy: PID 1807 died... 09:36:39.022287 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1807): Terminated: ok {rc=0} 09:36:39.066133 --- ParallelTerminationStrategy: PID 1810 died... 09:36:39.084792 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1810): Terminated: ok {rc=0} 09:36:39.168655 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2402 gprs:nanobts+band-900+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 09:36:40.254738 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:36:40.267693 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 09:36:40.318790 tst ping_idle_ping.py: using LAC 40025 09:36:40.438567 tst ping_idle_ping.py: using RAC 245 09:36:40.562266 tst ping_idle_ping.py: using CellId 40025 09:36:40.692923 tst ping_idle_ping.py: using BVCI 40026 09:36:40.803862 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:36:40.815004 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:36:40.826004 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:36:40.836706 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:36:40.847739 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:36:40.858816 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:36:40.870083 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:36:40.881169 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:36:40.995702 tst ping_idle_ping.py:24: start network... 09:36:41.193796 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:36:41.656245 run create_hlr_db(pid=1813): Launched 09:36:41.768418 bus /gobi_6: Setting Powered False 09:36:42.828125 run create_hlr_db(pid=1813): Terminated: ok {rc=0} 09:36:43.263566 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1816): Launched 09:36:43.581969 run osmo-hlr_10.42.42.2(pid=1817): Launched 09:36:43.702342 run osmo-stp_10.42.42.5: Starting osmo-stp 09:36:44.259884 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1820): Launched 09:36:44.579260 run osmo-stp_10.42.42.5(pid=1821): Launched 09:36:44.699869 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:36:45.249132 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1823): Launched 09:36:45.371284 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:36:45.639794 run patchelf(pid=1824): Launched 09:36:45.816226 run osmo-stp_10.42.42.5(pid=1821): ERR: Terminated: ERROR {rc=1} [trial-2402↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1821)] 09:36:45.971147 run osmo-stp_10.42.42.5(pid=1821): stdout: | (launched: 2022-12-14_09:36:44.519913) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:36:46.111215 run osmo-stp_10.42.42.5(pid=1821): stderr: | 20221214093644706 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214093644706 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214093644707 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214093644707 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214093644708 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214093644708 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214093644708 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:36:46.254564 run osmo-stp_10.42.42.5(pid=1821): stdout: | (launched: 2022-12-14_09:36:44.519913) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:36:46.389401 run osmo-stp_10.42.42.5(pid=1821): stderr: | 20221214093644706 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214093644706 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214093644707 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214093644707 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214093644708 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214093644708 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214093644708 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:36:46.547869 run patchelf(pid=1824): Terminating (SIGINT) 09:36:46.730865 run patchelf(pid=1824): Terminated: ok {rc=0} 09:36:46.862711 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=1821): Process ended prematurely: osmo-stp_10.42.42.5(pid=1821) [trial-2402↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1821)] [trial-2402↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27] 09:36:46.872815 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 09:36:46.902358 run osmo-hlr_10.42.42.2(pid=1817): ERR: Terminated: ERROR {rc=237} [trial-2402↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1817)] 09:36:46.953998 run osmo-hlr_10.42.42.2(pid=1817): stdout: | (launched: 2022-12-14_09:36:43.522572) 09:36:47.007295 run osmo-hlr_10.42.42.2(pid=1817): stderr: | 20221214093643717 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214093643717 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214093643717 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214093643717 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214093643717 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214093643717 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214093643730 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/gprs:nanobts+band-900+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214093643738 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214093643738 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214093643738 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:36:47.060761 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1816): Terminating (SIGTERM) 09:36:47.104839 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1820): Terminating (SIGTERM) 09:36:47.154580 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1823): Terminating (SIGTERM) 09:36:47.198125 --- ParallelTerminationStrategy: PID 1816 died... 09:36:47.218262 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1816): Terminated: ok {rc=0} 09:36:47.262407 --- ParallelTerminationStrategy: PID 1820 died... 09:36:47.281264 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1820): Terminated: ok {rc=0} 09:36:47.325918 --- ParallelTerminationStrategy: PID 1823 died... 09:36:47.345017 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1823): Terminated: ok {rc=0} 09:36:47.430956 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2402 gprs:nanobts+band-900+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 gprs:nanobts+band-900+mod-bts0-dynts-ipa --------------------------------------------------------------------- 09:36:48.728360 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:36:48.735132 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 09:36:48.766701 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 09:36:48.805687 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 09:36:48.894006 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 09:36:48.927374 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 09:36:48.966737 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 09:36:49.556446 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2402 gprs:nanobts+band-900+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 09:36:49.605382 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:36:49.616458 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 09:36:49.683267 tst cs_paging_gprs_active.py: using LAC 40026 09:36:49.805743 tst cs_paging_gprs_active.py: using RAC 246 09:36:49.932344 tst cs_paging_gprs_active.py: using CellId 40026 09:36:50.057373 tst cs_paging_gprs_active.py: using BVCI 40027 09:36:50.177080 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:36:50.188585 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:36:50.199974 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:36:50.211318 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:36:50.222497 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:36:50.233741 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:36:50.245067 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:36:50.256273 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:36:50.267750 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:36:50.388398 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:36:50.507486 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 09:36:50.725691 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:36:51.049726 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1828): Launched 09:36:51.331653 run iperf3-srv_10.42.42.10(pid=1829): Launched 09:36:51.452545 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 09:36:51.670207 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:36:51.994994 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1830): Launched 09:36:52.277168 run iperf3-srv_10.42.42.10(pid=1831): Launched 09:36:52.398613 tst cs_paging_gprs_active.py:38: start network... 09:36:52.616564 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:36:53.119006 run create_hlr_db(pid=1832): Launched 09:36:53.250024 bus /gobi_6: Setting Powered False 09:36:54.314149 run create_hlr_db(pid=1832): Terminated: ok {rc=0} 09:36:54.744840 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1834): Launched 09:36:55.070064 run osmo-hlr_10.42.42.2(pid=1835): Launched 09:36:55.193807 run osmo-stp_10.42.42.5: Starting osmo-stp 09:36:55.754530 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1837): Launched 09:36:56.078123 run osmo-stp_10.42.42.5(pid=1838): Launched 09:36:56.200682 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:36:56.758147 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1840): Launched 09:36:56.880864 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:36:57.154409 run patchelf(pid=1841): Launched 09:36:57.336436 run osmo-stp_10.42.42.5(pid=1838): ERR: Terminated: ERROR {rc=1} [trial-2402↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1838)] 09:36:57.472438 run osmo-stp_10.42.42.5(pid=1838): stdout: | (launched: 2022-12-14_09:36:56.018344) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:36:57.610909 run osmo-stp_10.42.42.5(pid=1838): stderr: | 20221214093656208 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214093656208 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214093656209 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214093656209 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214093656209 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214093656210 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214093656210 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:36:57.749244 run osmo-stp_10.42.42.5(pid=1838): stdout: | (launched: 2022-12-14_09:36:56.018344) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:36:57.881713 run osmo-stp_10.42.42.5(pid=1838): stderr: | 20221214093656208 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214093656208 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214093656209 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214093656209 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214093656209 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214093656210 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214093656210 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:36:58.038869 run patchelf(pid=1841): Terminating (SIGINT) 09:36:58.219924 run patchelf(pid=1841): Terminated: ok {rc=0} 09:36:58.350439 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=1838): Process ended prematurely: osmo-stp_10.42.42.5(pid=1838) [trial-2402↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1838)] [trial-2402↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 09:36:58.360396 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 09:36:58.389031 run osmo-hlr_10.42.42.2(pid=1835): ERR: Terminated: ERROR {rc=237} [trial-2402↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1835)] 09:36:58.439438 run osmo-hlr_10.42.42.2(pid=1835): stdout: | (launched: 2022-12-14_09:36:55.010052) 09:36:58.491099 run osmo-hlr_10.42.42.2(pid=1835): stderr: | 20221214093655205 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214093655205 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214093655205 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214093655205 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214093655205 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214093655205 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214093655218 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/gprs:nanobts+band-900+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214093655227 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214093655227 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214093655227 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:36:58.543097 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1828): Terminating (SIGTERM) 09:36:58.584658 run iperf3-srv_10.42.42.10(pid=1829): Terminating (SIGTERM) 09:36:58.626208 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1830): Terminating (SIGTERM) 09:36:58.667696 run iperf3-srv_10.42.42.10(pid=1831): Terminating (SIGTERM) 09:36:58.709084 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1834): Terminating (SIGTERM) 09:36:58.750832 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1837): Terminating (SIGTERM) 09:36:58.792360 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1840): Terminating (SIGTERM) 09:36:58.834281 --- ParallelTerminationStrategy: PID 1828 died... 09:36:58.854211 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1828): Terminated: ok {rc=0} 09:36:58.900222 --- ParallelTerminationStrategy: PID 1829 died... 09:36:58.919670 run iperf3-srv_10.42.42.10(pid=1829): Terminated {rc=256} 09:36:58.965217 --- ParallelTerminationStrategy: PID 1830 died... 09:36:58.984481 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1830): Terminated: ok {rc=0} 09:36:59.030232 --- ParallelTerminationStrategy: PID 1831 died... 09:36:59.049621 run iperf3-srv_10.42.42.10(pid=1831): Terminated {rc=256} 09:36:59.095052 --- ParallelTerminationStrategy: PID 1834 died... 09:36:59.114560 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1834): Terminated: ok {rc=0} 09:36:59.160324 --- ParallelTerminationStrategy: PID 1837 died... 09:36:59.179876 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1837): Terminated: ok {rc=0} 09:36:59.225475 --- ParallelTerminationStrategy: PID 1840 died... 09:36:59.244851 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1840): Terminated: ok {rc=0} 09:36:59.331482 bus /gobi_0: Setting Powered False 09:37:00.430239 bus /gobi_0: Setting Powered False 09:37:01.554872 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2402 gprs:nanobts+band-900+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 09:37:02.708763 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:37:02.720357 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 09:37:02.789430 tst iperf3.py: using LAC 40027 09:37:02.917129 tst iperf3.py: using RAC 247 09:37:03.044209 tst iperf3.py: using CellId 40027 09:37:03.164206 tst iperf3.py: using BVCI 40028 09:37:03.275566 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:37:03.286554 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:37:03.297708 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:37:03.308509 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:37:03.319619 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:37:03.330811 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:37:03.342068 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:37:03.352943 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:37:03.364246 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:37:03.479467 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 09:37:03.682352 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:37:03.987876 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1845): Launched 09:37:04.252740 run iperf3-srv_10.42.42.10(pid=1846): Launched 09:37:04.366969 tst iperf3.py:8: start network... 09:37:04.570149 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:37:05.041372 run create_hlr_db(pid=1847): Launched 09:37:05.158052 bus /gobi_6: Setting Powered False 09:37:06.218575 run create_hlr_db(pid=1847): Terminated: ok {rc=0} 09:37:06.641511 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1849): Launched 09:37:06.944558 run osmo-hlr_10.42.42.2(pid=1850): Launched 09:37:07.060105 run osmo-stp_10.42.42.5: Starting osmo-stp 09:37:07.581299 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1852): Launched 09:37:07.883834 run osmo-stp_10.42.42.5(pid=1853): Launched 09:37:07.999555 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:37:08.522612 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1855): Launched 09:37:08.645818 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:37:08.921221 run patchelf(pid=1856): Launched 09:37:09.099788 run osmo-stp_10.42.42.5(pid=1853): ERR: Terminated: ERROR {rc=1} [trial-2402↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1853)] 09:37:09.236420 run osmo-stp_10.42.42.5(pid=1853): stdout: | (launched: 2022-12-14_09:37:07.827284) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:37:09.374466 run osmo-stp_10.42.42.5(pid=1853): stderr: | 20221214093707994 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214093707995 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214093707995 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214093707995 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214093707996 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214093707996 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214093707996 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:37:09.512202 run osmo-stp_10.42.42.5(pid=1853): stdout: | (launched: 2022-12-14_09:37:07.827284) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:37:09.644128 run osmo-stp_10.42.42.5(pid=1853): stderr: | 20221214093707994 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214093707995 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214093707995 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214093707995 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214093707996 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214093707996 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214093707996 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:37:09.800480 run patchelf(pid=1856): Terminating (SIGINT) 09:37:09.980132 run patchelf(pid=1856): Terminated: ok {rc=0} 09:37:10.109785 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1853): Process ended prematurely: osmo-stp_10.42.42.5(pid=1853) [trial-2402↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1853)] [trial-2402↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8] 09:37:10.120051 tst iperf3.py:8: Test FAILED (7.4 sec) 09:37:10.148599 run osmo-hlr_10.42.42.2(pid=1850): ERR: Terminated: ERROR {rc=237} [trial-2402↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1850)] 09:37:10.199116 run osmo-hlr_10.42.42.2(pid=1850): stdout: | (launched: 2022-12-14_09:37:06.888120) 09:37:10.251160 run osmo-hlr_10.42.42.2(pid=1850): stderr: | 20221214093707061 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214093707061 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214093707061 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214093707061 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214093707061 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214093707061 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214093707073 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/gprs:nanobts+band-900+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214093707081 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214093707081 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214093707081 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:37:10.303417 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1845): Terminating (SIGTERM) 09:37:10.345550 run iperf3-srv_10.42.42.10(pid=1846): Terminating (SIGTERM) 09:37:10.387429 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1849): Terminating (SIGTERM) 09:37:10.429868 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1852): Terminating (SIGTERM) 09:37:10.472239 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1855): Terminating (SIGTERM) 09:37:10.514521 --- ParallelTerminationStrategy: PID 1845 died... 09:37:10.534535 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1845): Terminated: ok {rc=0} 09:37:10.581068 --- ParallelTerminationStrategy: PID 1846 died... 09:37:10.600557 run iperf3-srv_10.42.42.10(pid=1846): Terminated {rc=256} 09:37:10.646664 --- ParallelTerminationStrategy: PID 1849 died... 09:37:10.666392 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1849): Terminated: ok {rc=0} 09:37:10.712338 --- ParallelTerminationStrategy: PID 1852 died... 09:37:10.731994 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1852): Terminated: ok {rc=0} 09:37:10.778493 --- ParallelTerminationStrategy: PID 1855 died... 09:37:10.798119 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1855): Terminated: ok {rc=0} 09:37:10.884672 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2402 gprs:nanobts+band-900+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 09:37:12.030042 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:37:12.041957 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 09:37:12.110637 tst iperf3m4.py: using LAC 40028 09:37:12.229400 tst iperf3m4.py: using RAC 248 09:37:12.348048 tst iperf3m4.py: using CellId 40028 09:37:12.470931 tst iperf3m4.py: using BVCI 40029 09:37:12.582940 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:37:12.594088 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:37:12.604897 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:37:12.615788 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:37:12.626903 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:37:12.638128 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:37:12.649545 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:37:12.660568 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:37:12.671960 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:37:12.788573 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:37:12.908920 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:37:13.026311 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:37:13.146053 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 09:37:13.365435 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:37:13.691210 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1857): Launched 09:37:13.972690 run iperf3-srv_10.42.42.10(pid=1858): Launched 09:37:14.094067 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 09:37:14.311851 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:37:14.636756 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1859): Launched 09:37:14.918394 run iperf3-srv_10.42.42.10(pid=1860): Launched 09:37:15.035235 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 09:37:15.238122 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:37:15.543170 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1861): Launched 09:37:15.806813 run iperf3-srv_10.42.42.10(pid=1862): Launched 09:37:15.938972 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 09:37:16.162415 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:37:16.501445 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1863): Launched 09:37:16.804021 run iperf3-srv_10.42.42.10(pid=1864): Launched 09:37:16.943080 tst iperf3m4.py:8: start network... 09:37:17.167594 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:37:17.663909 run create_hlr_db(pid=1865): Launched 09:37:17.779635 bus /gobi_6: Setting Powered False 09:37:18.840731 run create_hlr_db(pid=1865): Terminated: ok {rc=0} 09:37:19.262451 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1867): Launched 09:37:19.565687 run osmo-hlr_10.42.42.2(pid=1868): Launched 09:37:19.680281 run osmo-stp_10.42.42.5: Starting osmo-stp 09:37:20.202268 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1870): Launched 09:37:20.505172 run osmo-stp_10.42.42.5(pid=1871): Launched 09:37:20.620552 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:37:21.141774 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1873): Launched 09:37:21.256546 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:37:21.511884 run patchelf(pid=1874): Launched 09:37:21.679742 run osmo-stp_10.42.42.5(pid=1871): ERR: Terminated: ERROR {rc=1} [trial-2402↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1871)] 09:37:21.807741 run osmo-stp_10.42.42.5(pid=1871): stdout: | (launched: 2022-12-14_09:37:20.448290) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:37:21.936775 run osmo-stp_10.42.42.5(pid=1871): stderr: | 20221214093720618 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214093720618 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214093720619 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214093720619 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214093720619 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214093720620 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214093720620 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:37:22.066058 run osmo-stp_10.42.42.5(pid=1871): stdout: | (launched: 2022-12-14_09:37:20.448290) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:37:22.189745 run osmo-stp_10.42.42.5(pid=1871): stderr: | 20221214093720618 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214093720618 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214093720619 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214093720619 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214093720619 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214093720620 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214093720620 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:37:22.335475 run patchelf(pid=1874): Terminating (SIGINT) 09:37:22.503412 run patchelf(pid=1874): Terminated: ok {rc=0} 09:37:22.625075 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1871): Process ended prematurely: osmo-stp_10.42.42.5(pid=1871) [trial-2402↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1871)] [trial-2402↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8] 09:37:22.634581 tst iperf3m4.py:8: Test FAILED (10.6 sec) 09:37:22.662387 run osmo-hlr_10.42.42.2(pid=1868): ERR: Terminated: ERROR {rc=237} [trial-2402↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1868)] 09:37:22.710535 run osmo-hlr_10.42.42.2(pid=1868): stdout: | (launched: 2022-12-14_09:37:19.508546) 09:37:22.759850 run osmo-hlr_10.42.42.2(pid=1868): stderr: | 20221214093719683 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214093719683 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214093719683 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214093719683 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214093719683 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214093719683 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214093719696 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/gprs:nanobts+band-900+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214093719705 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214093719705 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214093719705 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:37:22.809717 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1857): Terminating (SIGTERM) 09:37:22.849739 run iperf3-srv_10.42.42.10(pid=1858): Terminating (SIGTERM) 09:37:22.889364 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1859): Terminating (SIGTERM) 09:37:22.929743 run iperf3-srv_10.42.42.10(pid=1860): Terminating (SIGTERM) 09:37:22.969764 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1861): Terminating (SIGTERM) 09:37:23.009833 run iperf3-srv_10.42.42.10(pid=1862): Terminating (SIGTERM) 09:37:23.049755 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1863): Terminating (SIGTERM) 09:37:23.089859 run iperf3-srv_10.42.42.10(pid=1864): Terminating (SIGTERM) 09:37:23.129880 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1867): Terminating (SIGTERM) 09:37:23.169753 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1870): Terminating (SIGTERM) 09:37:23.209913 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1873): Terminating (SIGTERM) 09:37:23.250287 --- ParallelTerminationStrategy: PID 1857 died... 09:37:23.269997 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1857): Terminated: ok {rc=0} 09:37:23.314422 --- ParallelTerminationStrategy: PID 1858 died... 09:37:23.333542 run iperf3-srv_10.42.42.10(pid=1858): Terminated {rc=256} 09:37:23.377748 --- ParallelTerminationStrategy: PID 1859 died... 09:37:23.396839 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1859): Terminated: ok {rc=0} 09:37:23.440865 --- ParallelTerminationStrategy: PID 1860 died... 09:37:23.460410 run iperf3-srv_10.42.42.10(pid=1860): Terminated {rc=256} 09:37:23.504446 --- ParallelTerminationStrategy: PID 1861 died... 09:37:23.523453 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1861): Terminated: ok {rc=0} 09:37:23.567686 --- ParallelTerminationStrategy: PID 1862 died... 09:37:23.586855 run iperf3-srv_10.42.42.10(pid=1862): Terminated {rc=256} 09:37:23.631171 --- ParallelTerminationStrategy: PID 1863 died... 09:37:23.650376 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1863): Terminated: ok {rc=0} 09:37:23.694398 --- ParallelTerminationStrategy: PID 1864 died... 09:37:23.713467 run iperf3-srv_10.42.42.10(pid=1864): Terminated {rc=256} 09:37:23.757465 --- ParallelTerminationStrategy: PID 1867 died... 09:37:23.776518 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1867): Terminated: ok {rc=0} 09:37:23.820473 --- ParallelTerminationStrategy: PID 1870 died... 09:37:23.839449 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1870): Terminated: ok {rc=0} 09:37:23.883336 --- ParallelTerminationStrategy: PID 1873 died... 09:37:23.902434 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1873): Terminated: ok {rc=0} 09:37:23.985685 bus /gobi_4: Setting Powered False 09:37:25.084365 bus /gobi_4: Setting Powered False 09:37:26.201046 bus /gobi_1: Setting Powered False 09:37:27.299375 bus /gobi_1: Setting Powered False 09:37:28.415568 bus /gobi_0: Setting Powered False 09:37:29.512854 bus /gobi_0: Setting Powered False 09:37:30.629483 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2402 gprs:nanobts+band-900+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 09:37:31.731198 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:37:31.744576 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 09:37:31.818116 tst ping.py: using LAC 40029 09:37:31.945522 tst ping.py: using RAC 249 09:37:32.100217 tst ping.py: using CellId 40029 09:37:32.220638 tst ping.py: using BVCI 40030 09:37:32.330168 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:37:32.341518 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:37:32.352261 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:37:32.363301 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:37:32.374609 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:37:32.385839 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:37:32.397130 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:37:32.408256 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:37:32.522242 tst ping.py:19: start network... 09:37:32.720599 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:37:33.181775 run create_hlr_db(pid=1875): Launched 09:37:33.295252 bus /gobi_6: Setting Powered False 09:37:34.354978 run create_hlr_db(pid=1875): Terminated: ok {rc=0} 09:37:34.769981 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1877): Launched 09:37:35.067293 run osmo-hlr_10.42.42.2(pid=1878): Launched 09:37:35.179330 run osmo-stp_10.42.42.5: Starting osmo-stp 09:37:35.730660 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1880): Launched 09:37:36.047039 run osmo-stp_10.42.42.5(pid=1881): Launched 09:37:36.166423 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:37:36.713890 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1883): Launched 09:37:36.834957 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:37:37.103541 run patchelf(pid=1884): Launched 09:37:37.282535 run osmo-stp_10.42.42.5(pid=1881): ERR: Terminated: ERROR {rc=1} [trial-2402↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1881)] 09:37:37.417996 run osmo-stp_10.42.42.5(pid=1881): stdout: | (launched: 2022-12-14_09:37:35.988114) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:37:37.553749 run osmo-stp_10.42.42.5(pid=1881): stderr: | 20221214093736177 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214093736177 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214093736178 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214093736178 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214093736179 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214093736179 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214093736179 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:37:37.689539 run osmo-stp_10.42.42.5(pid=1881): stdout: | (launched: 2022-12-14_09:37:35.988114) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:37:37.819660 run osmo-stp_10.42.42.5(pid=1881): stderr: | 20221214093736177 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214093736177 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214093736178 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214093736178 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214093736179 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214093736179 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214093736179 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:37:37.973928 run patchelf(pid=1884): Terminating (SIGINT) 09:37:38.151051 run patchelf(pid=1884): Terminated: ok {rc=0} 09:37:38.278985 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=1881): Process ended prematurely: osmo-stp_10.42.42.5(pid=1881) [trial-2402↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1881)] [trial-2402↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22] 09:37:38.288462 tst ping.py:22: Test FAILED (6.5 sec) 09:37:38.316447 run osmo-hlr_10.42.42.2(pid=1878): ERR: Terminated: ERROR {rc=237} [trial-2402↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1878)] 09:37:38.366234 run osmo-hlr_10.42.42.2(pid=1878): stdout: | (launched: 2022-12-14_09:37:35.011592) 09:37:38.418141 run osmo-hlr_10.42.42.2(pid=1878): stderr: | 20221214093735183 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214093735183 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214093735183 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214093735183 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214093735183 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214093735184 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214093735196 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/gprs:nanobts+band-900+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214093735204 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214093735204 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214093735204 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:37:38.470167 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1877): Terminating (SIGTERM) 09:37:38.511865 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1880): Terminating (SIGTERM) 09:37:38.554069 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1883): Terminating (SIGTERM) 09:37:38.595988 --- ParallelTerminationStrategy: PID 1877 died... 09:37:38.616413 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1877): Terminated: ok {rc=0} 09:37:38.662857 --- ParallelTerminationStrategy: PID 1880 died... 09:37:38.682578 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1880): Terminated: ok {rc=0} 09:37:38.728715 --- ParallelTerminationStrategy: PID 1883 died... 09:37:38.748584 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1883): Terminated: ok {rc=0} 09:37:38.835432 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2402 gprs:nanobts+band-900+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 09:37:39.922909 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:37:39.935258 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 09:37:40.006019 tst ping_idle_ping.py: using LAC 40030 09:37:40.135828 tst ping_idle_ping.py: using RAC 250 09:37:40.261584 tst ping_idle_ping.py: using CellId 40030 09:37:40.379347 tst ping_idle_ping.py: using BVCI 40031 09:37:40.487552 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:37:40.498778 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:37:40.509886 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:37:40.520863 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:37:40.532305 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:37:40.543418 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:37:40.554615 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:37:40.565853 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:37:40.685181 tst ping_idle_ping.py:24: start network... 09:37:40.899232 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:37:41.397261 run create_hlr_db(pid=1885): Launched 09:37:41.526752 bus /gobi_6: Setting Powered False 09:37:42.590071 run create_hlr_db(pid=1885): Terminated: ok {rc=0} 09:37:43.034996 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1887): Launched 09:37:43.354023 run osmo-hlr_10.42.42.2(pid=1888): Launched 09:37:43.474314 run osmo-stp_10.42.42.5: Starting osmo-stp 09:37:44.024706 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1890): Launched 09:37:44.342722 run osmo-stp_10.42.42.5(pid=1891): Launched 09:37:44.463360 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:37:45.013780 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1893): Launched 09:37:45.135927 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:37:45.407061 run patchelf(pid=1894): Launched 09:37:45.584069 run osmo-stp_10.42.42.5(pid=1891): ERR: Terminated: ERROR {rc=1} [trial-2402↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1891)] 09:37:45.719052 run osmo-stp_10.42.42.5(pid=1891): stdout: | (launched: 2022-12-14_09:37:44.283666) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:37:45.871873 run osmo-stp_10.42.42.5(pid=1891): stderr: | 20221214093744470 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214093744470 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214093744470 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214093744470 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214093744471 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214093744471 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214093744471 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:37:46.022320 run osmo-stp_10.42.42.5(pid=1891): stdout: | (launched: 2022-12-14_09:37:44.283666) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:37:46.150417 run osmo-stp_10.42.42.5(pid=1891): stderr: | 20221214093744470 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214093744470 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214093744470 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214093744470 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214093744471 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214093744471 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214093744471 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:37:46.299889 run patchelf(pid=1894): Terminating (SIGINT) 09:37:46.472853 run patchelf(pid=1894): Terminated: ok {rc=0} 09:37:46.599159 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=1891): Process ended prematurely: osmo-stp_10.42.42.5(pid=1891) [trial-2402↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1891)] [trial-2402↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 09:37:46.609434 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 09:37:46.646251 run osmo-hlr_10.42.42.2(pid=1888): ERR: Terminated: ERROR {rc=237} [trial-2402↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1888)] 09:37:46.714254 run osmo-hlr_10.42.42.2(pid=1888): stdout: | (launched: 2022-12-14_09:37:43.294867) 09:37:46.781784 run osmo-hlr_10.42.42.2(pid=1888): stderr: | 20221214093743488 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214093743488 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214093743488 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214093743488 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214093743488 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214093743488 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214093743500 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/gprs:nanobts+band-900+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214093743508 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214093743509 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214093743509 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:37:46.850544 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1887): Terminating (SIGTERM) 09:37:46.894151 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1890): Terminating (SIGTERM) 09:37:46.939609 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1893): Terminating (SIGTERM) 09:37:46.984857 --- ParallelTerminationStrategy: PID 1887 died... 09:37:47.006418 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1887): Terminated: ok {rc=0} 09:37:47.055102 --- ParallelTerminationStrategy: PID 1890 died... 09:37:47.076172 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1890): Terminated: ok {rc=0} 09:37:47.123975 --- ParallelTerminationStrategy: PID 1893 died... 09:37:47.144982 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1893): Terminated: ok {rc=0} 09:37:47.234688 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2402 gprs:nanobts+band-900+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 09:37:48.540688 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:37:48.547760 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 09:37:48.579297 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 9 x ip_address (candidates: 9) 09:37:48.617780 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 4 x modem (candidates: 12) 09:37:48.703104 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 09:37:48.734614 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 9 x ip_address (candidates: 9) 09:37:48.772262 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 4 x modem (candidates: 12) 09:37:49.373157 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2402 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend cs_paging_gprs_active.py ---------------------------------------------- 09:37:49.421238 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:37:49.432338 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 09:37:49.480847 tst cs_paging_gprs_active.py: using LAC 40031 09:37:49.597981 tst cs_paging_gprs_active.py: using RAC 251 09:37:49.717992 tst cs_paging_gprs_active.py: using CellId 40031 09:37:49.835087 tst cs_paging_gprs_active.py: using BVCI 40032 09:37:49.943160 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:37:49.954607 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:37:49.965816 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:37:49.976825 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:37:49.988195 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:37:49.999657 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:37:50.011276 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:37:50.022813 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:37:50.034584 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 09:37:50.154405 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 09:37:50.270491 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 09:37:50.471459 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:37:50.772108 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1898): Launched 09:37:51.033691 run iperf3-srv_10.42.42.10(pid=1899): Launched 09:37:51.145914 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 09:37:51.345465 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:37:51.645411 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1900): Launched 09:37:51.932118 run iperf3-srv_10.42.42.10(pid=1901): Launched 09:37:52.044664 tst cs_paging_gprs_active.py:38: start network... 09:37:52.244717 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:37:52.711299 run create_hlr_db(pid=1902): Launched 09:37:52.826128 bus /gobi_6: Setting Powered False 09:37:53.885494 run create_hlr_db(pid=1902): Terminated: ok {rc=0} 09:37:54.324018 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1904): Launched 09:37:54.643114 run osmo-hlr_10.42.42.2(pid=1905): Launched 09:37:54.765684 run osmo-stp_10.42.42.5: Starting osmo-stp 09:37:55.315206 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1907): Launched 09:37:55.635588 run osmo-stp_10.42.42.5(pid=1908): Launched 09:37:55.757186 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:37:56.307755 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1910): Launched 09:37:56.429447 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:37:56.699553 run patchelf(pid=1911): Launched 09:37:56.875829 run osmo-stp_10.42.42.5(pid=1908): ERR: Terminated: ERROR {rc=1} [trial-2402↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1908)] 09:37:57.010860 run osmo-stp_10.42.42.5(pid=1908): stdout: | (launched: 2022-12-14_09:37:55.576548) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:37:57.146937 run osmo-stp_10.42.42.5(pid=1908): stderr: | 20221214093755764 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214093755764 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214093755764 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214093755765 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214093755765 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214093755765 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214093755766 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:37:57.283806 run osmo-stp_10.42.42.5(pid=1908): stdout: | (launched: 2022-12-14_09:37:55.576548) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:37:57.414567 run osmo-stp_10.42.42.5(pid=1908): stderr: | 20221214093755764 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214093755764 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214093755764 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214093755765 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214093755765 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214093755765 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214093755766 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:37:57.569432 run patchelf(pid=1911): Terminating (SIGINT) 09:37:57.747201 run patchelf(pid=1911): Terminated: ok {rc=0} 09:37:57.875808 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=1908): Process ended prematurely: osmo-stp_10.42.42.5(pid=1908) [trial-2402↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1908)] [trial-2402↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38] 09:37:57.885981 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 09:37:57.913852 run osmo-hlr_10.42.42.2(pid=1905): ERR: Terminated: ERROR {rc=237} [trial-2402↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1905)] 09:37:57.963542 run osmo-hlr_10.42.42.2(pid=1905): stdout: | (launched: 2022-12-14_09:37:54.584397) 09:37:58.014898 run osmo-hlr_10.42.42.2(pid=1905): stderr: | 20221214093754777 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214093754777 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214093754777 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214093754777 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214093754777 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214093754777 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214093754789 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214093754798 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214093754798 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214093754798 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:37:58.066988 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1898): Terminating (SIGTERM) 09:37:58.108246 run iperf3-srv_10.42.42.10(pid=1899): Terminating (SIGTERM) 09:37:58.149650 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1900): Terminating (SIGTERM) 09:37:58.191220 run iperf3-srv_10.42.42.10(pid=1901): Terminating (SIGTERM) 09:37:58.232388 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1904): Terminating (SIGTERM) 09:37:58.274111 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1907): Terminating (SIGTERM) 09:37:58.315343 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1910): Terminating (SIGTERM) 09:37:58.356516 --- ParallelTerminationStrategy: PID 1898 died... 09:37:58.376219 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1898): Terminated: ok {rc=0} 09:37:58.421810 --- ParallelTerminationStrategy: PID 1899 died... 09:37:58.440937 run iperf3-srv_10.42.42.10(pid=1899): Terminated {rc=256} 09:37:58.486278 --- ParallelTerminationStrategy: PID 1900 died... 09:37:58.505536 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1900): Terminated: ok {rc=0} 09:37:58.551371 --- ParallelTerminationStrategy: PID 1901 died... 09:37:58.570533 run iperf3-srv_10.42.42.10(pid=1901): Terminated {rc=256} 09:37:58.615686 --- ParallelTerminationStrategy: PID 1904 died... 09:37:58.634941 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1904): Terminated: ok {rc=0} 09:37:58.680295 --- ParallelTerminationStrategy: PID 1907 died... 09:37:58.699487 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1907): Terminated: ok {rc=0} 09:37:58.744659 --- ParallelTerminationStrategy: PID 1910 died... 09:37:58.764090 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1910): Terminated: ok {rc=0} 09:37:58.850765 bus /gobi_0: Setting Powered False 09:37:59.949414 bus /gobi_0: Setting Powered False 09:38:01.075931 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2402 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3.py ---------------------------------------------- 09:38:02.234224 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:38:02.248649 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 09:38:02.300673 tst iperf3.py: using LAC 40032 09:38:02.419171 tst iperf3.py: using RAC 252 09:38:02.542520 tst iperf3.py: using CellId 40032 09:38:02.660607 tst iperf3.py: using BVCI 40033 09:38:02.769757 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:38:02.781362 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:38:02.792588 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:38:02.803898 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:38:02.815419 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:38:02.827055 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:38:02.838748 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:38:02.850086 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:38:02.861639 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 09:38:02.979313 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 09:38:03.178595 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:38:03.478207 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1912): Launched 09:38:03.737579 run iperf3-srv_10.42.42.10(pid=1913): Launched 09:38:03.849860 tst iperf3.py:8: start network... 09:38:04.049312 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:38:04.513165 run create_hlr_db(pid=1914): Launched 09:38:04.628259 bus /gobi_6: Setting Powered False 09:38:05.688129 run create_hlr_db(pid=1914): Terminated: ok {rc=0} 09:38:06.123107 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1916): Launched 09:38:06.442609 run osmo-hlr_10.42.42.2(pid=1917): Launched 09:38:06.564247 run osmo-stp_10.42.42.5: Starting osmo-stp 09:38:07.117783 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1919): Launched 09:38:07.436471 run osmo-stp_10.42.42.5(pid=1920): Launched 09:38:07.557281 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:38:08.107400 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1922): Launched 09:38:08.229623 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:38:08.500264 run patchelf(pid=1923): Launched 09:38:08.677441 run osmo-stp_10.42.42.5(pid=1920): ERR: Terminated: ERROR {rc=1} [trial-2402↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1920)] 09:38:08.812405 run osmo-stp_10.42.42.5(pid=1920): stdout: | (launched: 2022-12-14_09:38:07.377506) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:38:08.949179 run osmo-stp_10.42.42.5(pid=1920): stderr: | 20221214093807566 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214093807566 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214093807567 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214093807567 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214093807567 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214093807567 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214093807568 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:38:09.086407 run osmo-stp_10.42.42.5(pid=1920): stdout: | (launched: 2022-12-14_09:38:07.377506) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:38:09.217779 run osmo-stp_10.42.42.5(pid=1920): stderr: | 20221214093807566 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214093807566 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214093807567 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214093807567 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214093807567 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214093807567 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214093807568 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:38:09.373771 run patchelf(pid=1923): Terminating (SIGINT) 09:38:09.551467 run patchelf(pid=1923): Terminated: ok {rc=0} 09:38:09.679563 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1920): Process ended prematurely: osmo-stp_10.42.42.5(pid=1920) [trial-2402↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1920)] [trial-2402↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8] 09:38:09.689934 tst iperf3.py:8: Test FAILED (7.5 sec) 09:38:09.718210 run osmo-hlr_10.42.42.2(pid=1917): ERR: Terminated: ERROR {rc=237} [trial-2402↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1917)] 09:38:09.768338 run osmo-hlr_10.42.42.2(pid=1917): stdout: | (launched: 2022-12-14_09:38:06.383787) 09:38:09.820361 run osmo-hlr_10.42.42.2(pid=1917): stderr: | 20221214093806578 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214093806578 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214093806578 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214093806578 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214093806578 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214093806579 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214093806594 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214093806603 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214093806603 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214093806603 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:38:09.872760 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1912): Terminating (SIGTERM) 09:38:09.915224 run iperf3-srv_10.42.42.10(pid=1913): Terminating (SIGTERM) 09:38:09.957659 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1916): Terminating (SIGTERM) 09:38:09.999668 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1919): Terminating (SIGTERM) 09:38:10.041913 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1922): Terminating (SIGTERM) 09:38:10.083845 --- ParallelTerminationStrategy: PID 1912 died... 09:38:10.103844 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1912): Terminated: ok {rc=0} 09:38:10.149949 --- ParallelTerminationStrategy: PID 1913 died... 09:38:10.169468 run iperf3-srv_10.42.42.10(pid=1913): Terminated {rc=256} 09:38:10.215384 --- ParallelTerminationStrategy: PID 1916 died... 09:38:10.234815 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1916): Terminated: ok {rc=0} 09:38:10.280771 --- ParallelTerminationStrategy: PID 1919 died... 09:38:10.300435 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1919): Terminated: ok {rc=0} 09:38:10.346390 --- ParallelTerminationStrategy: PID 1922 died... 09:38:10.365920 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1922): Terminated: ok {rc=0} 09:38:10.452551 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2402 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3m4.py ---------------------------------------------- 09:38:11.602681 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:38:11.615584 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 09:38:11.666861 tst iperf3m4.py: using LAC 40033 09:38:11.793742 tst iperf3m4.py: using RAC 253 09:38:11.918588 tst iperf3m4.py: using CellId 40033 09:38:12.047841 tst iperf3m4.py: using BVCI 40034 09:38:12.165687 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:38:12.177641 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:38:12.189438 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:38:12.201571 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:38:12.213300 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:38:12.224805 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:38:12.237340 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:38:12.249281 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:38:12.261455 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 09:38:12.380586 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 09:38:12.499817 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 09:38:12.618267 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 09:38:12.736640 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 09:38:12.953031 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:38:13.276797 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1924): Launched 09:38:13.554361 run iperf3-srv_10.42.42.10(pid=1925): Launched 09:38:13.673836 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 09:38:13.888717 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:38:14.210398 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1926): Launched 09:38:14.488379 run iperf3-srv_10.42.42.10(pid=1927): Launched 09:38:14.608251 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 09:38:14.822553 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:38:15.143525 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1928): Launched 09:38:15.422610 run iperf3-srv_10.42.42.10(pid=1931): Launched 09:38:15.542306 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 09:38:15.756566 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:38:16.140219 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1932): Launched 09:38:16.442157 run iperf3-srv_10.42.42.10(pid=1933): Launched 09:38:16.572145 tst iperf3m4.py:8: start network... 09:38:16.790408 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:38:17.292901 run create_hlr_db(pid=1934): Launched 09:38:17.423210 bus /gobi_6: Setting Powered False 09:38:18.486103 run create_hlr_db(pid=1934): Terminated: ok {rc=0} 09:38:18.929781 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1936): Launched 09:38:19.249651 run osmo-hlr_10.42.42.2(pid=1937): Launched 09:38:19.370756 run osmo-stp_10.42.42.5: Starting osmo-stp 09:38:19.921437 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1939): Launched 09:38:20.242827 run osmo-stp_10.42.42.5(pid=1940): Launched 09:38:20.364819 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:38:20.918350 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1942): Launched 09:38:21.039896 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:38:21.312764 run patchelf(pid=1943): Launched 09:38:21.490097 run osmo-stp_10.42.42.5(pid=1940): ERR: Terminated: ERROR {rc=1} [trial-2402↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1940)] 09:38:21.625180 run osmo-stp_10.42.42.5(pid=1940): stdout: | (launched: 2022-12-14_09:38:20.182640) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:38:21.761295 run osmo-stp_10.42.42.5(pid=1940): stderr: | 20221214093820373 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214093820373 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214093820373 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214093820374 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214093820374 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214093820374 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214093820374 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:38:21.897923 run osmo-stp_10.42.42.5(pid=1940): stdout: | (launched: 2022-12-14_09:38:20.182640) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:38:22.028762 run osmo-stp_10.42.42.5(pid=1940): stderr: | 20221214093820373 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214093820373 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214093820373 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214093820374 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214093820374 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214093820374 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214093820374 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:38:22.183762 run patchelf(pid=1943): Terminating (SIGINT) 09:38:22.362826 run patchelf(pid=1943): Terminated: ok {rc=0} 09:38:22.491083 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1940): Process ended prematurely: osmo-stp_10.42.42.5(pid=1940) [trial-2402↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1940)] [trial-2402↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8] 09:38:22.501279 tst iperf3m4.py:8: Test FAILED (10.9 sec) 09:38:22.529880 run osmo-hlr_10.42.42.2(pid=1937): ERR: Terminated: ERROR {rc=237} [trial-2402↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1937)] 09:38:22.579840 run osmo-hlr_10.42.42.2(pid=1937): stdout: | (launched: 2022-12-14_09:38:19.189775) 09:38:22.631249 run osmo-hlr_10.42.42.2(pid=1937): stderr: | 20221214093819386 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214093819386 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214093819386 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214093819386 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214093819386 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214093819386 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214093819398 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214093819406 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214093819406 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214093819406 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:38:22.683040 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1924): Terminating (SIGTERM) 09:38:22.724711 run iperf3-srv_10.42.42.10(pid=1925): Terminating (SIGTERM) 09:38:22.766282 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1926): Terminating (SIGTERM) 09:38:22.807916 run iperf3-srv_10.42.42.10(pid=1927): Terminating (SIGTERM) 09:38:22.849461 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1928): Terminating (SIGTERM) 09:38:22.891324 run iperf3-srv_10.42.42.10(pid=1931): Terminating (SIGTERM) 09:38:22.932769 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1932): Terminating (SIGTERM) 09:38:22.974667 run iperf3-srv_10.42.42.10(pid=1933): Terminating (SIGTERM) 09:38:23.016205 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1936): Terminating (SIGTERM) 09:38:23.057950 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1939): Terminating (SIGTERM) 09:38:23.099897 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1942): Terminating (SIGTERM) 09:38:23.142240 --- ParallelTerminationStrategy: PID 1924 died... 09:38:23.162139 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1924): Terminated: ok {rc=0} 09:38:23.208344 --- ParallelTerminationStrategy: PID 1925 died... 09:38:23.227958 run iperf3-srv_10.42.42.10(pid=1925): Terminated {rc=256} 09:38:23.273943 --- ParallelTerminationStrategy: PID 1926 died... 09:38:23.293619 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1926): Terminated: ok {rc=0} 09:38:23.339547 --- ParallelTerminationStrategy: PID 1927 died... 09:38:23.359223 run iperf3-srv_10.42.42.10(pid=1927): Terminated {rc=256} 09:38:23.405211 --- ParallelTerminationStrategy: PID 1928 died... 09:38:23.424643 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1928): Terminated: ok {rc=0} 09:38:23.470832 --- ParallelTerminationStrategy: PID 1931 died... 09:38:23.490372 run iperf3-srv_10.42.42.10(pid=1931): Terminated {rc=256} 09:38:23.536133 --- ParallelTerminationStrategy: PID 1932 died... 09:38:23.555728 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1932): Terminated: ok {rc=0} 09:38:23.601815 --- ParallelTerminationStrategy: PID 1933 died... 09:38:23.621413 run iperf3-srv_10.42.42.10(pid=1933): Terminated {rc=256} 09:38:23.667234 --- ParallelTerminationStrategy: PID 1936 died... 09:38:23.686921 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1936): Terminated: ok {rc=0} 09:38:23.732681 --- ParallelTerminationStrategy: PID 1939 died... 09:38:23.752442 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1939): Terminated: ok {rc=0} 09:38:23.798286 --- ParallelTerminationStrategy: PID 1942 died... 09:38:23.817917 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1942): Terminated: ok {rc=0} 09:38:23.905799 bus /gobi_4: Setting Powered False 09:38:25.004274 bus /gobi_4: Setting Powered False 09:38:26.119064 bus /gobi_1: Setting Powered False 09:38:27.217716 bus /gobi_1: Setting Powered False 09:38:28.332728 bus /gobi_0: Setting Powered False 09:38:29.429637 bus /gobi_0: Setting Powered False 09:38:30.544683 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2402 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping.py ---------------------------------------------- 09:38:31.643664 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:38:31.656443 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 09:38:31.711075 tst ping.py: using LAC 40034 09:38:31.834408 tst ping.py: using RAC 254 09:38:31.987897 tst ping.py: using CellId 40034 09:38:32.158403 tst ping.py: using BVCI 40035 09:38:32.276178 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:38:32.288425 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:38:32.300396 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:38:32.312368 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:38:32.324341 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:38:32.336297 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:38:32.348479 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:38:32.360294 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 09:38:32.476102 tst ping.py:19: start network... 09:38:32.672301 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:38:33.128262 run create_hlr_db(pid=1944): Launched 09:38:33.240805 bus /gobi_6: Setting Powered False 09:38:34.299504 run create_hlr_db(pid=1944): Terminated: ok {rc=0} 09:38:34.730216 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1946): Launched 09:38:35.044157 run osmo-hlr_10.42.42.2(pid=1947): Launched 09:38:35.163047 run osmo-stp_10.42.42.5: Starting osmo-stp 09:38:35.706668 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1949): Launched 09:38:36.022347 run osmo-stp_10.42.42.5(pid=1950): Launched 09:38:36.140449 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:38:36.682703 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1952): Launched 09:38:36.804543 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:38:37.071188 run patchelf(pid=1953): Launched 09:38:37.248639 run osmo-stp_10.42.42.5(pid=1950): ERR: Terminated: ERROR {rc=1} [trial-2402↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1950)] 09:38:37.381839 run osmo-stp_10.42.42.5(pid=1950): stdout: | (launched: 2022-12-14_09:38:35.963697) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:38:37.516219 run osmo-stp_10.42.42.5(pid=1950): stderr: | 20221214093836153 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214093836153 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214093836154 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214093836154 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214093836154 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214093836155 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214093836155 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:38:37.651258 run osmo-stp_10.42.42.5(pid=1950): stdout: | (launched: 2022-12-14_09:38:35.963697) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:38:37.780226 run osmo-stp_10.42.42.5(pid=1950): stderr: | 20221214093836153 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214093836153 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214093836154 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214093836154 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214093836154 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214093836155 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214093836155 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:38:37.933158 run patchelf(pid=1953): Terminating (SIGINT) 09:38:38.108551 run patchelf(pid=1953): Terminated: ok {rc=0} 09:38:38.235565 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=1950): Process ended prematurely: osmo-stp_10.42.42.5(pid=1950) [trial-2402↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1950)] [trial-2402↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22] 09:38:38.245252 tst ping.py:22: Test FAILED (6.6 sec) 09:38:38.273296 run osmo-hlr_10.42.42.2(pid=1947): ERR: Terminated: ERROR {rc=237} [trial-2402↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1947)] 09:38:38.323511 run osmo-hlr_10.42.42.2(pid=1947): stdout: | (launched: 2022-12-14_09:38:34.985730) 09:38:38.375402 run osmo-hlr_10.42.42.2(pid=1947): stderr: | 20221214093835180 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214093835180 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214093835180 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214093835180 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214093835180 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214093835180 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214093835192 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214093835200 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214093835201 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214093835201 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:38:38.427762 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1946): Terminating (SIGTERM) 09:38:38.469618 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1949): Terminating (SIGTERM) 09:38:38.511564 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1952): Terminating (SIGTERM) 09:38:38.553500 --- ParallelTerminationStrategy: PID 1946 died... 09:38:38.573691 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1946): Terminated: ok {rc=0} 09:38:38.619972 --- ParallelTerminationStrategy: PID 1949 died... 09:38:38.639631 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1949): Terminated: ok {rc=0} 09:38:38.685590 --- ParallelTerminationStrategy: PID 1952 died... 09:38:38.705151 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1952): Terminated: ok {rc=0} 09:38:38.792568 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2402 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping_idle_ping.py ---------------------------------------------- 09:38:39.879778 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:38:39.892417 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 09:38:39.944098 tst ping_idle_ping.py: using LAC 40035 09:38:40.069975 tst ping_idle_ping.py: using RAC 255 09:38:40.194797 tst ping_idle_ping.py: using CellId 40035 09:38:40.318733 tst ping_idle_ping.py: using BVCI 40036 09:38:40.435116 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:38:40.447243 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:38:40.458963 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:38:40.470760 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:38:40.482937 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:38:40.495100 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:38:40.507452 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:38:40.519859 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 09:38:40.636501 tst ping_idle_ping.py:24: start network... 09:38:40.834128 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:38:41.295637 run create_hlr_db(pid=1954): Launched 09:38:41.408940 bus /gobi_6: Setting Powered False 09:38:42.468756 run create_hlr_db(pid=1954): Terminated: ok {rc=0} 09:38:42.883358 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1956): Launched 09:38:43.181624 run osmo-hlr_10.42.42.2(pid=1957): Launched 09:38:43.294513 run osmo-stp_10.42.42.5: Starting osmo-stp 09:38:43.813685 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1959): Launched 09:38:44.109365 run osmo-stp_10.42.42.5(pid=1960): Launched 09:38:44.222176 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:38:44.733639 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1962): Launched 09:38:44.846255 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:38:45.096096 run patchelf(pid=1963): Launched 09:38:45.260560 run osmo-stp_10.42.42.5(pid=1960): ERR: Terminated: ERROR {rc=1} [trial-2402↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1960)] 09:38:45.386025 run osmo-stp_10.42.42.5(pid=1960): stdout: | (launched: 2022-12-14_09:38:44.054055) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:38:45.512482 run osmo-stp_10.42.42.5(pid=1960): stderr: | 20221214093844221 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214093844221 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214093844221 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214093844222 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214093844222 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214093844222 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214093844222 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:38:45.638799 run osmo-stp_10.42.42.5(pid=1960): stdout: | (launched: 2022-12-14_09:38:44.054055) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:38:45.760387 run osmo-stp_10.42.42.5(pid=1960): stderr: | 20221214093844221 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214093844221 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214093844221 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214093844222 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214093844222 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214093844222 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214093844222 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:38:45.912186 run patchelf(pid=1963): Terminating (SIGINT) 09:38:46.082641 run patchelf(pid=1963): Terminated: ok {rc=0} 09:38:46.206150 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=1960): Process ended prematurely: osmo-stp_10.42.42.5(pid=1960) [trial-2402↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1960)] [trial-2402↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27] 09:38:46.216170 tst ping_idle_ping.py:27: Test FAILED (6.3 sec) 09:38:46.244323 run osmo-hlr_10.42.42.2(pid=1957): ERR: Terminated: ERROR {rc=237} [trial-2402↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1957)] 09:38:46.296893 run osmo-hlr_10.42.42.2(pid=1957): stdout: | (launched: 2022-12-14_09:38:43.125730) 09:38:46.347977 run osmo-hlr_10.42.42.2(pid=1957): stderr: | 20221214093843299 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214093843299 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214093843299 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214093843299 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214093843299 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214093843300 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214093843311 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214093843320 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214093843321 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214093843321 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:38:46.400361 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1956): Terminating (SIGTERM) 09:38:46.442962 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1959): Terminating (SIGTERM) 09:38:46.485022 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1962): Terminating (SIGTERM) 09:38:46.527544 --- ParallelTerminationStrategy: PID 1956 died... 09:38:46.548571 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1956): Terminated: ok {rc=0} 09:38:46.595455 --- ParallelTerminationStrategy: PID 1959 died... 09:38:46.616424 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1959): Terminated: ok {rc=0} 09:38:46.662935 --- ParallelTerminationStrategy: PID 1962 died... 09:38:46.683721 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1962): Terminated: ok {rc=0} 09:38:46.775957 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2402 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any --------------------------------------------------------------------- 09:38:48.097617 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:38:48.104913 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 09:38:48.136702 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 09:38:48.172035 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 09:38:48.225845 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 09:38:48.258694 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 09:38:48.293663 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 09:38:48.850892 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2402 dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 09:38:48.856206 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 09:38:48.867866 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 09:38:48.933956 tst switch_tch_pdch.py: using LAC 40036 09:38:49.061716 tst switch_tch_pdch.py: using RAC 1 09:38:49.180034 tst switch_tch_pdch.py: using CellId 40036 09:38:49.296540 tst switch_tch_pdch.py: using BVCI 40037 09:38:49.403908 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 09:38:49.415530 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 09:38:49.426936 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 09:38:49.438448 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 09:38:49.450193 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 09:38:49.461918 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 09:38:49.473870 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 09:38:49.485804 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 09:38:49.599492 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 09:38:49.717784 tst switch_tch_pdch.py:51: start network... 09:38:49.928270 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:38:50.415791 run create_hlr_db(pid=1968): Launched 09:38:50.544649 bus /gobi_6: Setting Powered False 09:38:51.607975 run create_hlr_db(pid=1968): Terminated: ok {rc=0} 09:38:52.028456 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1970): Launched 09:38:52.323282 run osmo-hlr_10.42.42.2(pid=1971): Launched 09:38:52.435779 run osmo-stp_10.42.42.5: Starting osmo-stp 09:38:52.958180 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1973): Launched 09:38:53.252805 run osmo-stp_10.42.42.5(pid=1974): Launched 09:38:53.366056 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:38:53.875723 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1976): Launched 09:38:53.988031 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:38:54.238095 run patchelf(pid=1977): Launched 09:38:54.403847 run osmo-stp_10.42.42.5(pid=1974): ERR: Terminated: ERROR {rc=1} [trial-2402↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1974)] 09:38:54.529516 run osmo-stp_10.42.42.5(pid=1974): stdout: | (launched: 2022-12-14_09:38:53.197982) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:38:54.656003 run osmo-stp_10.42.42.5(pid=1974): stderr: | 20221214093853364 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214093853365 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214093853365 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214093853365 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214093853366 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214093853366 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214093853366 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:38:54.782629 run osmo-stp_10.42.42.5(pid=1974): stdout: | (launched: 2022-12-14_09:38:53.197982) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:38:54.903984 run osmo-stp_10.42.42.5(pid=1974): stderr: | 20221214093853364 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214093853365 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214093853365 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214093853365 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214093853366 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214093853366 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214093853366 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:38:55.047487 run patchelf(pid=1977): Terminating (SIGINT) 09:38:55.212662 run patchelf(pid=1977): Terminated: ok {rc=0} 09:38:55.331627 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=1974): Process ended prematurely: osmo-stp_10.42.42.5(pid=1974) [trial-2402↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1974)] [trial-2402↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54] 09:38:55.340871 tst switch_tch_pdch.py:54: Test FAILED (6.5 sec) 09:38:55.367360 run osmo-hlr_10.42.42.2(pid=1971): ERR: Terminated: ERROR {rc=237} [trial-2402↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1971)] 09:38:55.416145 run osmo-hlr_10.42.42.2(pid=1971): stdout: | (launched: 2022-12-14_09:38:52.268746) 09:38:55.465481 run osmo-hlr_10.42.42.2(pid=1971): stderr: | 20221214093852438 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214093852438 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214093852438 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214093852438 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214093852438 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214093852438 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214093852451 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214093852459 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214093852459 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214093852459 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:38:55.515497 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1970): Terminating (SIGTERM) 09:38:55.555388 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1973): Terminating (SIGTERM) 09:38:55.595159 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1976): Terminating (SIGTERM) 09:38:55.635018 --- ParallelTerminationStrategy: PID 1970 died... 09:38:55.654200 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1970): Terminated: ok {rc=0} 09:38:55.698434 --- ParallelTerminationStrategy: PID 1973 died... 09:38:55.717189 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1973): Terminated: ok {rc=0} 09:38:55.760608 --- ParallelTerminationStrategy: PID 1976 died... 09:38:55.779408 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1976): Terminated: ok {rc=0} 09:38:55.864725 bus /gobi_0: Setting Powered False 09:38:56.964426 bus /gobi_0: Setting Powered False 09:38:58.078998 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2402 dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 nitb_smpp --------------------------------------------------------------------- 09:38:59.332065 tst nitb_smpp: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:38:59.335052 tst nitb_smpp: Verifying 1 x bts (candidates: 11) 09:38:59.356306 tst nitb_smpp: Verifying 1 x ip_address (candidates: 9) 09:38:59.363472 tst nitb_smpp: Verifying 1 x modem (candidates: 12) 09:38:59.398363 tst nitb_smpp: Reserving 1 x bts (candidates: 11) 09:38:59.419778 tst nitb_smpp: Reserving 1 x ip_address (candidates: 9) 09:38:59.426932 tst nitb_smpp: Reserving 1 x modem (candidates: 12) 09:38:59.946853 tst nitb_smpp: RESERVED RESOURCES for nitb_smpp: bts sysmoBTS 1002 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2402 nitb_smpp esme_connect_policy_acceptall.py ---------------------------------------------- 09:38:59.952795 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 09:38:59.971456 tst esme_connect_policy_acceptall.py: using MSISDN 8613 09:39:00.106314 run osmo-nitb_10.42.42.2: Starting osmo-nitb 09:39:00.668669 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=1981): Launched 09:39:01.013711 run osmo-nitb_10.42.42.2(pid=1982): Launched 09:39:01.201294 run osmo-nitb_10.42.42.2(pid=1982): ERR: Terminated: ERROR {rc=2} [trial-2402↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=1982)] 09:39:01.339847 run osmo-nitb_10.42.42.2(pid=1982): stdout: | (launched: 2022-12-14_09:39:00.948646) 09:39:01.479975 run osmo-nitb_10.42.42.2(pid=1982): stderr: | (launched: 2022-12-14_09:39:00.997406) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 09:39:01.625933 run osmo-nitb_10.42.42.2(pid=1982): stdout: | (launched: 2022-12-14_09:39:00.948646) 09:39:01.779994 run osmo-nitb_10.42.42.2(pid=1982): stderr: | (launched: 2022-12-14_09:39:00.997406) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fe4ae4b0268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=1982): Process ended prematurely: osmo-nitb_10.42.42.2(pid=1982) [trial-2402↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=1982)] 09:39:02.147631 tst osmo-nitb_10.42.42.2(pid=1982): stdout: | (launched: 2022-12-14_09:39:00.948646) 09:39:02.325382 tst osmo-nitb_10.42.42.2(pid=1982): stderr: | (launched: 2022-12-14_09:39:00.997406) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 09:39:02.491410 tst esme_connect_policy_acceptall.py:18: ERR: Error: osmo-nitb_10.42.42.2(pid=1982): Process ended prematurely: osmo-nitb_10.42.42.2(pid=1982) [trial-2402↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=1982)] [trial-2402↪nitb_smpp↪esme_connect_policy_acceptall.py:18] 09:39:02.503746 tst esme_connect_policy_acceptall.py:18: Test FAILED (2.5 sec) 09:39:02.514866 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=1981): Terminating (SIGTERM) 09:39:02.729373 --- ParallelTerminationStrategy: PID 1981 died... 09:39:02.758789 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=1981): Terminated: ok {rc=0} ---------------------------------------------- trial-2402 nitb_smpp esme_connect_policy_closed.py ---------------------------------------------- 09:39:02.829913 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 09:39:02.857399 tst esme_connect_policy_closed.py: using MSISDN 8614 09:39:03.036231 tst esme_connect_policy_closed.py: using MSISDN 8615 09:39:03.178528 run osmo-nitb_10.42.42.2: Starting osmo-nitb 09:39:03.885287 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=2232): Launched 09:39:04.251794 run osmo-nitb_10.42.42.2(pid=2253): Launched 09:39:04.438951 run osmo-nitb_10.42.42.2(pid=2253): ERR: Terminated: ERROR {rc=2} [trial-2402↪nitb_smpp↪esme_connect_policy_closed.py:24↪esme_connect_policy_closed.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=2253)] 09:39:04.566856 run osmo-nitb_10.42.42.2(pid=2253): stdout: | (launched: 2022-12-14_09:39:04.195126) 09:39:04.696295 run osmo-nitb_10.42.42.2(pid=2253): stderr: | (launched: 2022-12-14_09:39:04.240515) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 09:39:04.825927 run osmo-nitb_10.42.42.2(pid=2253): stdout: | (launched: 2022-12-14_09:39:04.195126) 09:39:04.950172 run osmo-nitb_10.42.42.2(pid=2253): stderr: | (launched: 2022-12-14_09:39:04.240515) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 09:39:05.098255 tst esme_connect_policy_closed.py:24: ERR: Error: osmo-nitb_10.42.42.2(pid=2253): Process ended prematurely: osmo-nitb_10.42.42.2(pid=2253) [trial-2402↪nitb_smpp↪esme_connect_policy_closed.py:24↪esme_connect_policy_closed.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=2253)] [trial-2402↪nitb_smpp↪esme_connect_policy_closed.py:24] 09:39:05.107644 tst esme_connect_policy_closed.py:24: Test FAILED (2.3 sec) 09:39:05.115166 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=2232): Terminating (SIGTERM) 09:39:05.327833 --- ParallelTerminationStrategy: PID 2232 died... 09:39:05.349645 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=2232): Terminated: ok {rc=0} ---------------------------------------------- trial-2402 nitb_smpp esme_ms_sms_storeforward.py ---------------------------------------------- 09:39:05.402468 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 09:39:05.414760 tst nitb_smpp: Using 1 x bts (candidates: 1) 09:39:05.452017 tst esme_ms_sms_storeforward.py: using LAC 40037 09:39:05.577317 tst esme_ms_sms_storeforward.py: using RAC 2 09:39:05.699384 tst esme_ms_sms_storeforward.py: using CellId 40037 09:39:05.825166 tst esme_ms_sms_storeforward.py: using BVCI 40038 09:39:05.939955 tst nitb_smpp: Using 1 x modem (candidates: 1) 09:39:06.069566 tst esme_ms_sms_storeforward.py: using MSISDN 8616 09:39:06.189061 tst esme_ms_sms_storeforward.py:20: start nitb and bts... 09:39:06.398274 run osmo-nitb_10.42.42.2: Starting osmo-nitb 09:39:07.034444 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=2258): Launched 09:39:07.359378 run osmo-nitb_10.42.42.2(pid=2259): Launched 09:39:07.548448 run osmo-nitb_10.42.42.2(pid=2259): ERR: Terminated: ERROR {rc=2} [trial-2402↪nitb_smpp↪esme_ms_sms_storeforward.py:23↪esme_ms_sms_storeforward.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=2259)] 09:39:07.678095 run osmo-nitb_10.42.42.2(pid=2259): stdout: | (launched: 2022-12-14_09:39:07.300896) 09:39:07.811455 run osmo-nitb_10.42.42.2(pid=2259): stderr: | (launched: 2022-12-14_09:39:07.348284) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 09:39:07.943199 run osmo-nitb_10.42.42.2(pid=2259): stdout: | (launched: 2022-12-14_09:39:07.300896) 09:39:08.066413 run osmo-nitb_10.42.42.2(pid=2259): stderr: | (launched: 2022-12-14_09:39:07.348284) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 09:39:08.215310 tst esme_ms_sms_storeforward.py:23: ERR: Error: osmo-nitb_10.42.42.2(pid=2259): Process ended prematurely: osmo-nitb_10.42.42.2(pid=2259) [trial-2402↪nitb_smpp↪esme_ms_sms_storeforward.py:23↪esme_ms_sms_storeforward.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=2259)] [trial-2402↪nitb_smpp↪esme_ms_sms_storeforward.py:23] 09:39:08.224584 tst esme_ms_sms_storeforward.py:23: Test FAILED (2.8 sec) 09:39:08.232785 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=2258): Terminating (SIGTERM) 09:39:08.445216 --- ParallelTerminationStrategy: PID 2258 died... 09:39:08.467060 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=2258): Terminated: ok {rc=0} 09:39:08.557161 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2402 nitb_smpp esme_ms_sms_transaction.py ---------------------------------------------- 09:39:09.649182 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 09:39:09.662103 tst nitb_smpp: Using 1 x bts (candidates: 1) 09:39:09.699968 tst esme_ms_sms_transaction.py: using LAC 40038 09:39:09.831519 tst esme_ms_sms_transaction.py: using RAC 3 09:39:09.961721 tst esme_ms_sms_transaction.py: using CellId 40038 09:39:10.092499 tst esme_ms_sms_transaction.py: using BVCI 40039 09:39:10.215864 tst nitb_smpp: Using 1 x modem (candidates: 1) 09:39:10.350392 tst esme_ms_sms_transaction.py: using MSISDN 8617 09:39:10.470084 tst esme_ms_sms_transaction.py:18: start nitb and bts... 09:39:10.694091 run osmo-nitb_10.42.42.2: Starting osmo-nitb 09:39:11.367474 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=2260): Launched 09:39:11.711918 run osmo-nitb_10.42.42.2(pid=2261): Launched 09:39:11.912359 run osmo-nitb_10.42.42.2(pid=2261): ERR: Terminated: ERROR {rc=2} [trial-2402↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=2261)] 09:39:12.061157 run osmo-nitb_10.42.42.2(pid=2261): stdout: | (launched: 2022-12-14_09:39:11.648237) 09:39:12.210049 run osmo-nitb_10.42.42.2(pid=2261): stderr: | (launched: 2022-12-14_09:39:11.697841) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 09:39:12.360804 run osmo-nitb_10.42.42.2(pid=2261): stdout: | (launched: 2022-12-14_09:39:11.648237) 09:39:12.503801 run osmo-nitb_10.42.42.2(pid=2261): stderr: | (launched: 2022-12-14_09:39:11.697841) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fe4ae4b0268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=2261): Process ended prematurely: osmo-nitb_10.42.42.2(pid=2261) [trial-2402↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=2261)] 09:39:12.854421 tst osmo-nitb_10.42.42.2(pid=2261): stdout: | (launched: 2022-12-14_09:39:11.648237) 09:39:12.979800 tst osmo-nitb_10.42.42.2(pid=2261): stderr: | (launched: 2022-12-14_09:39:11.697841) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 09:39:13.127198 tst esme_ms_sms_transaction.py:21: ERR: Error: osmo-nitb_10.42.42.2(pid=2261): Process ended prematurely: osmo-nitb_10.42.42.2(pid=2261) [trial-2402↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=2261)] [trial-2402↪nitb_smpp↪esme_ms_sms_transaction.py:21] 09:39:13.136782 tst esme_ms_sms_transaction.py:21: Test FAILED (3.5 sec) 09:39:13.144334 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=2260): Terminating (SIGTERM) 09:39:13.356630 --- ParallelTerminationStrategy: PID 2260 died... 09:39:13.378036 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=2260): Terminated: ok {rc=0} 09:39:13.469264 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2402 nitb_smpp FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 smpp --------------------------------------------------------------------- 09:39:14.636831 tst smpp: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:39:14.640371 tst smpp: Verifying 1 x bts (candidates: 11) 09:39:14.662131 tst smpp: Verifying 6 x ip_address (candidates: 9) 09:39:14.694064 tst smpp: Verifying 1 x modem (candidates: 12) 09:39:14.731583 tst smpp: Reserving 1 x bts (candidates: 11) 09:39:14.755070 tst smpp: Reserving 6 x ip_address (candidates: 9) 09:39:14.784080 tst smpp: Reserving 1 x modem (candidates: 12) 09:39:15.308891 tst smpp: RESERVED RESOURCES for smpp: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2402 smpp esme_connect_policy_acceptall.py ---------------------------------------------- 09:39:15.316646 tst smpp: Using 1 x ip_address (candidates: 6) 09:39:15.328565 tst smpp: Using 1 x ip_address (candidates: 6) 09:39:15.340705 tst smpp: Using 1 x ip_address (candidates: 6) 09:39:15.353437 tst smpp: Using 1 x ip_address (candidates: 6) 09:39:15.373869 tst esme_connect_policy_acceptall.py: using MSISDN 8618 09:39:15.497466 run osmo-stp_10.42.42.4: Starting osmo-stp 09:39:16.087307 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=2265): Launched 09:39:16.443438 run osmo-stp_10.42.42.4(pid=2266): Launched 09:39:16.672456 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:39:17.313735 run create_hlr_db(pid=2267): Launched 09:39:17.452313 bus /sierra_2: Setting Powered False 09:39:18.513785 run create_hlr_db(pid=2267): Terminated: ok {rc=0} 09:39:18.989932 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2269): Launched 09:39:19.317705 run osmo-hlr_10.42.42.2(pid=2270): Launched 09:39:19.559006 run osmo-msc_10.42.42.5: Starting osmo-msc 09:39:20.299874 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2272): Launched 09:39:20.639545 run osmo-msc_10.42.42.5(pid=2273): Launched 09:39:20.993405 run osmo-hlr_10.42.42.2(pid=2270): ERR: Terminated: ERROR {rc=237} [trial-2402↪smpp↪esme_connect_policy_acceptall.py:23↪esme_connect_policy_acceptall.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2270)] 09:39:21.299087 run osmo-hlr_10.42.42.2(pid=2270): stdout: | (launched: 2022-12-14_09:39:19.258277) 09:39:21.436541 run osmo-hlr_10.42.42.2(pid=2270): stderr: | 20221214093919601 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214093919601 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214093919601 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214093919601 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214093919601 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214093919601 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214093919615 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/smpp/esme_connect_policy_acceptall.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214093919631 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214093919632 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214093919632 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:39:21.664084 run osmo-hlr_10.42.42.2(pid=2270): stdout: | (launched: 2022-12-14_09:39:19.258277) 09:39:21.795374 run osmo-hlr_10.42.42.2(pid=2270): stderr: | 20221214093919601 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214093919601 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214093919601 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214093919601 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214093919601 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214093919601 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214093919615 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/smpp/esme_connect_policy_acceptall.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214093919631 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214093919632 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214093919632 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:39:21.952893 tst esme_connect_policy_acceptall.py:23: ERR: Error: osmo-hlr_10.42.42.2(pid=2270): Process ended prematurely: osmo-hlr_10.42.42.2(pid=2270) [trial-2402↪smpp↪esme_connect_policy_acceptall.py:23↪esme_connect_policy_acceptall.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2270)] [trial-2402↪smpp↪esme_connect_policy_acceptall.py:23] 09:39:21.963059 tst esme_connect_policy_acceptall.py:23: Test FAILED (6.6 sec) 09:39:21.991735 run osmo-msc_10.42.42.5(pid=2273): ERR: Terminated: ERROR {rc=9} [trial-2402↪smpp↪esme_connect_policy_acceptall.py↪esme_connect_policy_acceptall.py↪osmo-msc_10.42.42.5↪osmo-msc_10.42.42.5(pid=2273)] 09:39:22.043879 run osmo-msc_10.42.42.5(pid=2273): stdout: | (launched: 2022-12-14_09:39:20.578470) 09:39:22.097588 run osmo-msc_10.42.42.5(pid=2273): stderr: | 20221214093921261 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Freeing instance (osmo_ss7.c:1650) | 20221214093921261 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Deallocated (fsm.c:568) | 20221214093921261 DLSS7 DEBUG XUA_ASP(asp0)[0x612000015820]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214093921261 DLSCCP NOTICE OsmoMSC-A-Iu: Using ASP instance asp0 (sccp_user.c:647) | 20221214093921261 DLSS7 NOTICE 0: Creating SCCP instance (osmo_ss7.c:458) | 20221214093921261 DLSCCP INFO Binding user 'SCCP Management' to SSN=1 PC=(no PC) (sccp_user.c:108) | 20221214093921261 DLSS7 DEBUG registering user=SCCP for SI 3 with priv 0x6120000159a0 (osmo_ss7.c:482) | 20221214093921262 DLGLOBAL NOTICE unable to bind socket: 0.0.0.0:29118: Address already in use (socket.c:822) | 20221214093921262 DSGS ERROR SGs socket cannot be opened: Address already in use (sgs_server.c:182) | Starting SGs server failed 09:39:22.151562 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=2265): Terminating (SIGTERM) 09:39:22.195471 run osmo-stp_10.42.42.4(pid=2266): Terminating (SIGTERM) 09:39:22.246828 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2269): Terminating (SIGTERM) 09:39:22.341243 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2272): Terminating (SIGTERM) 09:39:22.415335 --- ParallelTerminationStrategy: PID 2265 died... 09:39:22.436504 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=2265): Terminated: ok {rc=0} 09:39:22.486372 --- ParallelTerminationStrategy: PID 2266 died... 09:39:22.507879 run osmo-stp_10.42.42.4(pid=2266): Terminated: ok {rc=0} 09:39:22.556485 --- ParallelTerminationStrategy: PID 2269 died... 09:39:22.577942 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2269): Terminated: ok {rc=0} 09:39:22.626955 --- ParallelTerminationStrategy: PID 2272 died... 09:39:22.648447 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2272): Terminated: ok {rc=0} ---------------------------------------------- trial-2402 smpp esme_connect_policy_closed.py ---------------------------------------------- 09:39:22.702287 tst smpp: Using 1 x ip_address (candidates: 6) 09:39:22.714974 tst smpp: Using 1 x bts (candidates: 1) 09:39:22.752177 tst esme_connect_policy_closed.py: using LAC 40039 09:39:22.882877 tst esme_connect_policy_closed.py: using RAC 4 09:39:23.015200 tst esme_connect_policy_closed.py: using CellId 40039 09:39:23.143803 tst esme_connect_policy_closed.py: using BVCI 40040 09:39:23.265112 tst smpp: Using 1 x ip_address (candidates: 6) 09:39:23.277344 tst smpp: Using 1 x ip_address (candidates: 6) 09:39:23.289245 tst smpp: Using 1 x ip_address (candidates: 6) 09:39:23.312820 tst esme_connect_policy_closed.py: using MSISDN 8619 09:39:23.437957 tst esme_connect_policy_closed.py: using MSISDN 8620 09:39:23.552110 run osmo-stp_10.42.42.4: Starting osmo-stp 09:39:24.089214 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=2276): Launched 09:39:24.417262 run osmo-stp_10.42.42.4(pid=2277): Launched 09:39:24.661442 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:39:25.162892 run create_hlr_db(pid=2278): Launched 09:39:26.350524 run create_hlr_db(pid=2278): Terminated: ok {rc=0} 09:39:26.672863 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2280): Launched 09:39:26.977498 run osmo-hlr_10.42.42.2(pid=2281): Launched 09:39:27.093074 run osmo-msc_10.42.42.5: Starting osmo-msc 09:39:27.660607 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2283): Launched 09:39:27.988914 run osmo-msc_10.42.42.5(pid=2284): Launched 09:39:28.168099 run osmo-hlr_10.42.42.2(pid=2281): ERR: Terminated: ERROR {rc=237} [trial-2402↪smpp↪esme_connect_policy_closed.py:31↪esme_connect_policy_closed.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2281)] 09:39:28.306599 run osmo-hlr_10.42.42.2(pid=2281): stdout: | (launched: 2022-12-14_09:39:26.920350) 09:39:28.444479 run osmo-hlr_10.42.42.2(pid=2281): stderr: | 20221214093927092 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214093927092 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214093927092 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214093927092 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214093927093 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214093927093 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214093927103 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/smpp/esme_connect_policy_closed.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214093927111 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214093927112 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214093927112 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:39:28.581834 run osmo-hlr_10.42.42.2(pid=2281): stdout: | (launched: 2022-12-14_09:39:26.920350) 09:39:28.710542 run osmo-hlr_10.42.42.2(pid=2281): stderr: | 20221214093927092 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214093927092 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214093927092 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214093927092 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214093927093 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214093927093 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214093927103 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/smpp/esme_connect_policy_closed.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214093927111 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214093927112 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214093927112 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:39:28.864935 tst esme_connect_policy_closed.py:31: ERR: Error: osmo-hlr_10.42.42.2(pid=2281): Process ended prematurely: osmo-hlr_10.42.42.2(pid=2281) [trial-2402↪smpp↪esme_connect_policy_closed.py:31↪esme_connect_policy_closed.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2281)] [trial-2402↪smpp↪esme_connect_policy_closed.py:31] 09:39:28.873826 tst esme_connect_policy_closed.py:31: Test FAILED (6.2 sec) 09:39:28.901188 run osmo-msc_10.42.42.5(pid=2284): ERR: Terminated: ERROR {rc=9} [trial-2402↪smpp↪esme_connect_policy_closed.py↪esme_connect_policy_closed.py↪osmo-msc_10.42.42.5↪osmo-msc_10.42.42.5(pid=2284)] 09:39:28.951647 run osmo-msc_10.42.42.5(pid=2284): stdout: | (launched: 2022-12-14_09:39:27.927682) 09:39:29.003576 run osmo-msc_10.42.42.5(pid=2284): stderr: | 20221214093928293 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Freeing instance (osmo_ss7.c:1650) | 20221214093928293 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Deallocated (fsm.c:568) | 20221214093928293 DLSS7 DEBUG XUA_ASP(asp0)[0x612000015820]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214093928293 DLSCCP NOTICE OsmoMSC-A-Iu: Using ASP instance asp0 (sccp_user.c:647) | 20221214093928293 DLSS7 NOTICE 0: Creating SCCP instance (osmo_ss7.c:458) | 20221214093928293 DLSCCP INFO Binding user 'SCCP Management' to SSN=1 PC=(no PC) (sccp_user.c:108) | 20221214093928293 DLSS7 DEBUG registering user=SCCP for SI 3 with priv 0x6120000159a0 (osmo_ss7.c:482) | 20221214093928293 DLGLOBAL NOTICE unable to bind socket: 0.0.0.0:29118: Address already in use (socket.c:822) | 20221214093928294 DSGS ERROR SGs socket cannot be opened: Address already in use (sgs_server.c:182) | Starting SGs server failed 09:39:29.055843 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=2276): Terminating (SIGTERM) 09:39:29.097802 run osmo-stp_10.42.42.4(pid=2277): Terminating (SIGTERM) 09:39:29.139539 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2280): Terminating (SIGTERM) 09:39:29.186462 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2283): Terminating (SIGTERM) 09:39:29.231352 --- ParallelTerminationStrategy: PID 2276 died... 09:39:29.251815 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=2276): Terminated: ok {rc=0} 09:39:29.296829 --- ParallelTerminationStrategy: PID 2277 died... 09:39:29.316302 run osmo-stp_10.42.42.4(pid=2277): Terminated: ok {rc=0} 09:39:29.361683 --- ParallelTerminationStrategy: PID 2280 died... 09:39:29.381288 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2280): Terminated: ok {rc=0} 09:39:29.426039 --- ParallelTerminationStrategy: PID 2283 died... 09:39:29.445620 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2283): Terminated: ok {rc=0} ---------------------------------------------- trial-2402 smpp esme_ms_sms_storeforward.py ---------------------------------------------- 09:39:29.495464 tst smpp: Using 1 x ip_address (candidates: 6) 09:39:29.507458 tst smpp: Using 1 x bts (candidates: 1) 09:39:29.543291 tst esme_ms_sms_storeforward.py: using LAC 40040 09:39:29.673777 tst esme_ms_sms_storeforward.py: using RAC 5 09:39:29.803798 tst esme_ms_sms_storeforward.py: using CellId 40040 09:39:29.936519 tst esme_ms_sms_storeforward.py: using BVCI 40041 09:39:30.057631 tst smpp: Using 1 x ip_address (candidates: 6) 09:39:30.068420 tst smpp: Using 1 x ip_address (candidates: 6) 09:39:30.079262 tst smpp: Using 1 x ip_address (candidates: 6) 09:39:30.090122 tst smpp: Using 1 x ip_address (candidates: 6) 09:39:30.101554 tst smpp: Using 1 x ip_address (candidates: 6) 09:39:30.112811 tst smpp: Using 1 x modem (candidates: 1) 09:39:30.239045 tst esme_ms_sms_storeforward.py: using MSISDN 8621 09:39:30.351607 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:39:30.829718 run create_hlr_db(pid=2288): Launched 09:39:32.060023 run create_hlr_db(pid=2288): Terminated: ok {rc=0} 09:39:32.440731 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2290): Launched 09:39:32.767916 run osmo-hlr_10.42.42.2(pid=2291): Launched 09:39:32.891399 run osmo-stp_10.42.42.5: Starting osmo-stp 09:39:33.458669 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2293): Launched 09:39:33.786775 run osmo-stp_10.42.42.5(pid=2294): Launched 09:39:33.911825 run osmo-msc_10.42.42.6: Starting osmo-msc 09:39:34.500629 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2296): Launched 09:39:34.825049 run osmo-msc_10.42.42.6(pid=2297): Launched 09:39:35.004224 run osmo-stp_10.42.42.5(pid=2294): ERR: Terminated: ERROR {rc=1} [trial-2402↪smpp↪esme_ms_sms_storeforward.py:30↪esme_ms_sms_storeforward.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2294)] 09:39:35.141490 run osmo-stp_10.42.42.5(pid=2294): stdout: | (launched: 2022-12-14_09:39:33.726036) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:39:35.279261 run osmo-stp_10.42.42.5(pid=2294): stderr: | 20221214093933920 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214093933920 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214093933920 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214093933921 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214093933923 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214093933923 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214093933923 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:39:35.415931 run osmo-stp_10.42.42.5(pid=2294): stdout: | (launched: 2022-12-14_09:39:33.726036) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:39:35.544585 run osmo-stp_10.42.42.5(pid=2294): stderr: | 20221214093933920 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214093933920 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214093933920 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214093933921 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214093933923 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214093933923 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214093933923 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:39:35.699121 tst esme_ms_sms_storeforward.py:30: ERR: Error: osmo-stp_10.42.42.5(pid=2294): Process ended prematurely: osmo-stp_10.42.42.5(pid=2294) [trial-2402↪smpp↪esme_ms_sms_storeforward.py:30↪esme_ms_sms_storeforward.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2294)] [trial-2402↪smpp↪esme_ms_sms_storeforward.py:30] 09:39:35.707967 tst esme_ms_sms_storeforward.py:30: Test FAILED (6.2 sec) 09:39:35.735193 run osmo-hlr_10.42.42.2(pid=2291): ERR: Terminated: ERROR {rc=237} [trial-2402↪smpp↪esme_ms_sms_storeforward.py↪esme_ms_sms_storeforward.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2291)] 09:39:35.785422 run osmo-hlr_10.42.42.2(pid=2291): stdout: | (launched: 2022-12-14_09:39:32.707546) 09:39:35.837230 run osmo-hlr_10.42.42.2(pid=2291): stderr: | 20221214093932905 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214093932905 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214093932905 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214093932905 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214093932905 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214093932905 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214093932920 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/smpp/esme_ms_sms_storeforward.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214093932930 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214093932931 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214093932931 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:39:35.909504 run osmo-msc_10.42.42.6(pid=2297): ERR: Terminated: ERROR {rc=2} [trial-2402↪smpp↪esme_ms_sms_storeforward.py↪esme_ms_sms_storeforward.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2297)] 09:39:35.959735 run osmo-msc_10.42.42.6(pid=2297): stdout: | (launched: 2022-12-14_09:39:34.764050) 09:39:36.011480 run osmo-msc_10.42.42.6(pid=2297): stderr: | 20221214093935087 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214093935087 DLGLOBAL DEBUG validating counter group 0x7fdc48cf4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214093935087 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214093935087 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214093935087 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214093935088 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214093935090 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214093935090 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214093935090 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214093935090 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:39:36.063326 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2290): Terminating (SIGTERM) 09:39:36.105020 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2293): Terminating (SIGTERM) 09:39:36.146695 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2296): Terminating (SIGTERM) 09:39:36.188544 --- ParallelTerminationStrategy: PID 2290 died... 09:39:36.208608 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2290): Terminated: ok {rc=0} 09:39:36.254973 --- ParallelTerminationStrategy: PID 2293 died... 09:39:36.274463 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2293): Terminated: ok {rc=0} 09:39:36.320643 --- ParallelTerminationStrategy: PID 2296 died... 09:39:36.340280 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2296): Terminated: ok {rc=0} 09:39:36.428593 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2402 smpp esme_ms_sms_transaction.py ---------------------------------------------- 09:39:37.516426 tst smpp: Using 1 x ip_address (candidates: 6) 09:39:37.528102 tst smpp: Using 1 x bts (candidates: 1) 09:39:37.564479 tst esme_ms_sms_transaction.py: using LAC 40041 09:39:37.693365 tst esme_ms_sms_transaction.py: using RAC 6 09:39:37.820539 tst esme_ms_sms_transaction.py: using CellId 40041 09:39:37.947856 tst esme_ms_sms_transaction.py: using BVCI 40042 09:39:38.065753 tst smpp: Using 1 x ip_address (candidates: 6) 09:39:38.076629 tst smpp: Using 1 x ip_address (candidates: 6) 09:39:38.087464 tst smpp: Using 1 x ip_address (candidates: 6) 09:39:38.098290 tst smpp: Using 1 x ip_address (candidates: 6) 09:39:38.109907 tst smpp: Using 1 x ip_address (candidates: 6) 09:39:38.121204 tst smpp: Using 1 x modem (candidates: 1) 09:39:38.253706 tst esme_ms_sms_transaction.py: using MSISDN 8622 09:39:38.373545 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:39:38.877534 run create_hlr_db(pid=2299): Launched 09:39:39.009650 bus /sierra_2: Setting Powered False 09:39:40.073663 run create_hlr_db(pid=2299): Terminated: ok {rc=0} 09:39:40.523071 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2301): Launched 09:39:40.833530 run osmo-hlr_10.42.42.2(pid=2302): Launched 09:39:40.949646 run osmo-stp_10.42.42.5: Starting osmo-stp 09:39:41.490538 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2304): Launched 09:39:41.796134 run osmo-stp_10.42.42.5(pid=2305): Launched 09:39:41.911380 run osmo-msc_10.42.42.6: Starting osmo-msc 09:39:42.471943 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2307): Launched 09:39:42.775550 run osmo-msc_10.42.42.6(pid=2308): Launched 09:39:42.948046 run osmo-stp_10.42.42.5(pid=2305): ERR: Terminated: ERROR {rc=1} [trial-2402↪smpp↪esme_ms_sms_transaction.py:28↪esme_ms_sms_transaction.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2305)] 09:39:43.077278 run osmo-stp_10.42.42.5(pid=2305): stdout: | (launched: 2022-12-14_09:39:41.738704) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:39:43.205639 run osmo-stp_10.42.42.5(pid=2305): stderr: | 20221214093941908 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214093941908 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214093941909 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214093941909 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214093941911 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214093941912 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214093941912 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:39:43.332600 run osmo-stp_10.42.42.5(pid=2305): stdout: | (launched: 2022-12-14_09:39:41.738704) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:39:43.452546 run osmo-stp_10.42.42.5(pid=2305): stderr: | 20221214093941908 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214093941908 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214093941909 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214093941909 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214093941911 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214093941912 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214093941912 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:39:43.596289 tst esme_ms_sms_transaction.py:28: ERR: Error: osmo-stp_10.42.42.5(pid=2305): Process ended prematurely: osmo-stp_10.42.42.5(pid=2305) [trial-2402↪smpp↪esme_ms_sms_transaction.py:28↪esme_ms_sms_transaction.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2305)] [trial-2402↪smpp↪esme_ms_sms_transaction.py:28] 09:39:43.604747 tst esme_ms_sms_transaction.py:28: Test FAILED (6.1 sec) 09:39:43.630477 run osmo-hlr_10.42.42.2(pid=2302): ERR: Terminated: ERROR {rc=237} [trial-2402↪smpp↪esme_ms_sms_transaction.py↪esme_ms_sms_transaction.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2302)] 09:39:43.679016 run osmo-hlr_10.42.42.2(pid=2302): stdout: | (launched: 2022-12-14_09:39:40.776341) 09:39:43.728711 run osmo-hlr_10.42.42.2(pid=2302): stderr: | 20221214093940953 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214093940953 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214093940953 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214093940953 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214093940953 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214093940953 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214093940965 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/smpp/esme_ms_sms_transaction.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214093940974 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214093940974 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214093940974 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:39:43.797831 run osmo-msc_10.42.42.6(pid=2308): ERR: Terminated: ERROR {rc=2} [trial-2402↪smpp↪esme_ms_sms_transaction.py↪esme_ms_sms_transaction.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2308)] 09:39:43.845124 run osmo-msc_10.42.42.6(pid=2308): stdout: | (launched: 2022-12-14_09:39:42.718624) 09:39:43.894291 run osmo-msc_10.42.42.6(pid=2308): stderr: | 20221214093942991 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214093942991 DLGLOBAL DEBUG validating counter group 0x7f36a6fc1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214093942991 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214093942991 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214093942991 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214093942992 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214093942993 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214093942994 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214093942994 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214093942994 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:39:43.943501 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2301): Terminating (SIGTERM) 09:39:43.982938 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2304): Terminating (SIGTERM) 09:39:44.022480 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2307): Terminating (SIGTERM) 09:39:44.062552 --- ParallelTerminationStrategy: PID 2301 died... 09:39:44.082124 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2301): Terminated: ok {rc=0} 09:39:44.126395 --- ParallelTerminationStrategy: PID 2304 died... 09:39:44.145485 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2304): Terminated: ok {rc=0} 09:39:44.189634 --- ParallelTerminationStrategy: PID 2307 died... 09:39:44.208525 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2307): Terminated: ok {rc=0} 09:39:44.295198 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2402 smpp FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 encryption --------------------------------------------------------------------- 09:39:45.490246 tst encryption: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:39:45.493781 tst encryption: Verifying 1 x bts (candidates: 11) 09:39:45.514501 tst encryption: Verifying 6 x ip_address (candidates: 9) 09:39:45.544358 tst encryption: Verifying 1 x modem (candidates: 12) 09:39:45.582601 tst encryption: Reserving 1 x bts (candidates: 11) 09:39:45.604460 tst encryption: Reserving 6 x ip_address (candidates: 9) 09:39:45.631659 tst encryption: Reserving 1 x modem (candidates: 12) 09:39:46.163054 tst encryption: RESERVED RESOURCES for encryption: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2402 encryption register_a5_0_authopt.py ---------------------------------------------- 09:39:46.240279 tst encryption: Using 1 x ip_address (candidates: 6) 09:39:46.255201 tst encryption: Using 1 x bts (candidates: 1) 09:39:46.290143 tst register_a5_0_authopt.py: using LAC 40042 09:39:46.426339 tst register_a5_0_authopt.py: using RAC 7 09:39:46.553102 tst register_a5_0_authopt.py: using CellId 40042 09:39:46.673773 tst register_a5_0_authopt.py: using BVCI 40043 09:39:46.789623 tst encryption: Using 1 x ip_address (candidates: 6) 09:39:46.801148 tst encryption: Using 1 x ip_address (candidates: 6) 09:39:46.812656 tst encryption: Using 1 x ip_address (candidates: 6) 09:39:46.824211 tst encryption: Using 1 x ip_address (candidates: 6) 09:39:46.836575 tst encryption: Using 1 x ip_address (candidates: 6) 09:39:46.848857 tst encryption: Using 1 x modem (candidates: 1) 09:39:46.973865 tst register_a5_0_authopt.py:8: start network... 09:39:47.222774 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:39:47.738332 run create_hlr_db(pid=2314): Launched 09:39:47.872631 bus /sierra_2: Setting Powered False 09:39:48.937237 run create_hlr_db(pid=2314): Terminated: ok {rc=0} 09:39:49.395674 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2316): Launched 09:39:49.727454 run osmo-hlr_10.42.42.2(pid=2317): Launched 09:39:49.853127 run osmo-stp_10.42.42.5: Starting osmo-stp 09:39:50.422972 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2319): Launched 09:39:50.751910 run osmo-stp_10.42.42.5(pid=2320): Launched 09:39:50.876419 run osmo-msc_10.42.42.6: Starting osmo-msc 09:39:51.471529 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2322): Launched 09:39:51.801380 run osmo-msc_10.42.42.6(pid=2323): Launched 09:39:51.984864 run osmo-stp_10.42.42.5(pid=2320): ERR: Terminated: ERROR {rc=1} [trial-2402↪encryption↪register_a5_0_authopt.py:8↪register_a5_0_authopt.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2320)] 09:39:52.122878 run osmo-stp_10.42.42.5(pid=2320): stdout: | (launched: 2022-12-14_09:39:50.690390) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:39:52.262520 run osmo-stp_10.42.42.5(pid=2320): stderr: | 20221214093950886 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214093950887 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214093950887 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214093950887 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214093950888 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214093950888 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214093950888 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:39:52.400578 run osmo-stp_10.42.42.5(pid=2320): stdout: | (launched: 2022-12-14_09:39:50.690390) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:39:52.531364 run osmo-stp_10.42.42.5(pid=2320): stderr: | 20221214093950886 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214093950887 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214093950887 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214093950887 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214093950888 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214093950888 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214093950888 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:39:52.687693 tst register_a5_0_authopt.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2320): Process ended prematurely: osmo-stp_10.42.42.5(pid=2320) [trial-2402↪encryption↪register_a5_0_authopt.py:8↪register_a5_0_authopt.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2320)] [trial-2402↪encryption↪register_a5_0_authopt.py:8] 09:39:52.697478 tst register_a5_0_authopt.py:8: Test FAILED (6.5 sec) 09:39:52.725317 run osmo-hlr_10.42.42.2(pid=2317): ERR: Terminated: ERROR {rc=237} [trial-2402↪encryption↪register_a5_0_authopt.py↪register_a5_0_authopt.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2317)] 09:39:52.775717 run osmo-hlr_10.42.42.2(pid=2317): stdout: | (launched: 2022-12-14_09:39:49.665775) 09:39:52.828080 run osmo-hlr_10.42.42.2(pid=2317): stderr: | 20221214093949867 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214093949867 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214093949867 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214093949867 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214093949867 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214093949867 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214093949879 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/encryption/register_a5_0_authopt.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214093949889 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214093949889 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214093949889 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:39:52.900720 run osmo-msc_10.42.42.6(pid=2323): ERR: Terminated: ERROR {rc=2} [trial-2402↪encryption↪register_a5_0_authopt.py↪register_a5_0_authopt.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2323)] 09:39:52.950787 run osmo-msc_10.42.42.6(pid=2323): stdout: | (launched: 2022-12-14_09:39:51.739507) 09:39:53.002809 run osmo-msc_10.42.42.6(pid=2323): stderr: | 20221214093952064 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214093952064 DLGLOBAL DEBUG validating counter group 0x7efc23cebc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214093952064 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214093952064 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214093952064 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214093952064 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214093952066 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214093952066 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214093952067 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214093952067 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:39:53.055133 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2316): Terminating (SIGTERM) 09:39:53.097255 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2319): Terminating (SIGTERM) 09:39:53.139545 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2322): Terminating (SIGTERM) 09:39:53.181870 --- ParallelTerminationStrategy: PID 2316 died... 09:39:53.202206 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2316): Terminated: ok {rc=0} 09:39:53.249493 --- ParallelTerminationStrategy: PID 2319 died... 09:39:53.269417 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2319): Terminated: ok {rc=0} 09:39:53.316168 --- ParallelTerminationStrategy: PID 2322 died... 09:39:53.336130 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2322): Terminated: ok {rc=0} 09:39:53.424852 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2402 encryption register_a5_0_authreq.py ---------------------------------------------- 09:39:54.576266 tst encryption: Using 1 x ip_address (candidates: 6) 09:39:54.587901 tst encryption: Using 1 x bts (candidates: 1) 09:39:54.624210 tst register_a5_0_authreq.py: using LAC 40043 09:39:54.753856 tst register_a5_0_authreq.py: using RAC 8 09:39:54.882678 tst register_a5_0_authreq.py: using CellId 40043 09:39:55.013926 tst register_a5_0_authreq.py: using BVCI 40044 09:39:55.127712 tst encryption: Using 1 x ip_address (candidates: 6) 09:39:55.138503 tst encryption: Using 1 x ip_address (candidates: 6) 09:39:55.149020 tst encryption: Using 1 x ip_address (candidates: 6) 09:39:55.159469 tst encryption: Using 1 x ip_address (candidates: 6) 09:39:55.170219 tst encryption: Using 1 x ip_address (candidates: 6) 09:39:55.181187 tst encryption: Using 1 x modem (candidates: 1) 09:39:55.302407 tst register_a5_0_authreq.py:8: start network... 09:39:55.524551 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:39:56.037275 run create_hlr_db(pid=2325): Launched 09:39:56.171733 bus /sierra_2: Setting Powered False 09:39:57.235936 run create_hlr_db(pid=2325): Terminated: ok {rc=0} 09:39:57.692807 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2327): Launched 09:39:58.024476 run osmo-hlr_10.42.42.2(pid=2328): Launched 09:39:58.151448 run osmo-stp_10.42.42.5: Starting osmo-stp 09:39:58.717252 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2330): Launched 09:39:59.045965 run osmo-stp_10.42.42.5(pid=2331): Launched 09:39:59.170810 run osmo-msc_10.42.42.6: Starting osmo-msc 09:39:59.766945 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2333): Launched 09:40:00.096282 run osmo-msc_10.42.42.6(pid=2334): Launched 09:40:00.280917 run osmo-stp_10.42.42.5(pid=2331): ERR: Terminated: ERROR {rc=1} [trial-2402↪encryption↪register_a5_0_authreq.py:8↪register_a5_0_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2331)] 09:40:00.419022 run osmo-stp_10.42.42.5(pid=2331): stdout: | (launched: 2022-12-14_09:39:58.984214) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:40:00.558433 run osmo-stp_10.42.42.5(pid=2331): stderr: | 20221214093959180 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214093959180 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214093959181 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214093959181 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214093959182 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214093959182 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214093959182 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:40:00.695936 run osmo-stp_10.42.42.5(pid=2331): stdout: | (launched: 2022-12-14_09:39:58.984214) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:40:00.826322 run osmo-stp_10.42.42.5(pid=2331): stderr: | 20221214093959180 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214093959180 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214093959181 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214093959181 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214093959182 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214093959182 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214093959182 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:40:00.997600 tst register_a5_0_authreq.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2331): Process ended prematurely: osmo-stp_10.42.42.5(pid=2331) [trial-2402↪encryption↪register_a5_0_authreq.py:8↪register_a5_0_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2331)] [trial-2402↪encryption↪register_a5_0_authreq.py:8] 09:40:01.007732 tst register_a5_0_authreq.py:8: Test FAILED (6.5 sec) 09:40:01.035954 run osmo-hlr_10.42.42.2(pid=2328): ERR: Terminated: ERROR {rc=237} [trial-2402↪encryption↪register_a5_0_authreq.py↪register_a5_0_authreq.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2328)] 09:40:01.086835 run osmo-hlr_10.42.42.2(pid=2328): stdout: | (launched: 2022-12-14_09:39:57.963313) 09:40:01.140097 run osmo-hlr_10.42.42.2(pid=2328): stderr: | 20221214093958164 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214093958164 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214093958164 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214093958164 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214093958165 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214093958165 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214093958177 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/encryption/register_a5_0_authreq.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214093958185 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214093958186 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214093958186 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:40:01.214445 run osmo-msc_10.42.42.6(pid=2334): ERR: Terminated: ERROR {rc=2} [trial-2402↪encryption↪register_a5_0_authreq.py↪register_a5_0_authreq.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2334)] 09:40:01.265741 run osmo-msc_10.42.42.6(pid=2334): stdout: | (launched: 2022-12-14_09:40:00.035042) 09:40:01.328131 run osmo-msc_10.42.42.6(pid=2334): stderr: | 20221214094000360 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214094000360 DLGLOBAL DEBUG validating counter group 0x7fe47ddf3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214094000360 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214094000360 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214094000360 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214094000361 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214094000362 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214094000363 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214094000363 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214094000363 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:40:01.385832 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2327): Terminating (SIGTERM) 09:40:01.432378 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2330): Terminating (SIGTERM) 09:40:01.477135 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2333): Terminating (SIGTERM) 09:40:01.521407 --- ParallelTerminationStrategy: PID 2327 died... 09:40:01.541818 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2327): Terminated: ok {rc=0} 09:40:01.589472 --- ParallelTerminationStrategy: PID 2330 died... 09:40:01.609735 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2330): Terminated: ok {rc=0} 09:40:01.656534 --- ParallelTerminationStrategy: PID 2333 died... 09:40:01.676749 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2333): Terminated: ok {rc=0} 09:40:01.766357 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2402 encryption register_a5_1_authreq.py ---------------------------------------------- 09:40:02.914846 tst encryption: Using 1 x ip_address (candidates: 6) 09:40:02.926270 tst encryption: Using 1 x bts (candidates: 1) 09:40:02.965796 tst register_a5_1_authreq.py: using LAC 40044 09:40:03.094944 tst register_a5_1_authreq.py: using RAC 9 09:40:03.225336 tst register_a5_1_authreq.py: using CellId 40044 09:40:03.354712 tst register_a5_1_authreq.py: using BVCI 40045 09:40:03.476051 tst encryption: Using 1 x ip_address (candidates: 6) 09:40:03.487183 tst encryption: Using 1 x ip_address (candidates: 6) 09:40:03.498231 tst encryption: Using 1 x ip_address (candidates: 6) 09:40:03.508935 tst encryption: Using 1 x ip_address (candidates: 6) 09:40:03.519703 tst encryption: Using 1 x ip_address (candidates: 6) 09:40:03.530458 tst encryption: Using 1 x modem (candidates: 1) 09:40:03.648816 tst register_a5_1_authreq.py:8: start network... 09:40:03.870990 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:40:04.383285 run create_hlr_db(pid=2339): Launched 09:40:04.518052 bus /sierra_2: Setting Powered False 09:40:05.582917 run create_hlr_db(pid=2339): Terminated: ok {rc=0} 09:40:06.022273 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2341): Launched 09:40:06.331480 run osmo-hlr_10.42.42.2(pid=2342): Launched 09:40:06.449339 run osmo-stp_10.42.42.5: Starting osmo-stp 09:40:07.019555 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2344): Launched 09:40:07.350131 run osmo-stp_10.42.42.5(pid=2345): Launched 09:40:07.474876 run osmo-msc_10.42.42.6: Starting osmo-msc 09:40:08.067529 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2347): Launched 09:40:08.397421 run osmo-msc_10.42.42.6(pid=2348): Launched 09:40:08.581260 run osmo-stp_10.42.42.5(pid=2345): ERR: Terminated: ERROR {rc=1} [trial-2402↪encryption↪register_a5_1_authreq.py:8↪register_a5_1_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2345)] 09:40:08.718870 run osmo-stp_10.42.42.5(pid=2345): stdout: | (launched: 2022-12-14_09:40:07.287932) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:40:08.857591 run osmo-stp_10.42.42.5(pid=2345): stderr: | 20221214094007483 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214094007483 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214094007483 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214094007484 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214094007484 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214094007484 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214094007485 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:40:08.995143 run osmo-stp_10.42.42.5(pid=2345): stdout: | (launched: 2022-12-14_09:40:07.287932) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:40:09.125314 run osmo-stp_10.42.42.5(pid=2345): stderr: | 20221214094007483 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214094007483 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214094007483 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214094007484 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214094007484 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214094007484 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214094007485 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:40:09.281447 tst register_a5_1_authreq.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2345): Process ended prematurely: osmo-stp_10.42.42.5(pid=2345) [trial-2402↪encryption↪register_a5_1_authreq.py:8↪register_a5_1_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2345)] [trial-2402↪encryption↪register_a5_1_authreq.py:8] 09:40:09.291031 tst register_a5_1_authreq.py:8: Test FAILED (6.4 sec) 09:40:09.318987 run osmo-hlr_10.42.42.2(pid=2342): ERR: Terminated: ERROR {rc=237} [trial-2402↪encryption↪register_a5_1_authreq.py↪register_a5_1_authreq.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2342)] 09:40:09.369833 run osmo-hlr_10.42.42.2(pid=2342): stdout: | (launched: 2022-12-14_09:40:06.272216) 09:40:09.422075 run osmo-hlr_10.42.42.2(pid=2342): stderr: | 20221214094006451 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214094006451 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214094006451 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214094006451 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214094006451 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214094006451 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214094006463 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/encryption/register_a5_1_authreq.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214094006471 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214094006471 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214094006472 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:40:09.494866 run osmo-msc_10.42.42.6(pid=2348): ERR: Terminated: ERROR {rc=2} [trial-2402↪encryption↪register_a5_1_authreq.py↪register_a5_1_authreq.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2348)] 09:40:09.545089 run osmo-msc_10.42.42.6(pid=2348): stdout: | (launched: 2022-12-14_09:40:08.336225) 09:40:09.597253 run osmo-msc_10.42.42.6(pid=2348): stderr: | 20221214094008660 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214094008661 DLGLOBAL DEBUG validating counter group 0x7fba4cb9ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214094008661 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214094008661 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214094008661 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214094008661 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214094008663 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214094008664 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214094008664 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214094008664 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:40:09.649555 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2341): Terminating (SIGTERM) 09:40:09.691824 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2344): Terminating (SIGTERM) 09:40:09.734136 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2347): Terminating (SIGTERM) 09:40:09.776032 --- ParallelTerminationStrategy: PID 2341 died... 09:40:09.795833 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2341): Terminated: ok {rc=0} 09:40:09.842551 --- ParallelTerminationStrategy: PID 2344 died... 09:40:09.862377 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2344): Terminated: ok {rc=0} 09:40:09.908528 --- ParallelTerminationStrategy: PID 2347 died... 09:40:09.928256 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2347): Terminated: ok {rc=0} 09:40:10.016262 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2402 encryption register_a5_3_authreq.py ---------------------------------------------- 09:40:11.167347 tst encryption: Using 1 x ip_address (candidates: 6) 09:40:11.178996 tst encryption: Using 1 x bts (candidates: 1) 09:40:11.213932 tst register_a5_3_authreq.py: using LAC 40045 09:40:11.342418 tst register_a5_3_authreq.py: using RAC 10 09:40:11.470317 tst register_a5_3_authreq.py: using CellId 40045 09:40:11.597930 tst register_a5_3_authreq.py: using BVCI 40046 09:40:11.717781 tst encryption: Using 1 x ip_address (candidates: 6) 09:40:11.728647 tst encryption: Using 1 x ip_address (candidates: 6) 09:40:11.739510 tst encryption: Using 1 x ip_address (candidates: 6) 09:40:11.750370 tst encryption: Using 1 x ip_address (candidates: 6) 09:40:11.761212 tst encryption: Using 1 x ip_address (candidates: 6) 09:40:11.771946 tst encryption: Using 1 x modem (candidates: 1) 09:40:11.906206 tst register_a5_3_authreq.py:8: start network... 09:40:12.127873 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:40:12.638216 run create_hlr_db(pid=2350): Launched 09:40:12.773121 bus /sierra_2: Setting Powered False 09:40:13.837568 run create_hlr_db(pid=2350): Terminated: ok {rc=0} 09:40:14.276158 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2352): Launched 09:40:14.607878 run osmo-hlr_10.42.42.2(pid=2353): Launched 09:40:14.735629 run osmo-stp_10.42.42.5: Starting osmo-stp 09:40:15.301473 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2355): Launched 09:40:15.632133 run osmo-stp_10.42.42.5(pid=2356): Launched 09:40:15.759330 run osmo-msc_10.42.42.6: Starting osmo-msc 09:40:16.433535 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2358): Launched 09:40:16.773513 run osmo-msc_10.42.42.6(pid=2359): Launched 09:40:17.088116 run osmo-stp_10.42.42.5(pid=2356): ERR: Terminated: ERROR {rc=1} [trial-2402↪encryption↪register_a5_3_authreq.py:8↪register_a5_3_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2356)] 09:40:17.390689 run osmo-stp_10.42.42.5(pid=2356): stdout: | (launched: 2022-12-14_09:40:15.571086) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:40:17.528431 run osmo-stp_10.42.42.5(pid=2356): stderr: | 20221214094015767 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214094015767 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214094015768 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214094015768 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214094015769 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214094015769 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214094015769 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:40:17.664706 run osmo-stp_10.42.42.5(pid=2356): stdout: | (launched: 2022-12-14_09:40:15.571086) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:40:17.794822 run osmo-stp_10.42.42.5(pid=2356): stderr: | 20221214094015767 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214094015767 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214094015768 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214094015768 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214094015769 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214094015769 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214094015769 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:40:17.950465 tst register_a5_3_authreq.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2356): Process ended prematurely: osmo-stp_10.42.42.5(pid=2356) [trial-2402↪encryption↪register_a5_3_authreq.py:8↪register_a5_3_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2356)] [trial-2402↪encryption↪register_a5_3_authreq.py:8] 09:40:17.959831 tst register_a5_3_authreq.py:8: Test FAILED (6.8 sec) 09:40:17.987188 run osmo-hlr_10.42.42.2(pid=2353): ERR: Terminated: ERROR {rc=237} [trial-2402↪encryption↪register_a5_3_authreq.py↪register_a5_3_authreq.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2353)] 09:40:18.037608 run osmo-hlr_10.42.42.2(pid=2353): stdout: | (launched: 2022-12-14_09:40:14.546939) 09:40:18.088919 run osmo-hlr_10.42.42.2(pid=2353): stderr: | 20221214094014749 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214094014749 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214094014749 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214094014749 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214094014749 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214094014749 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214094014765 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/encryption/register_a5_3_authreq.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214094014775 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214094014775 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214094014775 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:40:18.160900 run osmo-msc_10.42.42.6(pid=2359): ERR: Terminated: ERROR {rc=2} [trial-2402↪encryption↪register_a5_3_authreq.py↪register_a5_3_authreq.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2359)] 09:40:18.210593 run osmo-msc_10.42.42.6(pid=2359): stdout: | (launched: 2022-12-14_09:40:16.708308) 09:40:18.262742 run osmo-msc_10.42.42.6(pid=2359): stderr: | 20221214094017243 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214094017244 DLGLOBAL DEBUG validating counter group 0x7f2114938c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214094017244 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214094017244 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214094017244 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214094017244 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214094017246 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214094017247 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214094017247 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214094017247 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:40:18.314657 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2352): Terminating (SIGTERM) 09:40:18.356131 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2355): Terminating (SIGTERM) 09:40:18.397943 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2358): Terminating (SIGTERM) 09:40:18.440021 --- ParallelTerminationStrategy: PID 2352 died... 09:40:18.459834 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2352): Terminated: ok {rc=0} 09:40:18.505572 --- ParallelTerminationStrategy: PID 2355 died... 09:40:18.525091 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2355): Terminated: ok {rc=0} 09:40:18.570678 --- ParallelTerminationStrategy: PID 2358 died... 09:40:18.589942 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2358): Terminated: ok {rc=0} 09:40:18.676504 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2402 encryption FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 4g:srsenb-rftype@zmq+srsue-rftype@zmq --------------------------------------------------------------------- 09:40:19.883352 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:40:19.888523 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Verifying 1 x enb (candidates: 2) 09:40:19.907271 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Verifying 1 x modem (candidates: 12) 09:40:19.934625 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Verifying 1 x run_node (candidates: 1) 09:40:19.963703 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Reserving 1 x enb (candidates: 2) 09:40:19.982575 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Reserving 1 x modem (candidates: 12) 09:40:20.009661 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Reserving 1 x run_node (candidates: 1) 09:40:20.519953 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: RESERVED RESOURCES for 4g: enb srsENB-zmq modem srsUE-zmq_1 run_node e55cbce541824969b492cc4fa86bdef69cf65e7d ---------------------------------------------- trial-2402 4g:srsenb-rftype@zmq+srsue-rftype@zmq handover.py ---------------------------------------------- 09:40:20.526512 tst handover.py:11: TEST_CONFIG: {} 09:40:20.732423 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 09:40:20.748524 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 09:40:20.771262 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 09:40:20.820411 tst handover.py: using MSISDN 8623 09:40:20.934168 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='8623', subscriber_id=0} 09:40:21.041594 run srsepc_10.42.42.118: Starting srsepc 09:40:22.872294 run rm-remote-dir(pid=2366): Launched 09:40:22.995042 bus /sierra_2: Setting Powered False 09:40:24.060676 run rm-remote-dir(pid=2366): Terminated: ok {rc=0} 09:40:24.525664 run mk-remote-dir(pid=2367): Launched 09:40:25.707506 run mk-remote-dir(pid=2367): Terminated: ok {rc=0} 09:40:25.999096 run scp-inst-to-remote(pid=2368): Launched 09:40:28.178044 run scp-inst-to-remote(pid=2368): Terminated: ok {rc=0} 09:40:28.513188 run rm-remote-dir(pid=2370): Launched 09:40:29.690948 run rm-remote-dir(pid=2370): Terminated: ok {rc=0} 09:40:30.028220 run mk-remote-dir(pid=2371): Launched 09:40:31.206926 run mk-remote-dir(pid=2371): Terminated: ok {rc=0} 09:40:31.500380 run scp-cfg-to-remote(pid=2372): Launched 09:40:32.682899 run scp-cfg-to-remote(pid=2372): Terminated: ok {rc=0} 09:40:32.968713 run scp-db-to-remote(pid=2374): Launched 09:40:34.145834 run scp-db-to-remote(pid=2374): Terminated: ok {rc=0} 09:40:34.277454 run srsepc_10.42.42.118: Setting RPATH for srsepc 09:40:34.586534 run patchelf(pid=2376): Launched 09:40:35.762704 run patchelf(pid=2376): Terminated: ok {rc=0} 09:40:35.894313 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 09:40:36.204382 run setcap-netadm(pid=2377): Launched 09:40:37.379458 run setcap-netadm(pid=2377): Terminated: ok {rc=0} 09:40:37.704554 run srsepc(pid=2378): Launched 09:40:37.819250 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 09:40:38.991879 run rm-remote-dir(pid=2379): Launched 09:40:39.181681 run srsepc(pid=2378): ERR: Terminated: ERROR {rc=127} [trial-2402↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=2378)] 09:40:39.326154 run srsepc(pid=2378): stdout: | (launched: 2022-12-14_09:40:37.646695) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 09:40:39.468877 run srsepc(pid=2378): stderr: | (launched: 2022-12-14_09:40:37.692453) | Connection to 10.42.42.116 closed. 09:40:39.612052 run srsepc(pid=2378): stdout: | (launched: 2022-12-14_09:40:37.646695) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 09:40:39.749785 run srsepc(pid=2378): stderr: | (launched: 2022-12-14_09:40:37.692453) | Connection to 10.42.42.116 closed. 09:40:39.913307 run rm-remote-dir(pid=2379): Terminating (SIGINT) 09:40:40.101292 run rm-remote-dir(pid=2379): Terminated: ok {rc=0} 09:40:40.237270 tst handover.py:37: ERR: Error: srsepc(pid=2378): Process ended prematurely: srsepc(pid=2378) [trial-2402↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=2378)] [trial-2402↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37] 09:40:40.247864 tst handover.py:37: Test FAILED (19.7 sec) 09:40:40.329809 run scp-back-log(pid=2380): Launched 09:40:41.410444 run scp-back-log(pid=2380): ERR: Terminated: ERROR {rc=1} [trial-2402↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=2380)] 09:40:41.473946 run scp-back-log(pid=2380): stdout: | (launched: 2022-12-14_09:40:40.296522) 09:40:41.539221 run scp-back-log(pid=2380): stderr: | (launched: 2022-12-14_09:40:40.317439) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 09:40:41.612636 tst srsepc_10.42.42.118: Error('scp-back-log(pid=2380): launch_sync(): local process exited with status 1 [trial-2402↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=2380)]') ---------------------------------------------- trial-2402 4g:srsenb-rftype@zmq+srsue-rftype@zmq iperf3_bidir.py ---------------------------------------------- 09:40:41.659640 tst iperf3_bidir.py:13: Number of physical ue: 1 09:40:41.879195 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 09:40:41.922347 tst iperf3_bidir.py:20: ue index0: srsue_10.42.42.116 09:40:42.142002 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 09:40:42.158252 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 09:40:42.189900 tst iperf3_bidir.py: using MSISDN 8624 09:40:42.309114 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='8624', subscriber_id=0} 09:40:42.423287 run srsepc_10.42.42.118: Starting srsepc 09:40:43.094262 run rm-remote-dir(pid=2382): Launched 09:40:44.285906 run rm-remote-dir(pid=2382): Terminated: ok {rc=0} 09:40:44.643826 run mk-remote-dir(pid=2383): Launched 09:40:45.840499 run mk-remote-dir(pid=2383): Terminated: ok {rc=0} 09:40:46.171213 run scp-inst-to-remote(pid=2384): Launched 09:40:48.410755 run scp-inst-to-remote(pid=2384): Terminated: ok {rc=0} 09:40:48.767179 run rm-remote-dir(pid=2386): Launched 09:40:49.958084 run rm-remote-dir(pid=2386): Terminated: ok {rc=0} 09:40:50.317306 run mk-remote-dir(pid=2387): Launched 09:40:51.509806 run mk-remote-dir(pid=2387): Terminated: ok {rc=0} 09:40:51.815974 run scp-cfg-to-remote(pid=2388): Launched 09:40:53.004484 run scp-cfg-to-remote(pid=2388): Terminated: ok {rc=0} 09:40:53.308235 run scp-db-to-remote(pid=2390): Launched 09:40:54.499131 run scp-db-to-remote(pid=2390): Terminated: ok {rc=0} 09:40:54.639082 run srsepc_10.42.42.118: Setting RPATH for srsepc 09:40:54.968876 run patchelf(pid=2392): Launched 09:40:56.158866 run patchelf(pid=2392): Terminated: ok {rc=0} 09:40:56.299290 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 09:40:56.629446 run setcap-netadm(pid=2393): Launched 09:40:57.819610 run setcap-netadm(pid=2393): Terminated: ok {rc=0} 09:40:58.164463 run srsepc(pid=2394): Launched 09:40:58.289161 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 09:40:59.488499 run rm-remote-dir(pid=2395): Launched 09:40:59.678816 run srsepc(pid=2394): ERR: Terminated: ERROR {rc=127} [trial-2402↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=2394)] 09:40:59.822430 run srsepc(pid=2394): stdout: | (launched: 2022-12-14_09:40:58.103453) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 09:40:59.965303 run srsepc(pid=2394): stderr: | (launched: 2022-12-14_09:40:58.152135) | Connection to 10.42.42.116 closed. 09:41:00.108143 run srsepc(pid=2394): stdout: | (launched: 2022-12-14_09:40:58.103453) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 09:41:00.246034 run srsepc(pid=2394): stderr: | (launched: 2022-12-14_09:40:58.152135) | Connection to 10.42.42.116 closed. 09:41:00.410008 run rm-remote-dir(pid=2395): Terminating (SIGINT) 09:41:00.597507 run rm-remote-dir(pid=2395): Terminated: ok {rc=0} 09:41:00.733281 tst iperf3_bidir.py:42: ERR: Error: srsepc(pid=2394): Process ended prematurely: srsepc(pid=2394) [trial-2402↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=2394)] [trial-2402↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42] 09:41:00.744305 tst iperf3_bidir.py:42: Test FAILED (19.1 sec) 09:41:00.828730 run scp-back-log(pid=2396): Launched 09:41:01.920118 run scp-back-log(pid=2396): ERR: Terminated: ERROR {rc=1} [trial-2402↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=2396)] 09:41:02.004861 run scp-back-log(pid=2396): stdout: | (launched: 2022-12-14_09:41:00.793058) 09:41:02.088562 run scp-back-log(pid=2396): stderr: | (launched: 2022-12-14_09:41:00.813746) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 09:41:02.181994 tst srsepc_10.42.42.118: Error('scp-back-log(pid=2396): launch_sync(): local process exited with status 1 [trial-2402↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=2396)]') ---------------------------------------------- trial-2402 4g:srsenb-rftype@zmq+srsue-rftype@zmq iperf3_dl.py ---------------------------------------------- 09:41:02.232303 tst iperf3_dl.py:13: Number of physical ue: 1 09:41:02.455804 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 09:41:02.501444 tst iperf3_dl.py:20: ue index0: srsue_10.42.42.116 09:41:02.718597 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 09:41:02.734968 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 09:41:02.768362 tst iperf3_dl.py: using MSISDN 8625 09:41:02.887957 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='8625', subscriber_id=0} 09:41:03.002923 run srsepc_10.42.42.118: Starting srsepc 09:41:03.671462 run rm-remote-dir(pid=2398): Launched 09:41:04.859927 run rm-remote-dir(pid=2398): Terminated: ok {rc=0} 09:41:05.194980 run mk-remote-dir(pid=2399): Launched 09:41:06.371429 run mk-remote-dir(pid=2399): Terminated: ok {rc=0} 09:41:06.657591 run scp-inst-to-remote(pid=2400): Launched 09:41:08.833768 run scp-inst-to-remote(pid=2400): Terminated: ok {rc=0} 09:41:09.166621 run rm-remote-dir(pid=2402): Launched 09:41:10.344572 run rm-remote-dir(pid=2402): Terminated: ok {rc=0} 09:41:10.680731 run mk-remote-dir(pid=2403): Launched 09:41:11.858140 run mk-remote-dir(pid=2403): Terminated: ok {rc=0} 09:41:12.143690 run scp-cfg-to-remote(pid=2404): Launched 09:41:13.320513 run scp-cfg-to-remote(pid=2404): Terminated: ok {rc=0} 09:41:13.603858 run scp-db-to-remote(pid=2406): Launched 09:41:14.778250 run scp-db-to-remote(pid=2406): Terminated: ok {rc=0} 09:41:14.908303 run srsepc_10.42.42.118: Setting RPATH for srsepc 09:41:15.216322 run patchelf(pid=2408): Launched 09:41:16.422397 run patchelf(pid=2408): Terminated: ok {rc=0} 09:41:16.587903 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 09:41:16.923827 run setcap-netadm(pid=2409): Launched 09:41:18.166134 run setcap-netadm(pid=2409): Terminated: ok {rc=0} 09:41:18.511571 run srsepc(pid=2410): Launched 09:41:18.635617 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 09:41:19.816786 run rm-remote-dir(pid=2411): Launched 09:41:20.006329 run srsepc(pid=2410): ERR: Terminated: ERROR {rc=127} [trial-2402↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=2410)] 09:41:20.150115 run srsepc(pid=2410): stdout: | (launched: 2022-12-14_09:41:18.450341) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 09:41:20.293607 run srsepc(pid=2410): stderr: | (launched: 2022-12-14_09:41:18.499115) | Connection to 10.42.42.116 closed. 09:41:20.436684 run srsepc(pid=2410): stdout: | (launched: 2022-12-14_09:41:18.450341) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 09:41:20.575108 run srsepc(pid=2410): stderr: | (launched: 2022-12-14_09:41:18.499115) | Connection to 10.42.42.116 closed. 09:41:20.738776 run rm-remote-dir(pid=2411): Terminating (SIGINT) 09:41:20.926845 run rm-remote-dir(pid=2411): Terminated: ok {rc=0} 09:41:21.062555 tst iperf3_dl.py:42: ERR: Error: srsepc(pid=2410): Process ended prematurely: srsepc(pid=2410) [trial-2402↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=2410)] [trial-2402↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42] 09:41:21.073527 tst iperf3_dl.py:42: Test FAILED (18.8 sec) 09:41:21.155265 run scp-back-log(pid=2412): Launched 09:41:22.238159 run scp-back-log(pid=2412): ERR: Terminated: ERROR {rc=1} [trial-2402↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=2412)] 09:41:22.302294 run scp-back-log(pid=2412): stdout: | (launched: 2022-12-14_09:41:21.122134) 09:41:22.368195 run scp-back-log(pid=2412): stderr: | (launched: 2022-12-14_09:41:21.142863) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 09:41:22.441838 tst srsepc_10.42.42.118: Error('scp-back-log(pid=2412): launch_sync(): local process exited with status 1 [trial-2402↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=2412)]') ---------------------------------------------- trial-2402 4g:srsenb-rftype@zmq+srsue-rftype@zmq iperf3_ul.py ---------------------------------------------- 09:41:22.489366 tst iperf3_ul.py:13: Number of physical ue: 1 09:41:22.709274 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 09:41:22.752543 tst iperf3_ul.py:20: ue index0: srsue_10.42.42.116 09:41:22.970989 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 09:41:22.987575 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 09:41:23.021459 tst iperf3_ul.py: using MSISDN 8626 09:41:23.135121 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='8626', subscriber_id=0} 09:41:23.241723 run srsepc_10.42.42.118: Starting srsepc 09:41:23.868822 run rm-remote-dir(pid=2414): Launched 09:41:25.047418 run rm-remote-dir(pid=2414): Terminated: ok {rc=0} 09:41:25.383688 run mk-remote-dir(pid=2415): Launched 09:41:26.563694 run mk-remote-dir(pid=2415): Terminated: ok {rc=0} 09:41:26.850234 run scp-inst-to-remote(pid=2416): Launched 09:41:29.027672 run scp-inst-to-remote(pid=2416): Terminated: ok {rc=0} 09:41:29.361154 run rm-remote-dir(pid=2418): Launched 09:41:30.539175 run rm-remote-dir(pid=2418): Terminated: ok {rc=0} 09:41:30.902489 run mk-remote-dir(pid=2419): Launched 09:41:32.179056 run mk-remote-dir(pid=2419): Terminated: ok {rc=0} 09:41:32.477880 run scp-cfg-to-remote(pid=2420): Launched 09:41:33.654221 run scp-cfg-to-remote(pid=2420): Terminated: ok {rc=0} 09:41:33.938743 run scp-db-to-remote(pid=2422): Launched 09:41:35.114354 run scp-db-to-remote(pid=2422): Terminated: ok {rc=0} 09:41:35.245836 run srsepc_10.42.42.118: Setting RPATH for srsepc 09:41:35.553945 run patchelf(pid=2424): Launched 09:41:36.730999 run patchelf(pid=2424): Terminated: ok {rc=0} 09:41:36.861931 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 09:41:37.170812 run setcap-netadm(pid=2425): Launched 09:41:38.347550 run setcap-netadm(pid=2425): Terminated: ok {rc=0} 09:41:38.671625 run srsepc(pid=2426): Launched 09:41:38.787179 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 09:41:39.897502 run rm-remote-dir(pid=2427): Launched 09:41:40.074813 run srsepc(pid=2426): ERR: Terminated: ERROR {rc=127} [trial-2402↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=2426)] 09:41:40.209304 run srsepc(pid=2426): stdout: | (launched: 2022-12-14_09:41:38.613173) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 09:41:40.344132 run srsepc(pid=2426): stderr: | (launched: 2022-12-14_09:41:38.659294) | Connection to 10.42.42.116 closed. 09:41:40.478951 run srsepc(pid=2426): stdout: | (launched: 2022-12-14_09:41:38.613173) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 09:41:40.608430 run srsepc(pid=2426): stderr: | (launched: 2022-12-14_09:41:38.659294) | Connection to 10.42.42.116 closed. 09:41:40.762786 run rm-remote-dir(pid=2427): Terminating (SIGINT) 09:41:40.940023 run rm-remote-dir(pid=2427): Terminated: ok {rc=0} 09:41:41.068033 tst iperf3_ul.py:42: ERR: Error: srsepc(pid=2426): Process ended prematurely: srsepc(pid=2426) [trial-2402↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=2426)] [trial-2402↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42] 09:41:41.078059 tst iperf3_ul.py:42: Test FAILED (18.6 sec) 09:41:41.157074 run scp-back-log(pid=2428): Launched 09:41:42.233105 run scp-back-log(pid=2428): ERR: Terminated: ERROR {rc=1} [trial-2402↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=2428)] 09:41:42.293602 run scp-back-log(pid=2428): stdout: | (launched: 2022-12-14_09:41:41.124568) 09:41:42.355687 run scp-back-log(pid=2428): stderr: | (launched: 2022-12-14_09:41:41.144574) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 09:41:42.425642 tst srsepc_10.42.42.118: Error('scp-back-log(pid=2428): launch_sync(): local process exited with status 1 [trial-2402↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=2428)]') ---------------------------------------------- trial-2402 4g:srsenb-rftype@zmq+srsue-rftype@zmq ping.py ---------------------------------------------- 09:41:42.470754 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 09:41:42.487415 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 09:41:42.509986 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 09:41:42.563192 tst ping.py: using MSISDN 8627 09:41:42.678540 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='8627', subscriber_id=0} 09:41:42.786112 run srsepc_10.42.42.118: Starting srsepc 09:41:43.415391 run rm-remote-dir(pid=2430): Launched 09:41:44.595176 run rm-remote-dir(pid=2430): Terminated: ok {rc=0} 09:41:44.931293 run mk-remote-dir(pid=2431): Launched 09:41:46.123894 run mk-remote-dir(pid=2431): Terminated: ok {rc=0} 09:41:46.506768 run scp-inst-to-remote(pid=2432): Launched 09:41:48.725825 run scp-inst-to-remote(pid=2432): Terminated: ok {rc=0} 09:41:49.059254 run rm-remote-dir(pid=2434): Launched 09:41:50.237658 run rm-remote-dir(pid=2434): Terminated: ok {rc=0} 09:41:50.573674 run mk-remote-dir(pid=2435): Launched 09:41:51.750691 run mk-remote-dir(pid=2435): Terminated: ok {rc=0} 09:41:52.036550 run scp-cfg-to-remote(pid=2437): Launched 09:41:53.213916 run scp-cfg-to-remote(pid=2437): Terminated: ok {rc=0} 09:41:53.517244 run scp-db-to-remote(pid=2439): Launched 09:41:54.708088 run scp-db-to-remote(pid=2439): Terminated: ok {rc=0} 09:41:54.847643 run srsepc_10.42.42.118: Setting RPATH for srsepc 09:41:55.177482 run patchelf(pid=2441): Launched 09:41:56.366267 run patchelf(pid=2441): Terminated: ok {rc=0} 09:41:56.506604 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 09:41:56.836853 run setcap-netadm(pid=2442): Launched 09:41:58.025998 run setcap-netadm(pid=2442): Terminated: ok {rc=0} 09:41:58.374618 run srsepc(pid=2443): Launched 09:41:58.499270 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 09:41:59.683194 run rm-remote-dir(pid=2444): Launched 09:41:59.871505 run srsepc(pid=2443): ERR: Terminated: ERROR {rc=127} [trial-2402↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=2443)] 09:42:00.015274 run srsepc(pid=2443): stdout: | (launched: 2022-12-14_09:41:58.310917) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 09:42:00.158195 run srsepc(pid=2443): stderr: | (launched: 2022-12-14_09:41:58.362312) | Connection to 10.42.42.116 closed. 09:42:00.301443 run srsepc(pid=2443): stdout: | (launched: 2022-12-14_09:41:58.310917) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 09:42:00.439458 run srsepc(pid=2443): stderr: | (launched: 2022-12-14_09:41:58.362312) | Connection to 10.42.42.116 closed. 09:42:00.602920 run rm-remote-dir(pid=2444): Terminating (SIGINT) 09:42:00.790854 run rm-remote-dir(pid=2444): Terminated: ok {rc=0} 09:42:00.972679 tst ping.py:16: ERR: Error: srsepc(pid=2443): Process ended prematurely: srsepc(pid=2443) [trial-2402↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=2443)] [trial-2402↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16] 09:42:00.986826 tst ping.py:16: Test FAILED (18.5 sec) 09:42:01.099010 run scp-back-log(pid=2450): Launched 09:42:02.211725 run scp-back-log(pid=2450): ERR: Terminated: ERROR {rc=1} [trial-2402↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=2450)] 09:42:02.275811 run scp-back-log(pid=2450): stdout: | (launched: 2022-12-14_09:42:01.066470) 09:42:02.341232 run scp-back-log(pid=2450): stderr: | (launched: 2022-12-14_09:42:01.087207) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 09:42:02.412457 tst srsepc_10.42.42.118: Error('scp-back-log(pid=2450): launch_sync(): local process exited with status 1 [trial-2402↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=2450)]') ---------------------------------------------- trial-2402 4g:srsenb-rftype@zmq+srsue-rftype@zmq rrc_idle_mo_ping.py ---------------------------------------------- 09:42:02.457676 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 09:42:02.474930 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 09:42:02.498559 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 09:42:02.550630 tst rrc_idle_mo_ping.py: using MSISDN 8628 09:42:02.664333 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='8628', subscriber_id=0} 09:42:02.771531 run srsepc_10.42.42.118: Starting srsepc 09:42:03.402206 run rm-remote-dir(pid=2452): Launched 09:42:04.623529 run rm-remote-dir(pid=2452): Terminated: ok {rc=0} 09:42:04.981361 run mk-remote-dir(pid=2453): Launched 09:42:06.171314 run mk-remote-dir(pid=2453): Terminated: ok {rc=0} 09:42:06.477073 run scp-inst-to-remote(pid=2454): Launched 09:42:08.666413 run scp-inst-to-remote(pid=2454): Terminated: ok {rc=0} 09:42:09.010457 run rm-remote-dir(pid=2456): Launched 09:42:10.187284 run rm-remote-dir(pid=2456): Terminated: ok {rc=0} 09:42:10.523327 run mk-remote-dir(pid=2457): Launched 09:42:11.701421 run mk-remote-dir(pid=2457): Terminated: ok {rc=0} 09:42:11.987489 run scp-cfg-to-remote(pid=2458): Launched 09:42:13.162149 run scp-cfg-to-remote(pid=2458): Terminated: ok {rc=0} 09:42:13.446498 run scp-db-to-remote(pid=2460): Launched 09:42:14.621883 run scp-db-to-remote(pid=2460): Terminated: ok {rc=0} 09:42:14.752593 run srsepc_10.42.42.118: Setting RPATH for srsepc 09:42:15.061634 run patchelf(pid=2462): Launched 09:42:16.255322 run patchelf(pid=2462): Terminated: ok {rc=0} 09:42:16.430979 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 09:42:16.805914 run setcap-netadm(pid=2463): Launched 09:42:18.067940 run setcap-netadm(pid=2463): Terminated: ok {rc=0} 09:42:18.412215 run srsepc(pid=2464): Launched 09:42:18.536465 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 09:42:19.723149 run rm-remote-dir(pid=2465): Launched 09:42:19.913131 run srsepc(pid=2464): ERR: Terminated: ERROR {rc=127} [trial-2402↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=2464)] 09:42:20.056513 run srsepc(pid=2464): stdout: | (launched: 2022-12-14_09:42:18.351008) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 09:42:20.199636 run srsepc(pid=2464): stderr: | (launched: 2022-12-14_09:42:18.399794) | Connection to 10.42.42.116 closed. 09:42:20.342921 run srsepc(pid=2464): stdout: | (launched: 2022-12-14_09:42:18.351008) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 09:42:20.480652 run srsepc(pid=2464): stderr: | (launched: 2022-12-14_09:42:18.399794) | Connection to 10.42.42.116 closed. 09:42:20.643727 run rm-remote-dir(pid=2465): Terminating (SIGINT) 09:42:20.831615 run rm-remote-dir(pid=2465): Terminated: ok {rc=0} 09:42:20.967044 tst rrc_idle_mo_ping.py:16: ERR: Error: srsepc(pid=2464): Process ended prematurely: srsepc(pid=2464) [trial-2402↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=2464)] [trial-2402↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16] 09:42:20.977670 tst rrc_idle_mo_ping.py:16: Test FAILED (18.5 sec) 09:42:21.059129 run scp-back-log(pid=2466): Launched 09:42:22.141084 run scp-back-log(pid=2466): ERR: Terminated: ERROR {rc=1} [trial-2402↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=2466)] 09:42:22.204882 run scp-back-log(pid=2466): stdout: | (launched: 2022-12-14_09:42:21.026175) 09:42:22.270426 run scp-back-log(pid=2466): stderr: | (launched: 2022-12-14_09:42:21.046803) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 09:42:22.344982 tst srsepc_10.42.42.118: Error('scp-back-log(pid=2466): launch_sync(): local process exited with status 1 [trial-2402↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=2466)]') ---------------------------------------------- trial-2402 4g:srsenb-rftype@zmq+srsue-rftype@zmq rrc_idle_mt_ping.py ---------------------------------------------- 09:42:22.392808 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 09:42:22.410678 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 09:42:22.434742 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 09:42:22.487369 tst rrc_idle_mt_ping.py: using MSISDN 8629 09:42:22.610858 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='8629', subscriber_id=0} 09:42:22.725605 run srsepc_10.42.42.118: Starting srsepc 09:42:23.396519 run rm-remote-dir(pid=2468): Launched 09:42:24.589505 run rm-remote-dir(pid=2468): Terminated: ok {rc=0} 09:42:24.948341 run mk-remote-dir(pid=2469): Launched 09:42:26.141547 run mk-remote-dir(pid=2469): Terminated: ok {rc=0} 09:42:26.447703 run scp-inst-to-remote(pid=2470): Launched 09:42:28.639180 run scp-inst-to-remote(pid=2470): Terminated: ok {rc=0} 09:42:28.996226 run rm-remote-dir(pid=2472): Launched 09:42:30.188267 run rm-remote-dir(pid=2472): Terminated: ok {rc=0} 09:42:30.547119 run mk-remote-dir(pid=2473): Launched 09:42:31.738936 run mk-remote-dir(pid=2473): Terminated: ok {rc=0} 09:42:32.046477 run scp-cfg-to-remote(pid=2474): Launched 09:42:33.322054 run scp-cfg-to-remote(pid=2474): Terminated: ok {rc=0} 09:42:33.626550 run scp-db-to-remote(pid=2476): Launched 09:42:34.816020 run scp-db-to-remote(pid=2476): Terminated: ok {rc=0} 09:42:34.955720 run srsepc_10.42.42.118: Setting RPATH for srsepc 09:42:35.286953 run patchelf(pid=2478): Launched 09:42:36.477105 run patchelf(pid=2478): Terminated: ok {rc=0} 09:42:36.616889 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 09:42:36.947455 run setcap-netadm(pid=2479): Launched 09:42:38.139395 run setcap-netadm(pid=2479): Terminated: ok {rc=0} 09:42:38.487233 run srsepc(pid=2480): Launched 09:42:38.611589 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 09:42:39.800866 run rm-remote-dir(pid=2481): Launched 09:42:39.988878 run srsepc(pid=2480): ERR: Terminated: ERROR {rc=127} [trial-2402↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=2480)] 09:42:40.132633 run srsepc(pid=2480): stdout: | (launched: 2022-12-14_09:42:38.425797) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 09:42:40.275738 run srsepc(pid=2480): stderr: | (launched: 2022-12-14_09:42:38.474771) | Connection to 10.42.42.116 closed. 09:42:40.419168 run srsepc(pid=2480): stdout: | (launched: 2022-12-14_09:42:38.425797) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 09:42:40.556474 run srsepc(pid=2480): stderr: | (launched: 2022-12-14_09:42:38.474771) | Connection to 10.42.42.116 closed. 09:42:40.719428 run rm-remote-dir(pid=2481): Terminating (SIGINT) 09:42:40.906867 run rm-remote-dir(pid=2481): Terminated: ok {rc=0} 09:42:41.042283 tst rrc_idle_mt_ping.py:16: ERR: Error: srsepc(pid=2480): Process ended prematurely: srsepc(pid=2480) [trial-2402↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=2480)] [trial-2402↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16] 09:42:41.052931 tst rrc_idle_mt_ping.py:16: Test FAILED (18.7 sec) 09:42:41.135648 run scp-back-log(pid=2482): Launched 09:42:42.218167 run scp-back-log(pid=2482): ERR: Terminated: ERROR {rc=1} [trial-2402↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=2482)] 09:42:42.281880 run scp-back-log(pid=2482): stdout: | (launched: 2022-12-14_09:42:41.101818) 09:42:42.347470 run scp-back-log(pid=2482): stderr: | (launched: 2022-12-14_09:42:41.122824) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 09:42:42.421136 tst srsepc_10.42.42.118: Error('scp-back-log(pid=2482): launch_sync(): local process exited with status 1 [trial-2402↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=2482)]') --------------------------------------------------------------------- trial-2402 4g:srsenb-rftype@zmq+srsue-rftype@zmq FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 handover_2G:nanobts+bts1-oc2g --------------------------------------------------------------------- 09:42:42.555493 tst handover_2G:nanobts+bts1-oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:42:42.560924 tst handover_2G:nanobts+bts1-oc2g: Verifying 2 x bts (candidates: 11) 09:42:42.603013 tst handover_2G:nanobts+bts1-oc2g: Verifying 6 x ip_address (candidates: 9) 09:42:42.630287 tst handover_2G:nanobts+bts1-oc2g: Verifying 2 x modem (candidates: 12) 09:42:42.683981 tst handover_2G:nanobts+bts1-oc2g: Reserving 2 x bts (candidates: 11) 09:42:42.728474 tst handover_2G:nanobts+bts1-oc2g: Reserving 6 x ip_address (candidates: 9) 09:42:42.755611 tst handover_2G:nanobts+bts1-oc2g: Reserving 2 x modem (candidates: 12) 09:42:43.303298 tst handover_2G:nanobts+bts1-oc2g: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2402 handover_2G:nanobts+bts1-oc2g handover.py ---------------------------------------------- 09:42:43.309198 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 09:42:43.320541 tst handover_2G:nanobts+bts1-oc2g: Using 1 x bts (candidates: 2) 09:42:43.358717 tst handover.py: using LAC 40046 09:42:43.489525 tst handover.py: using RAC 11 09:42:43.611781 tst handover.py: using CellId 40046 09:42:43.733723 tst handover.py: using BVCI 40047 09:42:43.846066 tst handover_2G:nanobts+bts1-oc2g: Using 1 x bts (candidates: 2) 09:42:43.881659 tst handover.py: using LAC 40047 09:42:44.001730 tst handover.py: using RAC 12 09:42:44.130877 tst handover.py: using CellId 40047 09:42:44.257969 tst handover.py: using BVCI 40048 09:42:44.376707 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 09:42:44.387958 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 09:42:44.399147 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 09:42:44.410373 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 09:42:44.422212 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 09:42:44.433789 tst handover_2G:nanobts+bts1-oc2g: Using 1 x modem (candidates: 2) 09:42:44.551991 tst handover_2G:nanobts+bts1-oc2g: Using 1 x modem (candidates: 2) 09:42:44.668102 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:42:45.170013 run create_hlr_db(pid=2487): Launched 09:42:46.362251 run create_hlr_db(pid=2487): Terminated: ok {rc=0} 09:42:46.711078 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2489): Launched 09:42:47.052334 run osmo-hlr_10.42.42.2(pid=2490): Launched 09:42:47.175174 run osmo-stp_10.42.42.5: Starting osmo-stp 09:42:47.741074 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2492): Launched 09:42:48.066449 run osmo-stp_10.42.42.5(pid=2493): Launched 09:42:48.189650 run osmo-msc_10.42.42.6: Starting osmo-msc 09:42:48.775823 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2495): Launched 09:42:49.101987 run osmo-msc_10.42.42.6(pid=2496): Launched 09:42:49.283420 run osmo-stp_10.42.42.5(pid=2493): ERR: Terminated: ERROR {rc=1} [trial-2402↪handover_2G:nanobts+bts1-oc2g↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2493)] 09:42:49.419574 run osmo-stp_10.42.42.5(pid=2493): stdout: | (launched: 2022-12-14_09:42:48.005323) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:42:49.556157 run osmo-stp_10.42.42.5(pid=2493): stderr: | 20221214094248198 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214094248199 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214094248199 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214094248199 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214094248201 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214094248202 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214094248202 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:42:49.691849 run osmo-stp_10.42.42.5(pid=2493): stdout: | (launched: 2022-12-14_09:42:48.005323) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:42:49.819805 run osmo-stp_10.42.42.5(pid=2493): stderr: | 20221214094248198 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214094248199 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214094248199 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214094248199 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214094248201 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214094248202 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214094248202 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:42:49.972841 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=2493): Process ended prematurely: osmo-stp_10.42.42.5(pid=2493) [trial-2402↪handover_2G:nanobts+bts1-oc2g↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2493)] [trial-2402↪handover_2G:nanobts+bts1-oc2g↪handover.py:18] 09:42:49.982038 tst handover.py:18: Test FAILED (6.7 sec) 09:42:50.009525 run osmo-hlr_10.42.42.2(pid=2490): ERR: Terminated: ERROR {rc=237} [trial-2402↪handover_2G:nanobts+bts1-oc2g↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2490)] 09:42:50.060650 run osmo-hlr_10.42.42.2(pid=2490): stdout: | (launched: 2022-12-14_09:42:46.990235) 09:42:50.113308 run osmo-hlr_10.42.42.2(pid=2490): stderr: | 20221214094247271 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214094247271 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214094247271 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214094247271 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214094247271 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214094247272 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214094247284 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/handover_2G:nanobts+bts1-oc2g/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214094247292 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214094247292 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214094247292 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:42:50.186687 run osmo-msc_10.42.42.6(pid=2496): ERR: Terminated: ERROR {rc=2} [trial-2402↪handover_2G:nanobts+bts1-oc2g↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2496)] 09:42:50.236909 run osmo-msc_10.42.42.6(pid=2496): stdout: | (launched: 2022-12-14_09:42:49.040917) 09:42:50.289279 run osmo-msc_10.42.42.6(pid=2496): stderr: | 20221214094249365 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214094249365 DLGLOBAL DEBUG validating counter group 0x7fa2ebb5bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214094249365 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214094249365 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214094249365 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214094249366 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214094249367 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214094249368 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214094249368 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214094249368 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:42:50.342350 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2489): Terminating (SIGTERM) 09:42:50.384315 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2492): Terminating (SIGTERM) 09:42:50.426471 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2495): Terminating (SIGTERM) 09:42:50.468711 --- ParallelTerminationStrategy: PID 2489 died... 09:42:50.489382 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2489): Terminated: ok {rc=0} 09:42:50.536201 --- ParallelTerminationStrategy: PID 2492 died... 09:42:50.556628 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2492): Terminated: ok {rc=0} 09:42:50.603223 --- ParallelTerminationStrategy: PID 2495 died... 09:42:50.623279 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2495): Terminated: ok {rc=0} 09:42:50.711471 bus /sierra_3: Setting Powered False 09:42:51.809846 bus /sierra_3: Setting Powered False 09:42:52.925425 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2402 handover_2G:nanobts+bts1-oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 handover_2G:nanobts+bts1-octphy --------------------------------------------------------------------- 09:42:54.171745 tst handover_2G:nanobts+bts1-octphy: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:42:54.177662 tst handover_2G:nanobts+bts1-octphy: Verifying 2 x bts (candidates: 11) 09:42:54.219021 tst handover_2G:nanobts+bts1-octphy: Verifying 6 x ip_address (candidates: 9) 09:42:54.246716 tst handover_2G:nanobts+bts1-octphy: Verifying 2 x modem (candidates: 12) 09:42:54.299390 tst handover_2G:nanobts+bts1-octphy: Reserving 2 x bts (candidates: 11) 09:42:54.340216 tst handover_2G:nanobts+bts1-octphy: Reserving 6 x ip_address (candidates: 9) 09:42:54.367637 tst handover_2G:nanobts+bts1-octphy: Reserving 2 x modem (candidates: 12) 09:42:54.922842 tst handover_2G:nanobts+bts1-octphy: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 OCTBTS 3500 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2402 handover_2G:nanobts+bts1-octphy handover.py ---------------------------------------------- 09:42:54.929049 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 09:42:54.940710 tst handover_2G:nanobts+bts1-octphy: Using 1 x bts (candidates: 2) 09:42:54.978318 tst handover.py: using LAC 40048 09:42:55.105506 tst handover.py: using RAC 13 09:42:55.232473 tst handover.py: using CellId 40048 09:42:55.359970 tst handover.py: using BVCI 40049 09:42:55.477594 tst handover_2G:nanobts+bts1-octphy: Using 1 x bts (candidates: 2) 09:42:55.512266 tst handover.py: using LAC 40049 09:42:55.641068 tst handover.py: using RAC 14 09:42:55.767169 tst handover.py: using CellId 40049 09:42:55.894557 tst handover.py: using BVCI 40050 09:42:56.011757 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 09:42:56.023099 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 09:42:56.034226 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 09:42:56.045335 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 09:42:56.056505 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 09:42:56.067661 tst handover_2G:nanobts+bts1-octphy: Using 1 x modem (candidates: 2) 09:42:56.185908 tst handover_2G:nanobts+bts1-octphy: Using 1 x modem (candidates: 2) 09:42:56.308928 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:42:56.751630 run create_hlr_db(pid=2501): Launched 09:42:56.875205 bus /sierra_2: Setting Powered False 09:42:57.935390 run create_hlr_db(pid=2501): Terminated: ok {rc=0} 09:42:58.331487 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2503): Launched 09:42:58.634806 run osmo-hlr_10.42.42.2(pid=2504): Launched 09:42:58.749830 run osmo-stp_10.42.42.5: Starting osmo-stp 09:42:59.259735 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2506): Launched 09:42:59.563892 run osmo-stp_10.42.42.5(pid=2507): Launched 09:42:59.678771 run osmo-msc_10.42.42.6: Starting osmo-msc 09:43:00.201657 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2509): Launched 09:43:00.505270 run osmo-msc_10.42.42.6(pid=2510): Launched 09:43:00.674587 run osmo-stp_10.42.42.5(pid=2507): ERR: Terminated: ERROR {rc=1} [trial-2402↪handover_2G:nanobts+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2507)] 09:43:00.803655 run osmo-stp_10.42.42.5(pid=2507): stdout: | (launched: 2022-12-14_09:42:59.506848) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:43:00.966473 run osmo-stp_10.42.42.5(pid=2507): stderr: | 20221214094259677 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214094259677 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214094259677 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214094259678 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214094259678 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214094259678 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214094259678 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:43:01.098798 run osmo-stp_10.42.42.5(pid=2507): stdout: | (launched: 2022-12-14_09:42:59.506848) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:43:01.222572 run osmo-stp_10.42.42.5(pid=2507): stderr: | 20221214094259677 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214094259677 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214094259677 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214094259678 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214094259678 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214094259678 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214094259678 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:43:01.369947 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=2507): Process ended prematurely: osmo-stp_10.42.42.5(pid=2507) [trial-2402↪handover_2G:nanobts+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2507)] [trial-2402↪handover_2G:nanobts+bts1-octphy↪handover.py:18] 09:43:01.379355 tst handover.py:18: Test FAILED (6.4 sec) 09:43:01.406511 run osmo-hlr_10.42.42.2(pid=2504): ERR: Terminated: ERROR {rc=237} [trial-2402↪handover_2G:nanobts+bts1-octphy↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2504)] 09:43:01.457055 run osmo-hlr_10.42.42.2(pid=2504): stdout: | (launched: 2022-12-14_09:42:58.577502) 09:43:01.507861 run osmo-hlr_10.42.42.2(pid=2504): stderr: | 20221214094258756 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214094258756 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214094258756 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214094258756 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214094258756 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214094258757 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214094258769 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/handover_2G:nanobts+bts1-octphy/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214094258778 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214094258778 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214094258778 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:43:01.579431 run osmo-msc_10.42.42.6(pid=2510): ERR: Terminated: ERROR {rc=2} [trial-2402↪handover_2G:nanobts+bts1-octphy↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2510)] 09:43:01.628251 run osmo-msc_10.42.42.6(pid=2510): stdout: | (launched: 2022-12-14_09:43:00.447655) 09:43:01.679341 run osmo-msc_10.42.42.6(pid=2510): stderr: | 20221214094300720 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214094300720 DLGLOBAL DEBUG validating counter group 0x7fcec1acac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214094300720 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214094300720 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214094300720 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214094300720 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214094300722 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214094300722 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214094300722 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214094300723 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:43:01.731692 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2503): Terminating (SIGTERM) 09:43:01.773246 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2506): Terminating (SIGTERM) 09:43:01.815044 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2509): Terminating (SIGTERM) 09:43:01.858520 --- ParallelTerminationStrategy: PID 2503 died... 09:43:01.879223 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2503): Terminated: ok {rc=0} 09:43:01.925062 --- ParallelTerminationStrategy: PID 2506 died... 09:43:01.945790 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2506): Terminated: ok {rc=0} 09:43:01.991350 --- ParallelTerminationStrategy: PID 2509 died... 09:43:02.011847 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2509): Terminated: ok {rc=0} 09:43:02.097964 bus /sierra_3: Setting Powered False 09:43:03.192466 bus /sierra_3: Setting Powered False 09:43:04.304522 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2402 handover_2G:nanobts+bts1-octphy FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 handover_2G:nanobts+bts1-trx-lms --------------------------------------------------------------------- 09:43:05.548291 tst handover_2G:nanobts+bts1-trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:43:05.554340 tst handover_2G:nanobts+bts1-trx-lms: Verifying 2 x bts (candidates: 11) 09:43:05.608905 tst handover_2G:nanobts+bts1-trx-lms: Verifying 6 x ip_address (candidates: 9) 09:43:05.636191 tst handover_2G:nanobts+bts1-trx-lms: Verifying 2 x modem (candidates: 12) 09:43:05.688703 tst handover_2G:nanobts+bts1-trx-lms: Reserving 2 x bts (candidates: 11) 09:43:05.743314 tst handover_2G:nanobts+bts1-trx-lms: Reserving 6 x ip_address (candidates: 9) 09:43:05.770545 tst handover_2G:nanobts+bts1-trx-lms: Reserving 2 x modem (candidates: 12) 09:43:06.323025 tst handover_2G:nanobts+bts1-trx-lms: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2402 handover_2G:nanobts+bts1-trx-lms handover.py ---------------------------------------------- 09:43:06.328374 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 09:43:06.340083 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x bts (candidates: 2) 09:43:06.380189 tst handover.py: using LAC 40050 09:43:06.508581 tst handover.py: using RAC 15 09:43:06.635757 tst handover.py: using CellId 40050 09:43:06.762736 tst handover.py: using BVCI 40051 09:43:06.882049 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x bts (candidates: 2) 09:43:06.931973 tst handover.py: using LAC 40051 09:43:07.052668 tst handover.py: using RAC 16 09:43:07.171489 tst handover.py: using CellId 40051 09:43:07.305398 tst handover.py: using BVCI 40052 09:43:07.421943 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 09:43:07.433022 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 09:43:07.443808 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 09:43:07.454710 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 09:43:07.466130 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 09:43:07.477506 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x modem (candidates: 2) 09:43:07.598216 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x modem (candidates: 2) 09:43:07.715796 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:43:08.189438 run create_hlr_db(pid=2515): Launched 09:43:08.319824 bus /sierra_2: Setting Powered False 09:43:09.384213 run create_hlr_db(pid=2515): Terminated: ok {rc=0} 09:43:09.790302 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2517): Launched 09:43:10.094974 run osmo-hlr_10.42.42.2(pid=2518): Launched 09:43:10.210090 run osmo-stp_10.42.42.5: Starting osmo-stp 09:43:10.722958 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2520): Launched 09:43:11.026378 run osmo-stp_10.42.42.5(pid=2521): Launched 09:43:11.140931 run osmo-msc_10.42.42.6: Starting osmo-msc 09:43:11.662837 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2523): Launched 09:43:11.966612 run osmo-msc_10.42.42.6(pid=2524): Launched 09:43:12.135706 run osmo-stp_10.42.42.5(pid=2521): ERR: Terminated: ERROR {rc=1} [trial-2402↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2521)] 09:43:12.263940 run osmo-stp_10.42.42.5(pid=2521): stdout: | (launched: 2022-12-14_09:43:10.968755) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:43:12.392477 run osmo-stp_10.42.42.5(pid=2521): stderr: | 20221214094311140 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214094311140 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214094311141 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214094311141 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214094311142 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214094311142 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214094311142 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:43:12.519026 run osmo-stp_10.42.42.5(pid=2521): stdout: | (launched: 2022-12-14_09:43:10.968755) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:43:12.639152 run osmo-stp_10.42.42.5(pid=2521): stderr: | 20221214094311140 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214094311140 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214094311141 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214094311141 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214094311142 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214094311142 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214094311142 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:43:12.783277 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=2521): Process ended prematurely: osmo-stp_10.42.42.5(pid=2521) [trial-2402↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2521)] [trial-2402↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18] 09:43:12.791514 tst handover.py:18: Test FAILED (6.5 sec) 09:43:12.817185 run osmo-hlr_10.42.42.2(pid=2518): ERR: Terminated: ERROR {rc=237} [trial-2402↪handover_2G:nanobts+bts1-trx-lms↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2518)] 09:43:12.864685 run osmo-hlr_10.42.42.2(pid=2518): stdout: | (launched: 2022-12-14_09:43:10.037385) 09:43:12.913856 run osmo-hlr_10.42.42.2(pid=2518): stderr: | 20221214094310216 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214094310216 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214094310216 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214094310216 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214094310216 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214094310216 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214094310228 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/handover_2G:nanobts+bts1-trx-lms/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214094310236 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214094310237 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214094310237 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:43:12.982660 run osmo-msc_10.42.42.6(pid=2524): ERR: Terminated: ERROR {rc=2} [trial-2402↪handover_2G:nanobts+bts1-trx-lms↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2524)] 09:43:13.029589 run osmo-msc_10.42.42.6(pid=2524): stdout: | (launched: 2022-12-14_09:43:11.909333) 09:43:13.078462 run osmo-msc_10.42.42.6(pid=2524): stderr: | 20221214094312180 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214094312180 DLGLOBAL DEBUG validating counter group 0x7f3831c67c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214094312181 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214094312181 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214094312181 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214094312181 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214094312183 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214094312183 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214094312183 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214094312183 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:43:13.127630 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2517): Terminating (SIGTERM) 09:43:13.167292 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2520): Terminating (SIGTERM) 09:43:13.206596 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2523): Terminating (SIGTERM) 09:43:13.246060 --- ParallelTerminationStrategy: PID 2517 died... 09:43:13.265331 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2517): Terminated: ok {rc=0} 09:43:13.308660 --- ParallelTerminationStrategy: PID 2520 died... 09:43:13.327334 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2520): Terminated: ok {rc=0} 09:43:13.370744 --- ParallelTerminationStrategy: PID 2523 died... 09:43:13.389516 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2523): Terminated: ok {rc=0} 09:43:13.474984 bus /sierra_3: Setting Powered False 09:43:14.570849 bus /sierra_3: Setting Powered False 09:43:15.681331 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2402 handover_2G:nanobts+bts1-trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 handover_2G:nanobts+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 09:43:16.985594 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:43:16.998281 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 09:43:17.063789 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 09:43:17.091350 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 09:43:17.147142 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 09:43:17.201202 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 09:43:17.228847 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 09:43:17.777674 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2402 handover_2G:nanobts+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 09:43:17.783051 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 09:43:17.794613 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 09:43:17.834247 tst handover.py: using LAC 40052 09:43:17.961923 tst handover.py: using RAC 17 09:43:18.090522 tst handover.py: using CellId 40052 09:43:18.218604 tst handover.py: using BVCI 40053 09:43:18.337277 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 09:43:18.382830 tst handover.py: using LAC 40053 09:43:18.503687 tst handover.py: using RAC 18 09:43:18.625904 tst handover.py: using CellId 40053 09:43:18.744640 tst handover.py: using BVCI 40054 09:43:18.863090 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 09:43:18.874693 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 09:43:18.886170 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 09:43:18.897718 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 09:43:18.909200 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 09:43:18.920630 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 09:43:19.036837 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 09:43:19.156228 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:43:19.631171 run create_hlr_db(pid=2529): Launched 09:43:19.761114 bus /sierra_2: Setting Powered False 09:43:20.821360 run create_hlr_db(pid=2529): Terminated: ok {rc=0} 09:43:21.236449 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2531): Launched 09:43:21.562476 run osmo-hlr_10.42.42.2(pid=2532): Launched 09:43:21.685613 run osmo-stp_10.42.42.5: Starting osmo-stp 09:43:22.211990 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2534): Launched 09:43:22.539189 run osmo-stp_10.42.42.5(pid=2535): Launched 09:43:22.662917 run osmo-msc_10.42.42.6: Starting osmo-msc 09:43:23.224809 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2537): Launched 09:43:23.552776 run osmo-msc_10.42.42.6(pid=2538): Launched 09:43:23.733568 run osmo-stp_10.42.42.5(pid=2535): ERR: Terminated: ERROR {rc=1} [trial-2402↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2535)] 09:43:23.870512 run osmo-stp_10.42.42.5(pid=2535): stdout: | (launched: 2022-12-14_09:43:22.477352) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:43:24.007923 run osmo-stp_10.42.42.5(pid=2535): stderr: | 20221214094322670 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214094322670 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214094322670 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214094322671 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214094322673 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214094322673 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214094322673 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:43:24.144156 run osmo-stp_10.42.42.5(pid=2535): stdout: | (launched: 2022-12-14_09:43:22.477352) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:43:24.272545 run osmo-stp_10.42.42.5(pid=2535): stderr: | 20221214094322670 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214094322670 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214094322670 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214094322671 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214094322673 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214094322673 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214094322673 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:43:24.427322 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=2535): Process ended prematurely: osmo-stp_10.42.42.5(pid=2535) [trial-2402↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2535)] [trial-2402↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18] 09:43:24.436551 tst handover.py:18: Test FAILED (6.6 sec) 09:43:24.464074 run osmo-hlr_10.42.42.2(pid=2532): ERR: Terminated: ERROR {rc=237} [trial-2402↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2532)] 09:43:24.514059 run osmo-hlr_10.42.42.2(pid=2532): stdout: | (launched: 2022-12-14_09:43:21.501413) 09:43:24.565773 run osmo-hlr_10.42.42.2(pid=2532): stderr: | 20221214094321700 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214094321700 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214094321700 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214094321700 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214094321700 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214094321700 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214094321713 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/handover_2G:nanobts+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214094321721 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214094321722 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214094321722 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:43:24.637806 run osmo-msc_10.42.42.6(pid=2538): ERR: Terminated: ERROR {rc=2} [trial-2402↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2538)] 09:43:24.687616 run osmo-msc_10.42.42.6(pid=2538): stdout: | (launched: 2022-12-14_09:43:23.491737) 09:43:24.739277 run osmo-msc_10.42.42.6(pid=2538): stderr: | 20221214094323817 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214094323817 DLGLOBAL DEBUG validating counter group 0x7f0ac6448c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214094323817 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214094323817 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214094323818 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214094323818 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214094323820 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214094323820 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214094323820 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214094323820 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:43:24.791000 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2531): Terminating (SIGTERM) 09:43:24.832495 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2534): Terminating (SIGTERM) 09:43:24.874284 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2537): Terminating (SIGTERM) 09:43:24.916116 --- ParallelTerminationStrategy: PID 2531 died... 09:43:24.936238 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2531): Terminated: ok {rc=0} 09:43:24.982446 --- ParallelTerminationStrategy: PID 2534 died... 09:43:25.002139 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2534): Terminated: ok {rc=0} 09:43:25.047908 --- ParallelTerminationStrategy: PID 2537 died... 09:43:25.067457 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2537): Terminated: ok {rc=0} 09:43:25.154920 bus /sierra_3: Setting Powered False 09:43:26.252263 bus /sierra_3: Setting Powered False 09:43:27.371049 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2402 handover_2G:nanobts+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 handover_2G:nanobts+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 09:43:28.631000 tst handover_2G:nanobts+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:43:28.636635 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 09:43:28.692847 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 09:43:28.720443 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 09:43:28.775428 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 09:43:28.832135 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 09:43:28.859639 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 09:43:29.412079 tst handover_2G:nanobts+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2402 handover_2G:nanobts+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 09:43:29.417856 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 09:43:29.429633 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 09:43:29.468686 tst handover.py: using LAC 40054 09:43:29.596532 tst handover.py: using RAC 19 09:43:29.716682 tst handover.py: using CellId 40054 09:43:29.834938 tst handover.py: using BVCI 40055 09:43:29.946440 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 09:43:29.994897 tst handover.py: using LAC 40055 09:43:30.115867 tst handover.py: using RAC 20 09:43:30.235886 tst handover.py: using CellId 40055 09:43:30.355901 tst handover.py: using BVCI 40056 09:43:30.466947 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 09:43:30.477982 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 09:43:30.488884 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 09:43:30.499756 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 09:43:30.511044 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 09:43:30.522367 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 09:43:30.639793 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 09:43:30.756524 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:43:31.209609 run create_hlr_db(pid=2543): Launched 09:43:31.361779 bus /sierra_2: Setting Powered False 09:43:32.422151 run create_hlr_db(pid=2543): Terminated: ok {rc=0} 09:43:32.819553 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2545): Launched 09:43:33.121687 run osmo-hlr_10.42.42.2(pid=2546): Launched 09:43:33.236340 run osmo-stp_10.42.42.5: Starting osmo-stp 09:43:33.734678 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2548): Launched 09:43:34.037730 run osmo-stp_10.42.42.5(pid=2549): Launched 09:43:34.152293 run osmo-msc_10.42.42.6: Starting osmo-msc 09:43:34.672321 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2551): Launched 09:43:34.975410 run osmo-msc_10.42.42.6(pid=2552): Launched 09:43:35.147564 run osmo-stp_10.42.42.5(pid=2549): ERR: Terminated: ERROR {rc=1} [trial-2402↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2549)] 09:43:35.276128 run osmo-stp_10.42.42.5(pid=2549): stdout: | (launched: 2022-12-14_09:43:33.980328) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:43:35.404499 run osmo-stp_10.42.42.5(pid=2549): stderr: | 20221214094334151 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214094334151 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214094334151 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214094334151 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214094334154 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214094334154 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214094334154 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:43:35.530911 run osmo-stp_10.42.42.5(pid=2549): stdout: | (launched: 2022-12-14_09:43:33.980328) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:43:35.651212 run osmo-stp_10.42.42.5(pid=2549): stderr: | 20221214094334151 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214094334151 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214094334151 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214094334151 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214094334154 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214094334154 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214094334154 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:43:35.794770 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=2549): Process ended prematurely: osmo-stp_10.42.42.5(pid=2549) [trial-2402↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2549)] [trial-2402↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18] 09:43:35.803069 tst handover.py:18: Test FAILED (6.4 sec) 09:43:35.829090 run osmo-hlr_10.42.42.2(pid=2546): ERR: Terminated: ERROR {rc=237} [trial-2402↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2546)] 09:43:35.877460 run osmo-hlr_10.42.42.2(pid=2546): stdout: | (launched: 2022-12-14_09:43:33.064890) 09:43:35.926760 run osmo-hlr_10.42.42.2(pid=2546): stderr: | 20221214094333241 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214094333241 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214094333241 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214094333241 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214094333241 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214094333241 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214094333254 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/handover_2G:nanobts+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214094333262 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214094333262 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214094333262 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:43:35.996047 run osmo-msc_10.42.42.6(pid=2552): ERR: Terminated: ERROR {rc=2} [trial-2402↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2552)] 09:43:36.043218 run osmo-msc_10.42.42.6(pid=2552): stdout: | (launched: 2022-12-14_09:43:34.918733) 09:43:36.092520 run osmo-msc_10.42.42.6(pid=2552): stderr: | 20221214094335187 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214094335187 DLGLOBAL DEBUG validating counter group 0x7f94afda8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214094335187 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214094335187 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214094335187 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214094335188 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214094335189 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214094335190 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214094335190 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214094335190 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:43:36.142231 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2545): Terminating (SIGTERM) 09:43:36.182006 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2548): Terminating (SIGTERM) 09:43:36.221711 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2551): Terminating (SIGTERM) 09:43:36.261992 --- ParallelTerminationStrategy: PID 2545 died... 09:43:36.281900 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2545): Terminated: ok {rc=0} 09:43:36.326301 --- ParallelTerminationStrategy: PID 2548 died... 09:43:36.345477 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2548): Terminated: ok {rc=0} 09:43:36.390008 --- ParallelTerminationStrategy: PID 2551 died... 09:43:36.409213 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2551): Terminated: ok {rc=0} 09:43:36.493288 bus /sierra_3: Setting Powered False 09:43:37.590321 bus /sierra_3: Setting Powered False 09:43:38.708216 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2402 handover_2G:nanobts+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 handover_2G:nanobts+bts1-sysmo --------------------------------------------------------------------- 09:43:39.967558 tst handover_2G:nanobts+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:43:39.972561 tst handover_2G:nanobts+bts1-sysmo: Verifying 2 x bts (candidates: 11) 09:43:40.014312 tst handover_2G:nanobts+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 09:43:40.041296 tst handover_2G:nanobts+bts1-sysmo: Verifying 2 x modem (candidates: 12) 09:43:40.094819 tst handover_2G:nanobts+bts1-sysmo: Reserving 2 x bts (candidates: 11) 09:43:40.137420 tst handover_2G:nanobts+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 09:43:40.165977 tst handover_2G:nanobts+bts1-sysmo: Reserving 2 x modem (candidates: 12) 09:43:40.712291 tst handover_2G:nanobts+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2402 handover_2G:nanobts+bts1-sysmo handover.py ---------------------------------------------- 09:43:40.717724 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 09:43:40.728606 tst handover_2G:nanobts+bts1-sysmo: Using 1 x bts (candidates: 2) 09:43:40.765464 tst handover.py: using LAC 40056 09:43:40.893270 tst handover.py: using RAC 21 09:43:41.019757 tst handover.py: using CellId 40056 09:43:41.146229 tst handover.py: using BVCI 40057 09:43:41.263591 tst handover_2G:nanobts+bts1-sysmo: Using 1 x bts (candidates: 2) 09:43:41.297910 tst handover.py: using LAC 40057 09:43:41.423304 tst handover.py: using RAC 22 09:43:41.549432 tst handover.py: using CellId 40057 09:43:41.676735 tst handover.py: using BVCI 40058 09:43:41.793822 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 09:43:41.805034 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 09:43:41.815981 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 09:43:41.827038 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 09:43:41.838241 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 09:43:41.849403 tst handover_2G:nanobts+bts1-sysmo: Using 1 x modem (candidates: 2) 09:43:41.965188 tst handover_2G:nanobts+bts1-sysmo: Using 1 x modem (candidates: 2) 09:43:42.085658 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:43:42.560450 run create_hlr_db(pid=2557): Launched 09:43:42.691816 bus /sierra_2: Setting Powered False 09:43:43.756381 run create_hlr_db(pid=2557): Terminated: ok {rc=0} 09:43:44.163065 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2559): Launched 09:43:44.465234 run osmo-hlr_10.42.42.2(pid=2560): Launched 09:43:44.583029 run osmo-stp_10.42.42.5: Starting osmo-stp 09:43:45.094757 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2562): Launched 09:43:45.398726 run osmo-stp_10.42.42.5(pid=2563): Launched 09:43:45.514408 run osmo-msc_10.42.42.6: Starting osmo-msc 09:43:46.085347 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2565): Launched 09:43:46.439686 run osmo-msc_10.42.42.6(pid=2566): Launched 09:43:46.645704 run osmo-stp_10.42.42.5(pid=2563): ERR: Terminated: ERROR {rc=1} [trial-2402↪handover_2G:nanobts+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2563)] 09:43:46.893404 run osmo-stp_10.42.42.5(pid=2563): stdout: | (launched: 2022-12-14_09:43:45.340834) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:43:47.208882 run osmo-stp_10.42.42.5(pid=2563): stderr: | 20221214094345512 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214094345512 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214094345512 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214094345513 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214094345515 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214094345515 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214094345515 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:43:47.435559 run osmo-stp_10.42.42.5(pid=2563): stdout: | (launched: 2022-12-14_09:43:45.340834) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:43:47.567447 run osmo-stp_10.42.42.5(pid=2563): stderr: | 20221214094345512 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214094345512 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214094345512 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214094345513 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214094345515 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214094345515 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214094345515 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:43:47.721644 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=2563): Process ended prematurely: osmo-stp_10.42.42.5(pid=2563) [trial-2402↪handover_2G:nanobts+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2563)] [trial-2402↪handover_2G:nanobts+bts1-sysmo↪handover.py:18] 09:43:47.730711 tst handover.py:18: Test FAILED (7.0 sec) 09:43:47.758362 run osmo-hlr_10.42.42.2(pid=2560): ERR: Terminated: ERROR {rc=237} [trial-2402↪handover_2G:nanobts+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2560)] 09:43:47.808926 run osmo-hlr_10.42.42.2(pid=2560): stdout: | (launched: 2022-12-14_09:43:44.408489) 09:43:47.861614 run osmo-hlr_10.42.42.2(pid=2560): stderr: | 20221214094344583 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214094344583 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214094344583 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214094344583 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214094344583 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214094344583 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214094344596 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/handover_2G:nanobts+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214094344605 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214094344606 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214094344606 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:43:47.934302 run osmo-msc_10.42.42.6(pid=2566): ERR: Terminated: ERROR {rc=2} [trial-2402↪handover_2G:nanobts+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2566)] 09:43:47.984731 run osmo-msc_10.42.42.6(pid=2566): stdout: | (launched: 2022-12-14_09:43:46.367272) 09:43:48.036824 run osmo-msc_10.42.42.6(pid=2566): stderr: | 20221214094347009 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214094347009 DLGLOBAL DEBUG validating counter group 0x7f5ef2914c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214094347009 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214094347010 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214094347010 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214094347010 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214094347012 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214094347012 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214094347012 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214094347012 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:43:48.089217 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2559): Terminating (SIGTERM) 09:43:48.130782 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2562): Terminating (SIGTERM) 09:43:48.172925 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2565): Terminating (SIGTERM) 09:43:48.215584 --- ParallelTerminationStrategy: PID 2559 died... 09:43:48.236139 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2559): Terminated: ok {rc=0} 09:43:48.282929 --- ParallelTerminationStrategy: PID 2562 died... 09:43:48.302866 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2562): Terminated: ok {rc=0} 09:43:48.349400 --- ParallelTerminationStrategy: PID 2565 died... 09:43:48.369682 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2565): Terminated: ok {rc=0} 09:43:48.458125 bus /sierra_3: Setting Powered False 09:43:49.556200 bus /sierra_3: Setting Powered False 09:43:50.671151 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2402 handover_2G:nanobts+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 handover_2G:nanobts+bts1-trx-b200 --------------------------------------------------------------------- 09:43:51.929395 tst handover_2G:nanobts+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:43:51.935061 tst handover_2G:nanobts+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 09:43:51.990461 tst handover_2G:nanobts+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 09:43:52.017936 tst handover_2G:nanobts+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 09:43:52.069706 tst handover_2G:nanobts+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 09:43:52.124524 tst handover_2G:nanobts+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 09:43:52.152138 tst handover_2G:nanobts+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 09:43:52.705358 tst handover_2G:nanobts+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2402 handover_2G:nanobts+bts1-trx-b200 handover.py ---------------------------------------------- 09:43:52.710870 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 09:43:52.722398 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x bts (candidates: 2) 09:43:52.765619 tst handover.py: using LAC 40058 09:43:52.886072 tst handover.py: using RAC 23 09:43:53.004132 tst handover.py: using CellId 40058 09:43:53.134753 tst handover.py: using BVCI 40059 09:43:53.246508 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x bts (candidates: 2) 09:43:53.299724 tst handover.py: using LAC 40059 09:43:53.418371 tst handover.py: using RAC 24 09:43:53.537310 tst handover.py: using CellId 40059 09:43:53.655003 tst handover.py: using BVCI 40060 09:43:53.767487 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 09:43:53.778379 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 09:43:53.789115 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 09:43:53.799717 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 09:43:53.811125 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 09:43:53.822309 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x modem (candidates: 2) 09:43:53.941610 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x modem (candidates: 2) 09:43:54.057526 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:43:54.502810 run create_hlr_db(pid=2571): Launched 09:43:54.617279 bus /sierra_2: Setting Powered False 09:43:55.677790 run create_hlr_db(pid=2571): Terminated: ok {rc=0} 09:43:56.093648 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2573): Launched 09:43:56.418760 run osmo-hlr_10.42.42.2(pid=2574): Launched 09:43:56.544546 run osmo-stp_10.42.42.5: Starting osmo-stp 09:43:57.074557 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2576): Launched 09:43:57.399015 run osmo-stp_10.42.42.5(pid=2577): Launched 09:43:57.523273 run osmo-msc_10.42.42.6: Starting osmo-msc 09:43:58.083082 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2579): Launched 09:43:58.407560 run osmo-msc_10.42.42.6(pid=2580): Launched 09:43:58.590438 run osmo-stp_10.42.42.5(pid=2577): ERR: Terminated: ERROR {rc=1} [trial-2402↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2577)] 09:43:58.726259 run osmo-stp_10.42.42.5(pid=2577): stdout: | (launched: 2022-12-14_09:43:57.337747) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:43:58.862821 run osmo-stp_10.42.42.5(pid=2577): stderr: | 20221214094357531 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214094357531 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214094357531 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214094357532 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214094357532 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214094357532 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214094357532 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:43:58.998480 run osmo-stp_10.42.42.5(pid=2577): stdout: | (launched: 2022-12-14_09:43:57.337747) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:43:59.126900 run osmo-stp_10.42.42.5(pid=2577): stderr: | 20221214094357531 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214094357531 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214094357531 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214094357532 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214094357532 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214094357532 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214094357532 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:43:59.280777 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=2577): Process ended prematurely: osmo-stp_10.42.42.5(pid=2577) [trial-2402↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2577)] [trial-2402↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18] 09:43:59.289891 tst handover.py:18: Test FAILED (6.6 sec) 09:43:59.317336 run osmo-hlr_10.42.42.2(pid=2574): ERR: Terminated: ERROR {rc=237} [trial-2402↪handover_2G:nanobts+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2574)] 09:43:59.368126 run osmo-hlr_10.42.42.2(pid=2574): stdout: | (launched: 2022-12-14_09:43:56.358058) 09:43:59.420193 run osmo-hlr_10.42.42.2(pid=2574): stderr: | 20221214094356558 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214094356558 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214094356558 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214094356558 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214094356559 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214094356559 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214094356574 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/handover_2G:nanobts+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214094356582 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214094356582 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214094356582 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:43:59.492578 run osmo-msc_10.42.42.6(pid=2580): ERR: Terminated: ERROR {rc=2} [trial-2402↪handover_2G:nanobts+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2580)] 09:43:59.542719 run osmo-msc_10.42.42.6(pid=2580): stdout: | (launched: 2022-12-14_09:43:58.346881) 09:43:59.594262 run osmo-msc_10.42.42.6(pid=2580): stderr: | 20221214094358668 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214094358668 DLGLOBAL DEBUG validating counter group 0x7fe1a8982c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214094358668 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214094358668 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214094358669 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214094358669 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214094358670 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214094358671 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214094358671 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214094358671 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:43:59.646306 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2573): Terminating (SIGTERM) 09:43:59.688120 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2576): Terminating (SIGTERM) 09:43:59.729920 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2579): Terminating (SIGTERM) 09:43:59.772140 --- ParallelTerminationStrategy: PID 2573 died... 09:43:59.792376 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2573): Terminated: ok {rc=0} 09:43:59.838591 --- ParallelTerminationStrategy: PID 2576 died... 09:43:59.858281 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2576): Terminated: ok {rc=0} 09:43:59.904244 --- ParallelTerminationStrategy: PID 2579 died... 09:43:59.923917 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2579): Terminated: ok {rc=0} 09:44:00.011266 bus /sierra_3: Setting Powered False 09:44:01.106575 bus /sierra_3: Setting Powered False 09:44:02.225502 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2402 handover_2G:nanobts+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 handover_2G:nanobts+bts1-trx-umtrx --------------------------------------------------------------------- 09:44:03.487605 tst handover_2G:nanobts+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:44:03.492786 tst handover_2G:nanobts+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 09:44:03.545957 tst handover_2G:nanobts+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 09:44:03.572343 tst handover_2G:nanobts+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 09:44:03.624152 tst handover_2G:nanobts+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 09:44:03.678472 tst handover_2G:nanobts+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 09:44:03.705792 tst handover_2G:nanobts+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 09:44:04.253442 tst handover_2G:nanobts+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2402 handover_2G:nanobts+bts1-trx-umtrx handover.py ---------------------------------------------- 09:44:04.258775 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 09:44:04.269823 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 09:44:04.308328 tst handover.py: using LAC 40060 09:44:04.428340 tst handover.py: using RAC 25 09:44:04.549389 tst handover.py: using CellId 40060 09:44:04.670625 tst handover.py: using BVCI 40061 09:44:04.781812 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 09:44:04.829361 tst handover.py: using LAC 40061 09:44:04.953689 tst handover.py: using RAC 26 09:44:05.073887 tst handover.py: using CellId 40061 09:44:05.193758 tst handover.py: using BVCI 40062 09:44:05.312911 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 09:44:05.324359 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 09:44:05.335644 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 09:44:05.346936 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 09:44:05.358187 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 09:44:05.369778 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 09:44:05.484290 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 09:44:05.602593 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:44:06.079263 run create_hlr_db(pid=2585): Launched 09:44:06.209749 bus /sierra_2: Setting Powered False 09:44:07.273512 run create_hlr_db(pid=2585): Terminated: ok {rc=0} 09:44:07.680846 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2587): Launched 09:44:07.987104 run osmo-hlr_10.42.42.2(pid=2588): Launched 09:44:08.102212 run osmo-stp_10.42.42.5: Starting osmo-stp 09:44:08.609559 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2590): Launched 09:44:08.913048 run osmo-stp_10.42.42.5(pid=2591): Launched 09:44:09.028533 run osmo-msc_10.42.42.6: Starting osmo-msc 09:44:09.551238 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2593): Launched 09:44:09.857173 run osmo-msc_10.42.42.6(pid=2594): Launched 09:44:10.026221 run osmo-stp_10.42.42.5(pid=2591): ERR: Terminated: ERROR {rc=1} [trial-2402↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2591)] 09:44:10.155004 run osmo-stp_10.42.42.5(pid=2591): stdout: | (launched: 2022-12-14_09:44:08.855549) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:44:10.283548 run osmo-stp_10.42.42.5(pid=2591): stderr: | 20221214094409026 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214094409026 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214094409027 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214094409027 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214094409028 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214094409028 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214094409028 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:44:10.409997 run osmo-stp_10.42.42.5(pid=2591): stdout: | (launched: 2022-12-14_09:44:08.855549) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:44:10.529896 run osmo-stp_10.42.42.5(pid=2591): stderr: | 20221214094409026 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214094409026 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214094409027 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214094409027 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214094409028 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214094409028 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214094409028 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:44:10.673362 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=2591): Process ended prematurely: osmo-stp_10.42.42.5(pid=2591) [trial-2402↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2591)] [trial-2402↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18] 09:44:10.681736 tst handover.py:18: Test FAILED (6.4 sec) 09:44:10.707760 run osmo-hlr_10.42.42.2(pid=2588): ERR: Terminated: ERROR {rc=237} [trial-2402↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2588)] 09:44:10.756289 run osmo-hlr_10.42.42.2(pid=2588): stdout: | (launched: 2022-12-14_09:44:07.929806) 09:44:10.806733 run osmo-hlr_10.42.42.2(pid=2588): stderr: | 20221214094408107 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214094408107 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214094408107 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214094408107 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214094408107 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214094408107 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214094408120 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/handover_2G:nanobts+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214094408131 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214094408131 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214094408131 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:44:10.876691 run osmo-msc_10.42.42.6(pid=2594): ERR: Terminated: ERROR {rc=2} [trial-2402↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2594)] 09:44:10.924205 run osmo-msc_10.42.42.6(pid=2594): stdout: | (launched: 2022-12-14_09:44:09.798769) 09:44:10.973808 run osmo-msc_10.42.42.6(pid=2594): stderr: | 20221214094410069 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214094410070 DLGLOBAL DEBUG validating counter group 0x7f8fcedb4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214094410070 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214094410070 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214094410070 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214094410070 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214094410072 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214094410072 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214094410072 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214094410072 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:44:11.024028 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2587): Terminating (SIGTERM) 09:44:11.063987 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2590): Terminating (SIGTERM) 09:44:11.103885 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2593): Terminating (SIGTERM) 09:44:11.143910 --- ParallelTerminationStrategy: PID 2587 died... 09:44:11.163496 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2587): Terminated: ok {rc=0} 09:44:11.207825 --- ParallelTerminationStrategy: PID 2590 died... 09:44:11.226718 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2590): Terminated: ok {rc=0} 09:44:11.270685 --- ParallelTerminationStrategy: PID 2593 died... 09:44:11.289715 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2593): Terminated: ok {rc=0} 09:44:11.375799 bus /sierra_3: Setting Powered False 09:44:12.475499 bus /sierra_3: Setting Powered False 09:44:13.589141 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2402 handover_2G:nanobts+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 handover_2G:oc2g+bts1-octphy --------------------------------------------------------------------- 09:44:14.852374 tst handover_2G:oc2g+bts1-octphy: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:44:14.858680 tst handover_2G:oc2g+bts1-octphy: Verifying 2 x bts (candidates: 11) 09:44:14.897725 tst handover_2G:oc2g+bts1-octphy: Verifying 6 x ip_address (candidates: 9) 09:44:14.925756 tst handover_2G:oc2g+bts1-octphy: Verifying 2 x modem (candidates: 12) 09:44:14.979828 tst handover_2G:oc2g+bts1-octphy: Reserving 2 x bts (candidates: 11) 09:44:15.018096 tst handover_2G:oc2g+bts1-octphy: Reserving 6 x ip_address (candidates: 9) 09:44:15.046151 tst handover_2G:oc2g+bts1-octphy: Reserving 2 x modem (candidates: 12) 09:44:15.594691 tst handover_2G:oc2g+bts1-octphy: RESERVED RESOURCES for handover_2G: bts OC-2G OCTBTS 3500 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2402 handover_2G:oc2g+bts1-octphy handover.py ---------------------------------------------- 09:44:15.600405 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 09:44:15.611601 tst handover_2G:oc2g+bts1-octphy: Using 1 x bts (candidates: 2) 09:44:15.647035 tst handover.py: using LAC 40062 09:44:15.767482 tst handover.py: using RAC 27 09:44:15.899354 tst handover.py: using CellId 40062 09:44:16.046066 tst handover.py: using BVCI 40063 09:44:16.191922 tst handover_2G:oc2g+bts1-octphy: Using 1 x bts (candidates: 2) 09:44:16.232308 tst handover.py: using LAC 40063 09:44:16.390768 tst handover.py: using RAC 28 09:44:16.549329 tst handover.py: using CellId 40063 09:44:16.684580 tst handover.py: using BVCI 40064 09:44:16.841889 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 09:44:16.853458 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 09:44:16.864846 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 09:44:16.876226 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 09:44:16.887878 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 09:44:16.899722 tst handover_2G:oc2g+bts1-octphy: Using 1 x modem (candidates: 2) 09:44:17.017124 tst handover_2G:oc2g+bts1-octphy: Using 1 x modem (candidates: 2) 09:44:17.141333 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:44:17.621975 run create_hlr_db(pid=2599): Launched 09:44:17.754018 bus /sierra_2: Setting Powered False 09:44:18.817699 run create_hlr_db(pid=2599): Terminated: ok {rc=0} 09:44:19.226178 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2601): Launched 09:44:19.532157 run osmo-hlr_10.42.42.2(pid=2602): Launched 09:44:19.648711 run osmo-stp_10.42.42.5: Starting osmo-stp 09:44:20.149805 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2604): Launched 09:44:20.454623 run osmo-stp_10.42.42.5(pid=2605): Launched 09:44:20.569672 run osmo-msc_10.42.42.6: Starting osmo-msc 09:44:21.091973 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2607): Launched 09:44:21.395791 run osmo-msc_10.42.42.6(pid=2608): Launched 09:44:21.564079 run osmo-stp_10.42.42.5(pid=2605): ERR: Terminated: ERROR {rc=1} [trial-2402↪handover_2G:oc2g+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2605)] 09:44:21.692098 run osmo-stp_10.42.42.5(pid=2605): stdout: | (launched: 2022-12-14_09:44:20.396818) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:44:21.820247 run osmo-stp_10.42.42.5(pid=2605): stderr: | 20221214094420570 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214094420570 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214094420571 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214094420571 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214094420572 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214094420572 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214094420572 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:44:21.947387 run osmo-stp_10.42.42.5(pid=2605): stdout: | (launched: 2022-12-14_09:44:20.396818) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:44:22.067420 run osmo-stp_10.42.42.5(pid=2605): stderr: | 20221214094420570 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214094420570 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214094420571 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214094420571 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214094420572 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214094420572 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214094420572 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:44:22.210884 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=2605): Process ended prematurely: osmo-stp_10.42.42.5(pid=2605) [trial-2402↪handover_2G:oc2g+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2605)] [trial-2402↪handover_2G:oc2g+bts1-octphy↪handover.py:18] 09:44:22.219164 tst handover.py:18: Test FAILED (6.6 sec) 09:44:22.245098 run osmo-hlr_10.42.42.2(pid=2602): ERR: Terminated: ERROR {rc=237} [trial-2402↪handover_2G:oc2g+bts1-octphy↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2602)] 09:44:22.293236 run osmo-hlr_10.42.42.2(pid=2602): stdout: | (launched: 2022-12-14_09:44:19.475245) 09:44:22.342441 run osmo-hlr_10.42.42.2(pid=2602): stderr: | 20221214094419650 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214094419651 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214094419651 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214094419651 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214094419651 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214094419651 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214094419666 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/handover_2G:oc2g+bts1-octphy/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214094419676 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214094419676 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214094419676 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:44:22.411307 run osmo-msc_10.42.42.6(pid=2608): ERR: Terminated: ERROR {rc=2} [trial-2402↪handover_2G:oc2g+bts1-octphy↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2608)] 09:44:22.458150 run osmo-msc_10.42.42.6(pid=2608): stdout: | (launched: 2022-12-14_09:44:21.338242) 09:44:22.507163 run osmo-msc_10.42.42.6(pid=2608): stderr: | 20221214094421610 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214094421610 DLGLOBAL DEBUG validating counter group 0x7f10ed3a4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214094421610 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214094421610 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214094421610 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214094421610 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214094421612 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214094421612 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214094421613 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214094421613 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:44:22.556926 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2601): Terminating (SIGTERM) 09:44:22.596470 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2604): Terminating (SIGTERM) 09:44:22.635813 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2607): Terminating (SIGTERM) 09:44:22.675329 --- ParallelTerminationStrategy: PID 2601 died... 09:44:22.694692 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2601): Terminated: ok {rc=0} 09:44:22.738675 --- ParallelTerminationStrategy: PID 2604 died... 09:44:22.757506 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2604): Terminated: ok {rc=0} 09:44:22.801081 --- ParallelTerminationStrategy: PID 2607 died... 09:44:22.819848 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2607): Terminated: ok {rc=0} 09:44:22.905731 bus /sierra_3: Setting Powered False 09:44:24.005218 bus /sierra_3: Setting Powered False 09:44:25.121355 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2402 handover_2G:oc2g+bts1-octphy FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 handover_2G:oc2g+bts1-trx-lms --------------------------------------------------------------------- 09:44:26.357117 tst handover_2G:oc2g+bts1-trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:44:26.362314 tst handover_2G:oc2g+bts1-trx-lms: Verifying 2 x bts (candidates: 11) 09:44:26.412577 tst handover_2G:oc2g+bts1-trx-lms: Verifying 6 x ip_address (candidates: 9) 09:44:26.438789 tst handover_2G:oc2g+bts1-trx-lms: Verifying 2 x modem (candidates: 12) 09:44:26.491844 tst handover_2G:oc2g+bts1-trx-lms: Reserving 2 x bts (candidates: 11) 09:44:26.541279 tst handover_2G:oc2g+bts1-trx-lms: Reserving 6 x ip_address (candidates: 9) 09:44:26.567342 tst handover_2G:oc2g+bts1-trx-lms: Reserving 2 x modem (candidates: 12) 09:44:27.116098 tst handover_2G:oc2g+bts1-trx-lms: RESERVED RESOURCES for handover_2G: bts OC-2G LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2402 handover_2G:oc2g+bts1-trx-lms handover.py ---------------------------------------------- 09:44:27.121242 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 09:44:27.132049 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x bts (candidates: 2) 09:44:27.166258 tst handover.py: using LAC 40064 09:44:27.295035 tst handover.py: using RAC 29 09:44:27.424877 tst handover.py: using CellId 40064 09:44:27.551478 tst handover.py: using BVCI 40065 09:44:27.662398 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x bts (candidates: 2) 09:44:27.710250 tst handover.py: using LAC 40065 09:44:27.829445 tst handover.py: using RAC 30 09:44:27.949348 tst handover.py: using CellId 40065 09:44:28.072841 tst handover.py: using BVCI 40066 09:44:28.184933 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 09:44:28.195891 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 09:44:28.206832 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 09:44:28.217438 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 09:44:28.228765 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 09:44:28.240337 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x modem (candidates: 2) 09:44:28.361359 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x modem (candidates: 2) 09:44:28.479184 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:44:28.955060 run create_hlr_db(pid=2615): Launched 09:44:29.088256 bus /sierra_2: Setting Powered False 09:44:30.149067 run create_hlr_db(pid=2615): Terminated: ok {rc=0} 09:44:30.565715 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2617): Launched 09:44:30.909753 run osmo-hlr_10.42.42.2(pid=2619): Launched 09:44:31.085095 run osmo-stp_10.42.42.5: Starting osmo-stp 09:44:31.763526 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2622): Launched 09:44:32.092341 run osmo-stp_10.42.42.5(pid=2623): Launched 09:44:32.330467 run osmo-msc_10.42.42.6: Starting osmo-msc 09:44:32.916538 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2626): Launched 09:44:33.240160 run osmo-msc_10.42.42.6(pid=2627): Launched 09:44:33.421438 run osmo-stp_10.42.42.5(pid=2623): ERR: Terminated: ERROR {rc=1} [trial-2402↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2623)] 09:44:33.556722 run osmo-stp_10.42.42.5(pid=2623): stdout: | (launched: 2022-12-14_09:44:32.029224) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:44:33.693235 run osmo-stp_10.42.42.5(pid=2623): stderr: | 20221214094432362 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214094432362 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214094432362 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214094432363 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214094432363 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214094432363 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214094432363 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:44:33.828433 run osmo-stp_10.42.42.5(pid=2623): stdout: | (launched: 2022-12-14_09:44:32.029224) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:44:33.956621 run osmo-stp_10.42.42.5(pid=2623): stderr: | 20221214094432362 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214094432362 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214094432362 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214094432363 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214094432363 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214094432363 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214094432363 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:44:34.110735 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=2623): Process ended prematurely: osmo-stp_10.42.42.5(pid=2623) [trial-2402↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2623)] [trial-2402↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18] 09:44:34.119659 tst handover.py:18: Test FAILED (7.0 sec) 09:44:34.147206 run osmo-hlr_10.42.42.2(pid=2619): ERR: Terminated: ERROR {rc=237} [trial-2402↪handover_2G:oc2g+bts1-trx-lms↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2619)] 09:44:34.197080 run osmo-hlr_10.42.42.2(pid=2619): stdout: | (launched: 2022-12-14_09:44:30.830878) 09:44:34.248708 run osmo-hlr_10.42.42.2(pid=2619): stderr: | 20221214094431173 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214094431173 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214094431173 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214094431173 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214094431173 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214094431174 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214094431188 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/handover_2G:oc2g+bts1-trx-lms/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214094431212 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214094431212 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214094431215 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:44:34.320336 run osmo-msc_10.42.42.6(pid=2627): ERR: Terminated: ERROR {rc=2} [trial-2402↪handover_2G:oc2g+bts1-trx-lms↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2627)] 09:44:34.370018 run osmo-msc_10.42.42.6(pid=2627): stdout: | (launched: 2022-12-14_09:44:33.179778) 09:44:34.421628 run osmo-msc_10.42.42.6(pid=2627): stderr: | 20221214094433502 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214094433502 DLGLOBAL DEBUG validating counter group 0x7fb5a39a7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214094433503 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214094433503 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214094433503 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214094433503 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214094433505 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214094433505 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214094433505 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214094433505 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:44:34.473471 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2617): Terminating (SIGTERM) 09:44:34.514632 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2622): Terminating (SIGTERM) 09:44:34.555885 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2626): Terminating (SIGTERM) 09:44:34.597452 --- ParallelTerminationStrategy: PID 2617 died... 09:44:34.617578 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2617): Terminated: ok {rc=0} 09:44:34.663372 --- ParallelTerminationStrategy: PID 2622 died... 09:44:34.682786 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2622): Terminated: ok {rc=0} 09:44:34.728379 --- ParallelTerminationStrategy: PID 2626 died... 09:44:34.747933 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2626): Terminated: ok {rc=0} 09:44:34.834775 bus /sierra_3: Setting Powered False 09:44:35.932689 bus /sierra_3: Setting Powered False 09:44:37.050668 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2402 handover_2G:oc2g+bts1-trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 handover_2G:oc2g+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 09:44:38.306382 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:44:38.312555 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 09:44:38.360259 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 09:44:38.387980 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 09:44:38.440387 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 09:44:38.488155 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 09:44:38.515626 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 09:44:39.069026 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts OC-2G LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2402 handover_2G:oc2g+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 09:44:39.074323 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 09:44:39.085922 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 09:44:39.120085 tst handover.py: using LAC 40066 09:44:39.247098 tst handover.py: using RAC 31 09:44:39.376517 tst handover.py: using CellId 40066 09:44:39.505804 tst handover.py: using BVCI 40067 09:44:39.624665 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 09:44:39.670187 tst handover.py: using LAC 40067 09:44:39.799730 tst handover.py: using RAC 32 09:44:39.926644 tst handover.py: using CellId 40067 09:44:40.054102 tst handover.py: using BVCI 40068 09:44:40.166515 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 09:44:40.177816 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 09:44:40.188568 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 09:44:40.199554 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 09:44:40.211122 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 09:44:40.222594 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 09:44:40.341553 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 09:44:40.461150 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:44:40.936189 run create_hlr_db(pid=2632): Launched 09:44:41.069246 bus /sierra_2: Setting Powered False 09:44:42.134096 run create_hlr_db(pid=2632): Terminated: ok {rc=0} 09:44:42.541601 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2634): Launched 09:44:42.846393 run osmo-hlr_10.42.42.2(pid=2635): Launched 09:44:42.963164 run osmo-stp_10.42.42.5: Starting osmo-stp 09:44:43.478080 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2637): Launched 09:44:43.782983 run osmo-stp_10.42.42.5(pid=2638): Launched 09:44:43.898945 run osmo-msc_10.42.42.6: Starting osmo-msc 09:44:44.424270 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2640): Launched 09:44:44.729452 run osmo-msc_10.42.42.6(pid=2641): Launched 09:44:44.899631 run osmo-stp_10.42.42.5(pid=2638): ERR: Terminated: ERROR {rc=1} [trial-2402↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2638)] 09:44:45.028590 run osmo-stp_10.42.42.5(pid=2638): stdout: | (launched: 2022-12-14_09:44:43.724595) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:44:45.157795 run osmo-stp_10.42.42.5(pid=2638): stderr: | 20221214094443897 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214094443897 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214094443897 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214094443898 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214094443898 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214094443898 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214094443898 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:44:45.284346 run osmo-stp_10.42.42.5(pid=2638): stdout: | (launched: 2022-12-14_09:44:43.724595) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:44:45.404137 run osmo-stp_10.42.42.5(pid=2638): stderr: | 20221214094443897 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214094443897 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214094443897 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214094443898 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214094443898 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214094443898 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214094443898 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:44:45.547639 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=2638): Process ended prematurely: osmo-stp_10.42.42.5(pid=2638) [trial-2402↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2638)] [trial-2402↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18] 09:44:45.555977 tst handover.py:18: Test FAILED (6.5 sec) 09:44:45.582164 run osmo-hlr_10.42.42.2(pid=2635): ERR: Terminated: ERROR {rc=237} [trial-2402↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2635)] 09:44:45.630631 run osmo-hlr_10.42.42.2(pid=2635): stdout: | (launched: 2022-12-14_09:44:42.788876) 09:44:45.680393 run osmo-hlr_10.42.42.2(pid=2635): stderr: | 20221214094442968 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214094442968 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214094442968 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214094442968 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214094442968 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214094442968 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214094442980 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/handover_2G:oc2g+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214094442988 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214094442988 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214094442988 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:44:45.750069 run osmo-msc_10.42.42.6(pid=2641): ERR: Terminated: ERROR {rc=2} [trial-2402↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2641)] 09:44:45.797919 run osmo-msc_10.42.42.6(pid=2641): stdout: | (launched: 2022-12-14_09:44:44.671592) 09:44:45.848660 run osmo-msc_10.42.42.6(pid=2641): stderr: | 20221214094444943 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214094444943 DLGLOBAL DEBUG validating counter group 0x7fcf2d120c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214094444943 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214094444943 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214094444943 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214094444943 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214094444945 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214094444946 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214094444946 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214094444946 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:44:45.914410 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2634): Terminating (SIGTERM) 09:44:45.954871 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2637): Terminating (SIGTERM) 09:44:45.995575 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2640): Terminating (SIGTERM) 09:44:46.046859 --- ParallelTerminationStrategy: PID 2634 died... 09:44:46.070492 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2634): Terminated: ok {rc=0} 09:44:46.125555 --- ParallelTerminationStrategy: PID 2637 died... 09:44:46.148206 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2637): Terminated: ok {rc=0} 09:44:46.203258 --- ParallelTerminationStrategy: PID 2640 died... 09:44:46.227090 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2640): Terminated: ok {rc=0} 09:44:46.331701 bus /sierra_3: Setting Powered False 09:44:47.434959 bus /sierra_3: Setting Powered False 09:44:48.550435 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2402 handover_2G:oc2g+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 handover_2G:oc2g+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 09:44:49.808526 tst handover_2G:oc2g+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:44:49.814228 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 09:44:49.866577 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 09:44:49.893711 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 09:44:49.945723 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 09:44:49.997506 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 09:44:50.024637 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 09:44:50.578672 tst handover_2G:oc2g+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts OC-2G sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2402 handover_2G:oc2g+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 09:44:50.584388 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 09:44:50.595952 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 09:44:50.631301 tst handover.py: using LAC 40068 09:44:50.758872 tst handover.py: using RAC 33 09:44:50.888382 tst handover.py: using CellId 40068 09:44:51.015518 tst handover.py: using BVCI 40069 09:44:51.133646 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 09:44:51.183756 tst handover.py: using LAC 40069 09:44:51.312898 tst handover.py: using RAC 34 09:44:51.441404 tst handover.py: using CellId 40069 09:44:51.568603 tst handover.py: using BVCI 40070 09:44:51.688586 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 09:44:51.700080 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 09:44:51.711410 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 09:44:51.722671 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 09:44:51.734192 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 09:44:51.745610 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 09:44:51.861795 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 09:44:51.982620 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:44:52.459965 run create_hlr_db(pid=2646): Launched 09:44:52.591094 bus /sierra_2: Setting Powered False 09:44:53.651316 run create_hlr_db(pid=2646): Terminated: ok {rc=0} 09:44:54.048633 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2648): Launched 09:44:54.354308 run osmo-hlr_10.42.42.2(pid=2649): Launched 09:44:54.469868 run osmo-stp_10.42.42.5: Starting osmo-stp 09:44:54.984079 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2651): Launched 09:44:55.289005 run osmo-stp_10.42.42.5(pid=2652): Launched 09:44:55.404938 run osmo-msc_10.42.42.6: Starting osmo-msc 09:44:55.927910 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2654): Launched 09:44:56.234333 run osmo-msc_10.42.42.6(pid=2655): Launched 09:44:56.403829 run osmo-stp_10.42.42.5(pid=2652): ERR: Terminated: ERROR {rc=1} [trial-2402↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2652)] 09:44:56.532244 run osmo-stp_10.42.42.5(pid=2652): stdout: | (launched: 2022-12-14_09:44:55.231324) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:44:56.660388 run osmo-stp_10.42.42.5(pid=2652): stderr: | 20221214094455405 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214094455405 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214094455406 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214094455406 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214094455406 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214094455407 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214094455407 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:44:56.786806 run osmo-stp_10.42.42.5(pid=2652): stdout: | (launched: 2022-12-14_09:44:55.231324) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:44:56.906942 run osmo-stp_10.42.42.5(pid=2652): stderr: | 20221214094455405 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214094455405 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214094455406 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214094455406 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214094455406 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214094455407 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214094455407 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:44:57.050643 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=2652): Process ended prematurely: osmo-stp_10.42.42.5(pid=2652) [trial-2402↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2652)] [trial-2402↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18] 09:44:57.058778 tst handover.py:18: Test FAILED (6.5 sec) 09:44:57.084617 run osmo-hlr_10.42.42.2(pid=2649): ERR: Terminated: ERROR {rc=237} [trial-2402↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2649)] 09:44:57.132579 run osmo-hlr_10.42.42.2(pid=2649): stdout: | (launched: 2022-12-14_09:44:54.296425) 09:44:57.182347 run osmo-hlr_10.42.42.2(pid=2649): stderr: | 20221214094454474 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214094454474 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214094454474 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214094454474 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214094454474 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214094454474 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214094454486 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/handover_2G:oc2g+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214094454494 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214094454495 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214094454495 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:44:57.251945 run osmo-msc_10.42.42.6(pid=2655): ERR: Terminated: ERROR {rc=2} [trial-2402↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2655)] 09:44:57.299294 run osmo-msc_10.42.42.6(pid=2655): stdout: | (launched: 2022-12-14_09:44:56.176208) 09:44:57.348836 run osmo-msc_10.42.42.6(pid=2655): stderr: | 20221214094456447 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214094456447 DLGLOBAL DEBUG validating counter group 0x7f78cbbf0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214094456447 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214094456447 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214094456448 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214094456448 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214094456450 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214094456450 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214094456450 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214094456450 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:44:57.398621 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2648): Terminating (SIGTERM) 09:44:57.438259 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2651): Terminating (SIGTERM) 09:44:57.477747 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2654): Terminating (SIGTERM) 09:44:57.517591 --- ParallelTerminationStrategy: PID 2648 died... 09:44:57.536703 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2648): Terminated: ok {rc=0} 09:44:57.581041 --- ParallelTerminationStrategy: PID 2651 died... 09:44:57.599784 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2651): Terminated: ok {rc=0} 09:44:57.643582 --- ParallelTerminationStrategy: PID 2654 died... 09:44:57.662398 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2654): Terminated: ok {rc=0} 09:44:57.748010 bus /sierra_3: Setting Powered False 09:44:58.847050 bus /sierra_3: Setting Powered False 09:44:59.960240 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2402 handover_2G:oc2g+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 handover_2G:oc2g+bts1-sysmo --------------------------------------------------------------------- 09:45:01.231343 tst handover_2G:oc2g+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:45:01.237357 tst handover_2G:oc2g+bts1-sysmo: Verifying 2 x bts (candidates: 11) 09:45:01.277797 tst handover_2G:oc2g+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 09:45:01.306141 tst handover_2G:oc2g+bts1-sysmo: Verifying 2 x modem (candidates: 12) 09:45:01.361598 tst handover_2G:oc2g+bts1-sysmo: Reserving 2 x bts (candidates: 11) 09:45:01.418136 tst handover_2G:oc2g+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 09:45:01.455104 tst handover_2G:oc2g+bts1-sysmo: Reserving 2 x modem (candidates: 12) 09:45:01.997441 tst handover_2G:oc2g+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts OC-2G sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2402 handover_2G:oc2g+bts1-sysmo handover.py ---------------------------------------------- 09:45:02.003601 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 09:45:02.015183 tst handover_2G:oc2g+bts1-sysmo: Using 1 x bts (candidates: 2) 09:45:02.050432 tst handover.py: using LAC 40070 09:45:02.203735 tst handover.py: using RAC 35 09:45:02.323336 tst handover.py: using CellId 40070 09:45:02.444096 tst handover.py: using BVCI 40071 09:45:02.556000 tst handover_2G:oc2g+bts1-sysmo: Using 1 x bts (candidates: 2) 09:45:02.589077 tst handover.py: using LAC 40071 09:45:02.707935 tst handover.py: using RAC 36 09:45:02.826312 tst handover.py: using CellId 40071 09:45:02.946556 tst handover.py: using BVCI 40072 09:45:03.065441 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 09:45:03.076907 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 09:45:03.088294 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 09:45:03.099598 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 09:45:03.110901 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 09:45:03.122176 tst handover_2G:oc2g+bts1-sysmo: Using 1 x modem (candidates: 2) 09:45:03.238550 tst handover_2G:oc2g+bts1-sysmo: Using 1 x modem (candidates: 2) 09:45:03.359813 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:45:03.836030 run create_hlr_db(pid=2664): Launched 09:45:03.968291 bus /sierra_2: Setting Powered False 09:45:05.032256 run create_hlr_db(pid=2664): Terminated: ok {rc=0} 09:45:05.440014 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2666): Launched 09:45:05.745999 run osmo-hlr_10.42.42.2(pid=2667): Launched 09:45:05.862098 run osmo-stp_10.42.42.5: Starting osmo-stp 09:45:06.376366 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2669): Launched 09:45:06.681274 run osmo-stp_10.42.42.5(pid=2670): Launched 09:45:06.796272 run osmo-msc_10.42.42.6: Starting osmo-msc 09:45:07.318647 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2672): Launched 09:45:07.622522 run osmo-msc_10.42.42.6(pid=2673): Launched 09:45:07.790723 run osmo-stp_10.42.42.5(pid=2670): ERR: Terminated: ERROR {rc=1} [trial-2402↪handover_2G:oc2g+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2670)] 09:45:07.919453 run osmo-stp_10.42.42.5(pid=2670): stdout: | (launched: 2022-12-14_09:45:06.623617) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:45:08.047333 run osmo-stp_10.42.42.5(pid=2670): stderr: | 20221214094506797 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214094506797 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214094506797 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214094506797 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214094506798 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214094506798 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214094506798 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:45:08.173548 run osmo-stp_10.42.42.5(pid=2670): stdout: | (launched: 2022-12-14_09:45:06.623617) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:45:08.292930 run osmo-stp_10.42.42.5(pid=2670): stderr: | 20221214094506797 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214094506797 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214094506797 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214094506797 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214094506798 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214094506798 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214094506798 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:45:08.436529 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=2670): Process ended prematurely: osmo-stp_10.42.42.5(pid=2670) [trial-2402↪handover_2G:oc2g+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2670)] [trial-2402↪handover_2G:oc2g+bts1-sysmo↪handover.py:18] 09:45:08.444830 tst handover.py:18: Test FAILED (6.4 sec) 09:45:08.470840 run osmo-hlr_10.42.42.2(pid=2667): ERR: Terminated: ERROR {rc=237} [trial-2402↪handover_2G:oc2g+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2667)] 09:45:08.519378 run osmo-hlr_10.42.42.2(pid=2667): stdout: | (launched: 2022-12-14_09:45:05.687782) 09:45:08.568683 run osmo-hlr_10.42.42.2(pid=2667): stderr: | 20221214094505865 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214094505865 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214094505865 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214094505865 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214094505865 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214094505865 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214094505877 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/handover_2G:oc2g+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214094505886 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214094505886 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214094505886 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:45:08.638458 run osmo-msc_10.42.42.6(pid=2673): ERR: Terminated: ERROR {rc=2} [trial-2402↪handover_2G:oc2g+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2673)] 09:45:08.685804 run osmo-msc_10.42.42.6(pid=2673): stdout: | (launched: 2022-12-14_09:45:07.564869) 09:45:08.735478 run osmo-msc_10.42.42.6(pid=2673): stderr: | 20221214094507839 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214094507839 DLGLOBAL DEBUG validating counter group 0x7f734ce2dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214094507839 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214094507839 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214094507839 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214094507839 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214094507841 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214094507842 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214094507842 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214094507842 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:45:08.785047 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2666): Terminating (SIGTERM) 09:45:08.824700 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2669): Terminating (SIGTERM) 09:45:08.864170 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2672): Terminating (SIGTERM) 09:45:08.903743 --- ParallelTerminationStrategy: PID 2666 died... 09:45:08.923134 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2666): Terminated: ok {rc=0} 09:45:08.967259 --- ParallelTerminationStrategy: PID 2669 died... 09:45:08.986101 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2669): Terminated: ok {rc=0} 09:45:09.029870 --- ParallelTerminationStrategy: PID 2672 died... 09:45:09.048489 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2672): Terminated: ok {rc=0} 09:45:09.133567 bus /sierra_3: Setting Powered False 09:45:10.231684 bus /sierra_3: Setting Powered False 09:45:11.346422 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2402 handover_2G:oc2g+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 handover_2G:oc2g+bts1-trx-b200 --------------------------------------------------------------------- 09:45:12.582457 tst handover_2G:oc2g+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:45:12.587643 tst handover_2G:oc2g+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 09:45:12.638216 tst handover_2G:oc2g+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 09:45:12.664441 tst handover_2G:oc2g+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 09:45:12.715748 tst handover_2G:oc2g+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 09:45:12.766382 tst handover_2G:oc2g+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 09:45:12.793031 tst handover_2G:oc2g+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 09:45:13.345540 tst handover_2G:oc2g+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts OC-2G Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2402 handover_2G:oc2g+bts1-trx-b200 handover.py ---------------------------------------------- 09:45:13.351007 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 09:45:13.362151 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x bts (candidates: 2) 09:45:13.401947 tst handover.py: using LAC 40072 09:45:13.529749 tst handover.py: using RAC 37 09:45:13.661330 tst handover.py: using CellId 40072 09:45:13.787124 tst handover.py: using BVCI 40073 09:45:13.904887 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x bts (candidates: 2) 09:45:13.952591 tst handover.py: using LAC 40073 09:45:14.078746 tst handover.py: using RAC 38 09:45:14.204768 tst handover.py: using CellId 40073 09:45:14.330797 tst handover.py: using BVCI 40074 09:45:14.451548 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 09:45:14.463287 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 09:45:14.474633 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 09:45:14.485954 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 09:45:14.497983 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 09:45:14.510091 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x modem (candidates: 2) 09:45:14.626067 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x modem (candidates: 2) 09:45:14.746292 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:45:15.222361 run create_hlr_db(pid=2678): Launched 09:45:15.353180 bus /sierra_2: Setting Powered False 09:45:16.417579 run create_hlr_db(pid=2678): Terminated: ok {rc=0} 09:45:16.850182 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2680): Launched 09:45:17.171862 run osmo-hlr_10.42.42.2(pid=2681): Launched 09:45:17.303781 run osmo-stp_10.42.42.5: Starting osmo-stp 09:45:17.803741 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2683): Launched 09:45:18.109231 run osmo-stp_10.42.42.5(pid=2684): Launched 09:45:18.226404 run osmo-msc_10.42.42.6: Starting osmo-msc 09:45:18.751278 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2686): Launched 09:45:19.055332 run osmo-msc_10.42.42.6(pid=2687): Launched 09:45:19.223827 run osmo-stp_10.42.42.5(pid=2684): ERR: Terminated: ERROR {rc=1} [trial-2402↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2684)] 09:45:19.352295 run osmo-stp_10.42.42.5(pid=2684): stdout: | (launched: 2022-12-14_09:45:18.051547) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:45:19.480698 run osmo-stp_10.42.42.5(pid=2684): stderr: | 20221214094518227 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214094518227 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214094518227 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214094518228 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214094518228 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214094518228 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214094518228 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:45:19.607534 run osmo-stp_10.42.42.5(pid=2684): stdout: | (launched: 2022-12-14_09:45:18.051547) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:45:19.727568 run osmo-stp_10.42.42.5(pid=2684): stderr: | 20221214094518227 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214094518227 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214094518227 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214094518228 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214094518228 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214094518228 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214094518228 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:45:19.871338 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=2684): Process ended prematurely: osmo-stp_10.42.42.5(pid=2684) [trial-2402↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2684)] [trial-2402↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18] 09:45:19.879897 tst handover.py:18: Test FAILED (6.5 sec) 09:45:19.905933 run osmo-hlr_10.42.42.2(pid=2681): ERR: Terminated: ERROR {rc=237} [trial-2402↪handover_2G:oc2g+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2681)] 09:45:19.954826 run osmo-hlr_10.42.42.2(pid=2681): stdout: | (launched: 2022-12-14_09:45:17.114751) 09:45:20.004303 run osmo-hlr_10.42.42.2(pid=2681): stderr: | 20221214094517352 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214094517352 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214094517352 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214094517352 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214094517352 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214094517352 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214094517364 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/handover_2G:oc2g+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214094517373 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214094517373 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214094517373 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:45:20.073884 run osmo-msc_10.42.42.6(pid=2687): ERR: Terminated: ERROR {rc=2} [trial-2402↪handover_2G:oc2g+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2687)] 09:45:20.121507 run osmo-msc_10.42.42.6(pid=2687): stdout: | (launched: 2022-12-14_09:45:18.997991) 09:45:20.170959 run osmo-msc_10.42.42.6(pid=2687): stderr: | 20221214094519269 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214094519269 DLGLOBAL DEBUG validating counter group 0x7f5cd0116c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214094519269 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214094519269 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214094519269 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214094519270 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214094519271 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214094519272 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214094519272 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214094519272 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:45:20.220614 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2680): Terminating (SIGTERM) 09:45:20.260491 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2683): Terminating (SIGTERM) 09:45:20.300348 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2686): Terminating (SIGTERM) 09:45:20.340542 --- ParallelTerminationStrategy: PID 2680 died... 09:45:20.360149 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2680): Terminated: ok {rc=0} 09:45:20.404414 --- ParallelTerminationStrategy: PID 2683 died... 09:45:20.423700 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2683): Terminated: ok {rc=0} 09:45:20.467773 --- ParallelTerminationStrategy: PID 2686 died... 09:45:20.487107 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2686): Terminated: ok {rc=0} 09:45:20.573916 bus /sierra_3: Setting Powered False 09:45:21.671581 bus /sierra_3: Setting Powered False 09:45:22.786570 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2402 handover_2G:oc2g+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 handover_2G:oc2g+bts1-trx-umtrx --------------------------------------------------------------------- 09:45:24.040765 tst handover_2G:oc2g+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:45:24.046692 tst handover_2G:oc2g+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 09:45:24.097945 tst handover_2G:oc2g+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 09:45:24.125294 tst handover_2G:oc2g+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 09:45:24.176645 tst handover_2G:oc2g+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 09:45:24.228415 tst handover_2G:oc2g+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 09:45:24.255581 tst handover_2G:oc2g+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 09:45:24.802180 tst handover_2G:oc2g+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts OC-2G UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2402 handover_2G:oc2g+bts1-trx-umtrx handover.py ---------------------------------------------- 09:45:24.808226 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 09:45:24.819733 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 09:45:24.854352 tst handover.py: using LAC 40074 09:45:24.973603 tst handover.py: using RAC 39 09:45:25.098609 tst handover.py: using CellId 40074 09:45:25.224611 tst handover.py: using BVCI 40075 09:45:25.340519 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 09:45:25.393042 tst handover.py: using LAC 40075 09:45:25.530992 tst handover.py: using RAC 40 09:45:25.655663 tst handover.py: using CellId 40075 09:45:25.781185 tst handover.py: using BVCI 40076 09:45:25.898466 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 09:45:25.909797 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 09:45:25.920792 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 09:45:25.931831 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 09:45:25.943123 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 09:45:25.954430 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 09:45:26.070920 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 09:45:26.187057 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:45:26.626628 run create_hlr_db(pid=2692): Launched 09:45:26.740892 bus /sierra_2: Setting Powered False 09:45:27.800380 run create_hlr_db(pid=2692): Terminated: ok {rc=0} 09:45:28.193413 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2694): Launched 09:45:28.494362 run osmo-hlr_10.42.42.2(pid=2695): Launched 09:45:28.608822 run osmo-stp_10.42.42.5: Starting osmo-stp 09:45:29.115053 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2697): Launched 09:45:29.414522 run osmo-stp_10.42.42.5(pid=2698): Launched 09:45:29.528058 run osmo-msc_10.42.42.6: Starting osmo-msc 09:45:30.044265 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2700): Launched 09:45:30.345850 run osmo-msc_10.42.42.6(pid=2701): Launched 09:45:30.512850 run osmo-stp_10.42.42.5(pid=2698): ERR: Terminated: ERROR {rc=1} [trial-2402↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2698)] 09:45:30.639226 run osmo-stp_10.42.42.5(pid=2698): stdout: | (launched: 2022-12-14_09:45:29.357765) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:45:30.766327 run osmo-stp_10.42.42.5(pid=2698): stderr: | 20221214094529528 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214094529528 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214094529528 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214094529529 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214094529529 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214094529529 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214094529529 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:45:30.913224 run osmo-stp_10.42.42.5(pid=2698): stdout: | (launched: 2022-12-14_09:45:29.357765) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:45:31.043799 run osmo-stp_10.42.42.5(pid=2698): stderr: | 20221214094529528 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214094529528 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214094529528 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214094529529 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214094529529 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214094529529 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214094529529 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:45:31.214342 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=2698): Process ended prematurely: osmo-stp_10.42.42.5(pid=2698) [trial-2402↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2698)] [trial-2402↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18] 09:45:31.224161 tst handover.py:18: Test FAILED (6.4 sec) 09:45:31.252761 run osmo-hlr_10.42.42.2(pid=2695): ERR: Terminated: ERROR {rc=237} [trial-2402↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2695)] 09:45:31.307092 run osmo-hlr_10.42.42.2(pid=2695): stdout: | (launched: 2022-12-14_09:45:28.437447) 09:45:31.362008 run osmo-hlr_10.42.42.2(pid=2695): stderr: | 20221214094528615 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214094528615 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214094528615 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214094528615 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214094528615 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214094528615 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214094528628 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/handover_2G:oc2g+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214094528636 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214094528636 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214094528636 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:45:31.440669 run osmo-msc_10.42.42.6(pid=2701): ERR: Terminated: ERROR {rc=2} [trial-2402↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2701)] 09:45:31.492010 run osmo-msc_10.42.42.6(pid=2701): stdout: | (launched: 2022-12-14_09:45:30.288212) 09:45:31.547797 run osmo-msc_10.42.42.6(pid=2701): stderr: | 20221214094530558 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214094530558 DLGLOBAL DEBUG validating counter group 0x7fe82b998c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214094530558 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214094530558 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214094530559 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214094530559 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214094530560 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214094530561 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214094530561 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214094530561 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:45:31.601916 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2694): Terminating (SIGTERM) 09:45:31.647221 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2697): Terminating (SIGTERM) 09:45:31.693706 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2700): Terminating (SIGTERM) 09:45:31.740502 --- ParallelTerminationStrategy: PID 2694 died... 09:45:31.762641 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2694): Terminated: ok {rc=0} 09:45:31.813477 --- ParallelTerminationStrategy: PID 2697 died... 09:45:31.833793 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2697): Terminated: ok {rc=0} 09:45:31.882506 --- ParallelTerminationStrategy: PID 2700 died... 09:45:31.903576 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2700): Terminated: ok {rc=0} 09:45:31.996251 bus /sierra_3: Setting Powered False 09:45:33.096055 bus /sierra_3: Setting Powered False 09:45:34.213113 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2402 handover_2G:oc2g+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 handover_2G:octphy+bts1-trx-lms --------------------------------------------------------------------- 09:45:35.468407 tst handover_2G:octphy+bts1-trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:45:35.473914 tst handover_2G:octphy+bts1-trx-lms: Verifying 2 x bts (candidates: 11) 09:45:35.523975 tst handover_2G:octphy+bts1-trx-lms: Verifying 6 x ip_address (candidates: 9) 09:45:35.551233 tst handover_2G:octphy+bts1-trx-lms: Verifying 2 x modem (candidates: 12) 09:45:35.603384 tst handover_2G:octphy+bts1-trx-lms: Reserving 2 x bts (candidates: 11) 09:45:35.652567 tst handover_2G:octphy+bts1-trx-lms: Reserving 6 x ip_address (candidates: 9) 09:45:35.679421 tst handover_2G:octphy+bts1-trx-lms: Reserving 2 x modem (candidates: 12) 09:45:36.228587 tst handover_2G:octphy+bts1-trx-lms: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2402 handover_2G:octphy+bts1-trx-lms handover.py ---------------------------------------------- 09:45:36.234129 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 09:45:36.245010 tst handover_2G:octphy+bts1-trx-lms: Using 1 x bts (candidates: 2) 09:45:36.278069 tst handover.py: using LAC 40076 09:45:36.398123 tst handover.py: using RAC 41 09:45:36.515603 tst handover.py: using CellId 40076 09:45:36.633366 tst handover.py: using BVCI 40077 09:45:36.744020 tst handover_2G:octphy+bts1-trx-lms: Using 1 x bts (candidates: 2) 09:45:36.791678 tst handover.py: using LAC 40077 09:45:36.910332 tst handover.py: using RAC 42 09:45:37.026720 tst handover.py: using CellId 40077 09:45:37.145378 tst handover.py: using BVCI 40078 09:45:37.255917 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 09:45:37.266768 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 09:45:37.277578 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 09:45:37.288070 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 09:45:37.299155 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 09:45:37.310154 tst handover_2G:octphy+bts1-trx-lms: Using 1 x modem (candidates: 2) 09:45:37.429760 tst handover_2G:octphy+bts1-trx-lms: Using 1 x modem (candidates: 2) 09:45:37.550453 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:45:37.989233 run create_hlr_db(pid=2706): Launched 09:45:38.102792 bus /sierra_2: Setting Powered False 09:45:39.162936 run create_hlr_db(pid=2706): Terminated: ok {rc=0} 09:45:39.555244 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2708): Launched 09:45:39.856723 run osmo-hlr_10.42.42.2(pid=2709): Launched 09:45:39.971451 run osmo-stp_10.42.42.5: Starting osmo-stp 09:45:40.475029 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2711): Launched 09:45:40.775119 run osmo-stp_10.42.42.5(pid=2712): Launched 09:45:40.888478 run osmo-msc_10.42.42.6: Starting osmo-msc 09:45:41.416644 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2714): Launched 09:45:41.717043 run osmo-msc_10.42.42.6(pid=2715): Launched 09:45:41.884794 run osmo-stp_10.42.42.5(pid=2712): ERR: Terminated: ERROR {rc=1} [trial-2402↪handover_2G:octphy+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2712)] 09:45:42.012527 run osmo-stp_10.42.42.5(pid=2712): stdout: | (launched: 2022-12-14_09:45:40.718590) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:45:42.140407 run osmo-stp_10.42.42.5(pid=2712): stderr: | 20221214094540888 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214094540888 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214094540888 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214094540889 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214094540889 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214094540889 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214094540890 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:45:42.265533 run osmo-stp_10.42.42.5(pid=2712): stdout: | (launched: 2022-12-14_09:45:40.718590) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:45:42.384286 run osmo-stp_10.42.42.5(pid=2712): stderr: | 20221214094540888 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214094540888 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214094540888 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214094540889 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214094540889 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214094540889 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214094540890 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:45:42.526692 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=2712): Process ended prematurely: osmo-stp_10.42.42.5(pid=2712) [trial-2402↪handover_2G:octphy+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2712)] [trial-2402↪handover_2G:octphy+bts1-trx-lms↪handover.py:18] 09:45:42.535005 tst handover.py:18: Test FAILED (6.3 sec) 09:45:42.561046 run osmo-hlr_10.42.42.2(pid=2709): ERR: Terminated: ERROR {rc=237} [trial-2402↪handover_2G:octphy+bts1-trx-lms↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2709)] 09:45:42.610134 run osmo-hlr_10.42.42.2(pid=2709): stdout: | (launched: 2022-12-14_09:45:39.799767) 09:45:42.659901 run osmo-hlr_10.42.42.2(pid=2709): stderr: | 20221214094539977 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214094539977 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214094539977 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214094539977 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214094539977 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214094539977 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214094539989 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/handover_2G:octphy+bts1-trx-lms/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214094539997 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214094539997 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214094539998 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:45:42.729187 run osmo-msc_10.42.42.6(pid=2715): ERR: Terminated: ERROR {rc=2} [trial-2402↪handover_2G:octphy+bts1-trx-lms↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2715)] 09:45:42.776560 run osmo-msc_10.42.42.6(pid=2715): stdout: | (launched: 2022-12-14_09:45:41.661012) 09:45:42.825980 run osmo-msc_10.42.42.6(pid=2715): stderr: | 20221214094541928 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214094541928 DLGLOBAL DEBUG validating counter group 0x7f4b4a538c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214094541928 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214094541928 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214094541929 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214094541929 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214094541930 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214094541931 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214094541931 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214094541931 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:45:42.875851 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2708): Terminating (SIGTERM) 09:45:42.915317 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2711): Terminating (SIGTERM) 09:45:42.955039 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2714): Terminating (SIGTERM) 09:45:42.994901 --- ParallelTerminationStrategy: PID 2708 died... 09:45:43.014468 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2708): Terminated: ok {rc=0} 09:45:43.058483 --- ParallelTerminationStrategy: PID 2711 died... 09:45:43.077390 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2711): Terminated: ok {rc=0} 09:45:43.121340 --- ParallelTerminationStrategy: PID 2714 died... 09:45:43.140241 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2714): Terminated: ok {rc=0} 09:45:43.223273 bus /sierra_3: Setting Powered False 09:45:44.320648 bus /sierra_3: Setting Powered False 09:45:45.436672 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2402 handover_2G:octphy+bts1-trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 handover_2G:octphy+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 09:45:46.720994 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:45:46.728114 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 09:45:46.788574 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 09:45:46.817312 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 09:45:46.876044 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 09:45:46.923078 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 09:45:46.951483 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 09:45:47.498643 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2402 handover_2G:octphy+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 09:45:47.504249 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 09:45:47.515442 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 09:45:47.548758 tst handover.py: using LAC 40078 09:45:47.666632 tst handover.py: using RAC 43 09:45:47.783240 tst handover.py: using CellId 40078 09:45:47.899646 tst handover.py: using BVCI 40079 09:45:48.008481 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 09:45:48.051131 tst handover.py: using LAC 40079 09:45:48.169323 tst handover.py: using RAC 44 09:45:48.286563 tst handover.py: using CellId 40079 09:45:48.407592 tst handover.py: using BVCI 40080 09:45:48.517833 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 09:45:48.528931 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 09:45:48.539870 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 09:45:48.550883 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 09:45:48.562699 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 09:45:48.574443 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 09:45:48.693881 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 09:45:48.813034 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:45:49.282023 run create_hlr_db(pid=2720): Launched 09:45:49.413965 bus /sierra_2: Setting Powered False 09:45:50.477787 run create_hlr_db(pid=2720): Terminated: ok {rc=0} 09:45:50.881730 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2722): Launched 09:45:51.182531 run osmo-hlr_10.42.42.2(pid=2723): Launched 09:45:51.296430 run osmo-stp_10.42.42.5: Starting osmo-stp 09:45:51.787592 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2725): Launched 09:45:52.099131 run osmo-stp_10.42.42.5(pid=2727): Launched 09:45:52.213514 run osmo-msc_10.42.42.6: Starting osmo-msc 09:45:52.730109 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2729): Launched 09:45:53.030672 run osmo-msc_10.42.42.6(pid=2730): Launched 09:45:53.196497 run osmo-stp_10.42.42.5(pid=2727): ERR: Terminated: ERROR {rc=1} [trial-2402↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2727)] 09:45:53.324299 run osmo-stp_10.42.42.5(pid=2727): stdout: | (launched: 2022-12-14_09:45:52.039680) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:45:53.451239 run osmo-stp_10.42.42.5(pid=2727): stderr: | 20221214094552211 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214094552211 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214094552212 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214094552212 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214094552213 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214094552213 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214094552213 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:45:53.576586 run osmo-stp_10.42.42.5(pid=2727): stdout: | (launched: 2022-12-14_09:45:52.039680) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:45:53.695184 run osmo-stp_10.42.42.5(pid=2727): stderr: | 20221214094552211 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214094552211 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214094552212 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214094552212 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214094552213 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214094552213 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214094552213 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:45:53.837228 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=2727): Process ended prematurely: osmo-stp_10.42.42.5(pid=2727) [trial-2402↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2727)] [trial-2402↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18] 09:45:53.845606 tst handover.py:18: Test FAILED (6.3 sec) 09:45:53.871567 run osmo-hlr_10.42.42.2(pid=2723): ERR: Terminated: ERROR {rc=237} [trial-2402↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2723)] 09:45:53.919996 run osmo-hlr_10.42.42.2(pid=2723): stdout: | (launched: 2022-12-14_09:45:51.126075) 09:45:53.969644 run osmo-hlr_10.42.42.2(pid=2723): stderr: | 20221214094551301 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214094551301 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214094551301 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214094551301 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214094551301 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214094551301 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214094551314 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/handover_2G:octphy+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214094551322 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214094551322 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214094551322 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:45:54.039028 run osmo-msc_10.42.42.6(pid=2730): ERR: Terminated: ERROR {rc=2} [trial-2402↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2730)] 09:45:54.086457 run osmo-msc_10.42.42.6(pid=2730): stdout: | (launched: 2022-12-14_09:45:52.974285) 09:45:54.135988 run osmo-msc_10.42.42.6(pid=2730): stderr: | 20221214094553241 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214094553241 DLGLOBAL DEBUG validating counter group 0x7f5c86db0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214094553241 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214094553241 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214094553242 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214094553242 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214094553243 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214094553244 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214094553244 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214094553244 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:45:54.185623 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2722): Terminating (SIGTERM) 09:45:54.225058 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2725): Terminating (SIGTERM) 09:45:54.264434 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2729): Terminating (SIGTERM) 09:45:54.303868 --- ParallelTerminationStrategy: PID 2722 died... 09:45:54.323348 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2722): Terminated: ok {rc=0} 09:45:54.367194 --- ParallelTerminationStrategy: PID 2725 died... 09:45:54.385896 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2725): Terminated: ok {rc=0} 09:45:54.429607 --- ParallelTerminationStrategy: PID 2729 died... 09:45:54.448537 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2729): Terminated: ok {rc=0} 09:45:54.531831 bus /sierra_3: Setting Powered False 09:45:55.628126 bus /sierra_3: Setting Powered False 09:45:56.746220 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2402 handover_2G:octphy+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 handover_2G:octphy+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 09:45:57.994495 tst handover_2G:octphy+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:45:57.999571 tst handover_2G:octphy+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 09:45:58.048829 tst handover_2G:octphy+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 09:45:58.075034 tst handover_2G:octphy+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 09:45:58.126113 tst handover_2G:octphy+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 09:45:58.177540 tst handover_2G:octphy+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 09:45:58.204389 tst handover_2G:octphy+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 09:45:58.751823 tst handover_2G:octphy+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2402 handover_2G:octphy+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 09:45:58.758094 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 09:45:58.770154 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 09:45:58.805090 tst handover.py: using LAC 40080 09:45:58.922925 tst handover.py: using RAC 45 09:45:59.041532 tst handover.py: using CellId 40080 09:45:59.159872 tst handover.py: using BVCI 40081 09:45:59.278963 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 09:45:59.329351 tst handover.py: using LAC 40081 09:45:59.460006 tst handover.py: using RAC 46 09:45:59.585375 tst handover.py: using CellId 40081 09:45:59.709353 tst handover.py: using BVCI 40082 09:45:59.826069 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 09:45:59.837546 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 09:45:59.848697 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 09:45:59.860092 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 09:45:59.871815 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 09:45:59.883624 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 09:45:59.999417 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 09:46:00.115138 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:46:00.586079 run create_hlr_db(pid=2735): Launched 09:46:00.716342 bus /sierra_2: Setting Powered False 09:46:01.796191 run create_hlr_db(pid=2735): Terminated: ok {rc=0} 09:46:02.274194 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2737): Launched 09:46:02.576272 run osmo-hlr_10.42.42.2(pid=2738): Launched 09:46:02.692828 run osmo-stp_10.42.42.5: Starting osmo-stp 09:46:03.199682 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2740): Launched 09:46:03.501491 run osmo-stp_10.42.42.5(pid=2741): Launched 09:46:03.615528 run osmo-msc_10.42.42.6: Starting osmo-msc 09:46:04.137321 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2743): Launched 09:46:04.439233 run osmo-msc_10.42.42.6(pid=2744): Launched 09:46:04.607027 run osmo-stp_10.42.42.5(pid=2741): ERR: Terminated: ERROR {rc=1} [trial-2402↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2741)] 09:46:04.735784 run osmo-stp_10.42.42.5(pid=2741): stdout: | (launched: 2022-12-14_09:46:03.446034) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:46:04.864628 run osmo-stp_10.42.42.5(pid=2741): stderr: | 20221214094603614 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214094603614 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214094603614 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214094603615 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214094603615 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214094603615 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214094603615 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:46:04.990853 run osmo-stp_10.42.42.5(pid=2741): stdout: | (launched: 2022-12-14_09:46:03.446034) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:46:05.111044 run osmo-stp_10.42.42.5(pid=2741): stderr: | 20221214094603614 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214094603614 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214094603614 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214094603615 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214094603615 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214094603615 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214094603615 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:46:05.254652 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=2741): Process ended prematurely: osmo-stp_10.42.42.5(pid=2741) [trial-2402↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2741)] [trial-2402↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18] 09:46:05.263046 tst handover.py:18: Test FAILED (6.5 sec) 09:46:05.289066 run osmo-hlr_10.42.42.2(pid=2738): ERR: Terminated: ERROR {rc=237} [trial-2402↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2738)] 09:46:05.337144 run osmo-hlr_10.42.42.2(pid=2738): stdout: | (launched: 2022-12-14_09:46:02.520565) 09:46:05.386612 run osmo-hlr_10.42.42.2(pid=2738): stderr: | 20221214094602690 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214094602690 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214094602690 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214094602690 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214094602690 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214094602690 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214094602702 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/handover_2G:octphy+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214094602710 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214094602711 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214094602711 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:46:05.455669 run osmo-msc_10.42.42.6(pid=2744): ERR: Terminated: ERROR {rc=2} [trial-2402↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2744)] 09:46:05.502960 run osmo-msc_10.42.42.6(pid=2744): stdout: | (launched: 2022-12-14_09:46:04.383618) 09:46:05.552562 run osmo-msc_10.42.42.6(pid=2744): stderr: | 20221214094604654 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214094604654 DLGLOBAL DEBUG validating counter group 0x7ff05311bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214094604655 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214094604655 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214094604655 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214094604655 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214094604657 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214094604657 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214094604657 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214094604657 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:46:05.602377 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2737): Terminating (SIGTERM) 09:46:05.641755 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2740): Terminating (SIGTERM) 09:46:05.681339 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2743): Terminating (SIGTERM) 09:46:05.720933 --- ParallelTerminationStrategy: PID 2737 died... 09:46:05.740386 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2737): Terminated: ok {rc=0} 09:46:05.784825 --- ParallelTerminationStrategy: PID 2740 died... 09:46:05.804414 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2740): Terminated: ok {rc=0} 09:46:05.848086 --- ParallelTerminationStrategy: PID 2743 died... 09:46:05.867095 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2743): Terminated: ok {rc=0} 09:46:05.952255 bus /sierra_3: Setting Powered False 09:46:07.051269 bus /sierra_3: Setting Powered False 09:46:08.165128 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2402 handover_2G:octphy+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 handover_2G:octphy+bts1-sysmo --------------------------------------------------------------------- 09:46:09.422312 tst handover_2G:octphy+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:46:09.427428 tst handover_2G:octphy+bts1-sysmo: Verifying 2 x bts (candidates: 11) 09:46:09.464001 tst handover_2G:octphy+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 09:46:09.491148 tst handover_2G:octphy+bts1-sysmo: Verifying 2 x modem (candidates: 12) 09:46:09.543195 tst handover_2G:octphy+bts1-sysmo: Reserving 2 x bts (candidates: 11) 09:46:09.580140 tst handover_2G:octphy+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 09:46:09.606888 tst handover_2G:octphy+bts1-sysmo: Reserving 2 x modem (candidates: 12) 09:46:10.154562 tst handover_2G:octphy+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2402 handover_2G:octphy+bts1-sysmo handover.py ---------------------------------------------- 09:46:10.159900 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 09:46:10.170941 tst handover_2G:octphy+bts1-sysmo: Using 1 x bts (candidates: 2) 09:46:10.203505 tst handover.py: using LAC 40082 09:46:10.324856 tst handover.py: using RAC 47 09:46:10.445512 tst handover.py: using CellId 40082 09:46:10.574312 tst handover.py: using BVCI 40083 09:46:10.693387 tst handover_2G:octphy+bts1-sysmo: Using 1 x bts (candidates: 2) 09:46:10.729406 tst handover.py: using LAC 40083 09:46:10.857380 tst handover.py: using RAC 48 09:46:10.985592 tst handover.py: using CellId 40083 09:46:11.107389 tst handover.py: using BVCI 40084 09:46:11.219495 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 09:46:11.230632 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 09:46:11.241460 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 09:46:11.252136 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 09:46:11.263425 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 09:46:11.274516 tst handover_2G:octphy+bts1-sysmo: Using 1 x modem (candidates: 2) 09:46:11.390126 tst handover_2G:octphy+bts1-sysmo: Using 1 x modem (candidates: 2) 09:46:11.510164 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:46:11.982303 run create_hlr_db(pid=2749): Launched 09:46:12.114939 bus /sierra_2: Setting Powered False 09:46:13.178402 run create_hlr_db(pid=2749): Terminated: ok {rc=0} 09:46:13.582872 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2751): Launched 09:46:13.885229 run osmo-hlr_10.42.42.2(pid=2752): Launched 09:46:14.000786 run osmo-stp_10.42.42.5: Starting osmo-stp 09:46:14.508589 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2754): Launched 09:46:14.810834 run osmo-stp_10.42.42.5(pid=2755): Launched 09:46:14.926523 run osmo-msc_10.42.42.6: Starting osmo-msc 09:46:15.446448 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2757): Launched 09:46:15.748570 run osmo-msc_10.42.42.6(pid=2758): Launched 09:46:16.047742 run osmo-stp_10.42.42.5(pid=2755): ERR: Terminated: ERROR {rc=1} [trial-2402↪handover_2G:octphy+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2755)] 09:46:16.447751 run osmo-stp_10.42.42.5(pid=2755): stdout: | (launched: 2022-12-14_09:46:14.755059) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:46:16.587597 run osmo-stp_10.42.42.5(pid=2755): stderr: | 20221214094614922 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214094614922 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214094614922 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214094614923 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214094614923 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214094614923 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214094614923 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:46:16.727739 run osmo-stp_10.42.42.5(pid=2755): stdout: | (launched: 2022-12-14_09:46:14.755059) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:46:16.859933 run osmo-stp_10.42.42.5(pid=2755): stderr: | 20221214094614922 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214094614922 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214094614922 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214094614923 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214094614923 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214094614923 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214094614923 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:46:17.018044 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=2755): Process ended prematurely: osmo-stp_10.42.42.5(pid=2755) [trial-2402↪handover_2G:octphy+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2755)] [trial-2402↪handover_2G:octphy+bts1-sysmo↪handover.py:18] 09:46:17.027614 tst handover.py:18: Test FAILED (6.9 sec) 09:46:17.055936 run osmo-hlr_10.42.42.2(pid=2752): ERR: Terminated: ERROR {rc=237} [trial-2402↪handover_2G:octphy+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2752)] 09:46:17.107611 run osmo-hlr_10.42.42.2(pid=2752): stdout: | (launched: 2022-12-14_09:46:13.828703) 09:46:17.162182 run osmo-hlr_10.42.42.2(pid=2752): stderr: | 20221214094614001 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214094614001 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214094614001 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214094614002 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214094614002 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214094614002 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214094614017 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/handover_2G:octphy+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214094614025 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214094614025 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214094614025 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:46:17.236931 run osmo-msc_10.42.42.6(pid=2758): ERR: Terminated: ERROR {rc=2} [trial-2402↪handover_2G:octphy+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2758)] 09:46:17.288209 run osmo-msc_10.42.42.6(pid=2758): stdout: | (launched: 2022-12-14_09:46:15.693055) 09:46:17.340673 run osmo-msc_10.42.42.6(pid=2758): stderr: | 20221214094616076 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214094616077 DLGLOBAL DEBUG validating counter group 0x7f834bcfcc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214094616077 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214094616077 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214094616077 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214094616077 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214094616079 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214094616079 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214094616079 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214094616079 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:46:17.393563 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2751): Terminating (SIGTERM) 09:46:17.434298 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2754): Terminating (SIGTERM) 09:46:17.474998 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2757): Terminating (SIGTERM) 09:46:17.515920 --- ParallelTerminationStrategy: PID 2751 died... 09:46:17.536059 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2751): Terminated: ok {rc=0} 09:46:17.581118 --- ParallelTerminationStrategy: PID 2754 died... 09:46:17.600695 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2754): Terminated: ok {rc=0} 09:46:17.645692 --- ParallelTerminationStrategy: PID 2757 died... 09:46:17.665334 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2757): Terminated: ok {rc=0} 09:46:17.752534 bus /sierra_3: Setting Powered False 09:46:18.851750 bus /sierra_3: Setting Powered False 09:46:19.967223 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2402 handover_2G:octphy+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 handover_2G:octphy+bts1-trx-b200 --------------------------------------------------------------------- 09:46:21.203527 tst handover_2G:octphy+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:46:21.208808 tst handover_2G:octphy+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 09:46:21.258665 tst handover_2G:octphy+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 09:46:21.285045 tst handover_2G:octphy+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 09:46:21.338109 tst handover_2G:octphy+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 09:46:21.387566 tst handover_2G:octphy+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 09:46:21.413740 tst handover_2G:octphy+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 09:46:21.961620 tst handover_2G:octphy+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2402 handover_2G:octphy+bts1-trx-b200 handover.py ---------------------------------------------- 09:46:21.966908 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 09:46:21.977754 tst handover_2G:octphy+bts1-trx-b200: Using 1 x bts (candidates: 2) 09:46:22.010259 tst handover.py: using LAC 40084 09:46:22.133327 tst handover.py: using RAC 49 09:46:22.252463 tst handover.py: using CellId 40084 09:46:22.380004 tst handover.py: using BVCI 40085 09:46:22.498328 tst handover_2G:octphy+bts1-trx-b200: Using 1 x bts (candidates: 2) 09:46:22.546636 tst handover.py: using LAC 40085 09:46:22.672133 tst handover.py: using RAC 50 09:46:22.797769 tst handover.py: using CellId 40085 09:46:22.925319 tst handover.py: using BVCI 40086 09:46:23.043331 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 09:46:23.054775 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 09:46:23.065939 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 09:46:23.077090 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 09:46:23.088418 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 09:46:23.099913 tst handover_2G:octphy+bts1-trx-b200: Using 1 x modem (candidates: 2) 09:46:23.216251 tst handover_2G:octphy+bts1-trx-b200: Using 1 x modem (candidates: 2) 09:46:23.335319 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:46:23.809342 run create_hlr_db(pid=2763): Launched 09:46:23.939703 bus /sierra_2: Setting Powered False 09:46:25.004205 run create_hlr_db(pid=2763): Terminated: ok {rc=0} 09:46:25.409868 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2765): Launched 09:46:25.712822 run osmo-hlr_10.42.42.2(pid=2766): Launched 09:46:25.828143 run osmo-stp_10.42.42.5: Starting osmo-stp 09:46:26.335715 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2768): Launched 09:46:26.636202 run osmo-stp_10.42.42.5(pid=2769): Launched 09:46:26.750895 run osmo-msc_10.42.42.6: Starting osmo-msc 09:46:27.271467 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2771): Launched 09:46:27.573054 run osmo-msc_10.42.42.6(pid=2772): Launched 09:46:27.743615 run osmo-stp_10.42.42.5(pid=2769): ERR: Terminated: ERROR {rc=1} [trial-2402↪handover_2G:octphy+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2769)] 09:46:27.872450 run osmo-stp_10.42.42.5(pid=2769): stdout: | (launched: 2022-12-14_09:46:26.580585) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:46:28.000715 run osmo-stp_10.42.42.5(pid=2769): stderr: | 20221214094626748 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214094626748 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214094626748 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214094626749 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214094626749 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214094626749 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214094626749 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:46:28.127414 run osmo-stp_10.42.42.5(pid=2769): stdout: | (launched: 2022-12-14_09:46:26.580585) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:46:28.247000 run osmo-stp_10.42.42.5(pid=2769): stderr: | 20221214094626748 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214094626748 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214094626748 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214094626749 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214094626749 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214094626749 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214094626749 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:46:28.390424 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=2769): Process ended prematurely: osmo-stp_10.42.42.5(pid=2769) [trial-2402↪handover_2G:octphy+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2769)] [trial-2402↪handover_2G:octphy+bts1-trx-b200↪handover.py:18] 09:46:28.398601 tst handover.py:18: Test FAILED (6.4 sec) 09:46:28.424528 run osmo-hlr_10.42.42.2(pid=2766): ERR: Terminated: ERROR {rc=237} [trial-2402↪handover_2G:octphy+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2766)] 09:46:28.472570 run osmo-hlr_10.42.42.2(pid=2766): stdout: | (launched: 2022-12-14_09:46:25.656673) 09:46:28.522249 run osmo-hlr_10.42.42.2(pid=2766): stderr: | 20221214094625831 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214094625831 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214094625831 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214094625831 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214094625831 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214094625831 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214094625846 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/handover_2G:octphy+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214094625856 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214094625856 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214094625856 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:46:28.591668 run osmo-msc_10.42.42.6(pid=2772): ERR: Terminated: ERROR {rc=2} [trial-2402↪handover_2G:octphy+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2772)] 09:46:28.639983 run osmo-msc_10.42.42.6(pid=2772): stdout: | (launched: 2022-12-14_09:46:27.517394) 09:46:28.689478 run osmo-msc_10.42.42.6(pid=2772): stderr: | 20221214094627786 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214094627786 DLGLOBAL DEBUG validating counter group 0x7f12360e7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214094627786 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214094627787 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214094627787 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214094627787 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214094627789 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214094627789 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214094627789 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214094627789 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:46:28.739110 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2765): Terminating (SIGTERM) 09:46:28.779130 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2768): Terminating (SIGTERM) 09:46:28.819140 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2771): Terminating (SIGTERM) 09:46:28.859130 --- ParallelTerminationStrategy: PID 2765 died... 09:46:28.878722 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2765): Terminated: ok {rc=0} 09:46:28.922937 --- ParallelTerminationStrategy: PID 2768 died... 09:46:28.941961 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2768): Terminated: ok {rc=0} 09:46:28.985972 --- ParallelTerminationStrategy: PID 2771 died... 09:46:29.004831 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2771): Terminated: ok {rc=0} 09:46:29.090809 bus /sierra_3: Setting Powered False 09:46:30.187655 bus /sierra_3: Setting Powered False 09:46:31.300137 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2402 handover_2G:octphy+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 handover_2G:octphy+bts1-trx-umtrx --------------------------------------------------------------------- 09:46:32.560627 tst handover_2G:octphy+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:46:32.566211 tst handover_2G:octphy+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 09:46:32.615801 tst handover_2G:octphy+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 09:46:32.643182 tst handover_2G:octphy+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 09:46:32.695448 tst handover_2G:octphy+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 09:46:32.745695 tst handover_2G:octphy+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 09:46:32.773284 tst handover_2G:octphy+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 09:46:33.323756 tst handover_2G:octphy+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2402 handover_2G:octphy+bts1-trx-umtrx handover.py ---------------------------------------------- 09:46:33.330185 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 09:46:33.341786 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 09:46:33.373705 tst handover.py: using LAC 40086 09:46:33.492737 tst handover.py: using RAC 51 09:46:33.611295 tst handover.py: using CellId 40086 09:46:33.736008 tst handover.py: using BVCI 40087 09:46:33.847257 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 09:46:33.897781 tst handover.py: using LAC 40087 09:46:34.024291 tst handover.py: using RAC 52 09:46:34.150607 tst handover.py: using CellId 40087 09:46:34.275673 tst handover.py: using BVCI 40088 09:46:34.393190 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 09:46:34.404731 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 09:46:34.416094 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 09:46:34.427232 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 09:46:34.438762 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 09:46:34.450495 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 09:46:34.566965 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 09:46:34.688746 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:46:35.162406 run create_hlr_db(pid=2777): Launched 09:46:35.293284 bus /sierra_2: Setting Powered False 09:46:36.357805 run create_hlr_db(pid=2777): Terminated: ok {rc=0} 09:46:36.765709 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2779): Launched 09:46:37.068937 run osmo-hlr_10.42.42.2(pid=2780): Launched 09:46:37.185101 run osmo-stp_10.42.42.5: Starting osmo-stp 09:46:37.681180 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2782): Launched 09:46:38.005857 run osmo-stp_10.42.42.5(pid=2783): Launched 09:46:38.128359 run osmo-msc_10.42.42.6: Starting osmo-msc 09:46:38.686907 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2785): Launched 09:46:39.011676 run osmo-msc_10.42.42.6(pid=2786): Launched 09:46:39.191868 run osmo-stp_10.42.42.5(pid=2783): ERR: Terminated: ERROR {rc=1} [trial-2402↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2783)] 09:46:39.328654 run osmo-stp_10.42.42.5(pid=2783): stdout: | (launched: 2022-12-14_09:46:37.946201) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:46:39.465480 run osmo-stp_10.42.42.5(pid=2783): stderr: | 20221214094638134 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214094638134 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214094638134 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214094638135 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214094638135 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214094638135 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214094638135 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:46:39.601455 run osmo-stp_10.42.42.5(pid=2783): stdout: | (launched: 2022-12-14_09:46:37.946201) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:46:39.729739 run osmo-stp_10.42.42.5(pid=2783): stderr: | 20221214094638134 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214094638134 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214094638134 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214094638135 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214094638135 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214094638135 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214094638135 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:46:39.883297 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=2783): Process ended prematurely: osmo-stp_10.42.42.5(pid=2783) [trial-2402↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2783)] [trial-2402↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18] 09:46:39.892343 tst handover.py:18: Test FAILED (6.6 sec) 09:46:39.920001 run osmo-hlr_10.42.42.2(pid=2780): ERR: Terminated: ERROR {rc=237} [trial-2402↪handover_2G:octphy+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2780)] 09:46:39.970703 run osmo-hlr_10.42.42.2(pid=2780): stdout: | (launched: 2022-12-14_09:46:37.012861) 09:46:40.023296 run osmo-hlr_10.42.42.2(pid=2780): stderr: | 20221214094637185 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214094637185 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214094637185 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214094637185 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214094637185 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214094637185 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214094637211 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/handover_2G:octphy+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214094637221 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214094637221 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214094637221 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:46:40.098356 run osmo-msc_10.42.42.6(pid=2786): ERR: Terminated: ERROR {rc=2} [trial-2402↪handover_2G:octphy+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2786)] 09:46:40.148733 run osmo-msc_10.42.42.6(pid=2786): stdout: | (launched: 2022-12-14_09:46:38.952549) 09:46:40.200592 run osmo-msc_10.42.42.6(pid=2786): stderr: | 20221214094639268 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214094639268 DLGLOBAL DEBUG validating counter group 0x7f3a735cac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214094639268 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214094639268 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214094639269 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214094639269 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214094639270 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214094639271 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214094639271 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214094639271 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:46:40.253311 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2779): Terminating (SIGTERM) 09:46:40.295105 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2782): Terminating (SIGTERM) 09:46:40.337058 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2785): Terminating (SIGTERM) 09:46:40.379151 --- ParallelTerminationStrategy: PID 2779 died... 09:46:40.399406 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2779): Terminated: ok {rc=0} 09:46:40.445654 --- ParallelTerminationStrategy: PID 2782 died... 09:46:40.465579 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2782): Terminated: ok {rc=0} 09:46:40.511683 --- ParallelTerminationStrategy: PID 2785 died... 09:46:40.531389 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2785): Terminated: ok {rc=0} 09:46:40.618754 bus /sierra_3: Setting Powered False 09:46:41.716848 bus /sierra_3: Setting Powered False 09:46:42.832225 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2402 handover_2G:octphy+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 handover_2G:trx-lms+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 09:46:44.084794 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:46:44.089856 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 09:46:44.148487 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 09:46:44.174635 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 09:46:44.230858 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 09:46:44.291924 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 09:46:44.319030 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 09:46:44.866438 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2402 handover_2G:trx-lms+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 09:46:44.872545 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 09:46:44.884578 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 09:46:44.932079 tst handover.py: using LAC 40088 09:46:45.057508 tst handover.py: using RAC 53 09:46:45.183949 tst handover.py: using CellId 40088 09:46:45.302783 tst handover.py: using BVCI 40089 09:46:45.414244 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 09:46:45.457554 tst handover.py: using LAC 40089 09:46:45.585154 tst handover.py: using RAC 54 09:46:45.710524 tst handover.py: using CellId 40089 09:46:45.841471 tst handover.py: using BVCI 40090 09:46:45.977466 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 09:46:45.989702 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 09:46:46.001583 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 09:46:46.013648 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 09:46:46.025775 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 09:46:46.038055 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 09:46:46.161193 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 09:46:46.310883 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:46:46.834780 run create_hlr_db(pid=2791): Launched 09:46:46.991388 bus /sierra_2: Setting Powered False 09:46:48.051289 run create_hlr_db(pid=2791): Terminated: ok {rc=0} 09:46:48.466546 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2793): Launched 09:46:48.791988 run osmo-hlr_10.42.42.2(pid=2794): Launched 09:46:48.914304 run osmo-stp_10.42.42.5: Starting osmo-stp 09:46:49.448256 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2796): Launched 09:46:49.771943 run osmo-stp_10.42.42.5(pid=2797): Launched 09:46:49.894895 run osmo-msc_10.42.42.6: Starting osmo-msc 09:46:50.451932 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2799): Launched 09:46:50.777095 run osmo-msc_10.42.42.6(pid=2800): Launched 09:46:50.958089 run osmo-stp_10.42.42.5(pid=2797): ERR: Terminated: ERROR {rc=1} [trial-2402↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2797)] 09:46:51.094035 run osmo-stp_10.42.42.5(pid=2797): stdout: | (launched: 2022-12-14_09:46:49.712596) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:46:51.230696 run osmo-stp_10.42.42.5(pid=2797): stderr: | 20221214094649900 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214094649900 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214094649900 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214094649901 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214094649901 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214094649901 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214094649901 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:46:51.365687 run osmo-stp_10.42.42.5(pid=2797): stdout: | (launched: 2022-12-14_09:46:49.712596) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:46:51.494213 run osmo-stp_10.42.42.5(pid=2797): stderr: | 20221214094649900 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214094649900 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214094649900 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214094649901 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214094649901 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214094649901 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214094649901 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:46:51.647447 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=2797): Process ended prematurely: osmo-stp_10.42.42.5(pid=2797) [trial-2402↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2797)] [trial-2402↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18] 09:46:51.656237 tst handover.py:18: Test FAILED (6.8 sec) 09:46:51.683698 run osmo-hlr_10.42.42.2(pid=2794): ERR: Terminated: ERROR {rc=237} [trial-2402↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2794)] 09:46:51.733821 run osmo-hlr_10.42.42.2(pid=2794): stdout: | (launched: 2022-12-14_09:46:48.731698) 09:46:51.785794 run osmo-hlr_10.42.42.2(pid=2794): stderr: | 20221214094648925 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214094648925 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214094648926 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214094648926 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214094648926 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214094648926 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214094648938 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/handover_2G:trx-lms+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214094648947 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214094648947 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214094648948 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:46:51.858044 run osmo-msc_10.42.42.6(pid=2800): ERR: Terminated: ERROR {rc=2} [trial-2402↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2800)] 09:46:51.908174 run osmo-msc_10.42.42.6(pid=2800): stdout: | (launched: 2022-12-14_09:46:50.717845) 09:46:51.959911 run osmo-msc_10.42.42.6(pid=2800): stderr: | 20221214094651037 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214094651037 DLGLOBAL DEBUG validating counter group 0x7f7e285e9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214094651037 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214094651037 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214094651037 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214094651037 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214094651039 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214094651039 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214094651040 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214094651040 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:46:52.012146 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2793): Terminating (SIGTERM) 09:46:52.053655 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2796): Terminating (SIGTERM) 09:46:52.095165 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2799): Terminating (SIGTERM) 09:46:52.136888 --- ParallelTerminationStrategy: PID 2793 died... 09:46:52.156848 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2793): Terminated: ok {rc=0} 09:46:52.203013 --- ParallelTerminationStrategy: PID 2796 died... 09:46:52.222492 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2796): Terminated: ok {rc=0} 09:46:52.268125 --- ParallelTerminationStrategy: PID 2799 died... 09:46:52.287580 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2799): Terminated: ok {rc=0} 09:46:52.374704 bus /sierra_3: Setting Powered False 09:46:53.473358 bus /sierra_3: Setting Powered False 09:46:54.591439 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2402 handover_2G:trx-lms+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 handover_2G:trx-lms+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 09:46:55.855304 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:46:55.860745 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 09:46:55.924163 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 09:46:55.950560 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 09:46:56.002657 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 09:46:56.067183 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 09:46:56.093456 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 09:46:56.641742 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2402 handover_2G:trx-lms+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 09:46:56.646837 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 09:46:56.657833 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 09:46:56.706613 tst handover.py: using LAC 40090 09:46:56.833846 tst handover.py: using RAC 55 09:46:56.961355 tst handover.py: using CellId 40090 09:46:57.087492 tst handover.py: using BVCI 40091 09:46:57.205452 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 09:46:57.255455 tst handover.py: using LAC 40091 09:46:57.383976 tst handover.py: using RAC 56 09:46:57.515747 tst handover.py: using CellId 40091 09:46:57.656065 tst handover.py: using BVCI 40092 09:46:57.768232 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 09:46:57.779222 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 09:46:57.790137 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 09:46:57.800844 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 09:46:57.812573 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 09:46:57.824276 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 09:46:57.946729 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 09:46:58.064127 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:46:58.505653 run create_hlr_db(pid=2805): Launched 09:46:58.620727 bus /sierra_2: Setting Powered False 09:46:59.681107 run create_hlr_db(pid=2805): Terminated: ok {rc=0} 09:47:00.076247 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2807): Launched 09:47:00.377691 run osmo-hlr_10.42.42.2(pid=2808): Launched 09:47:00.492575 run osmo-stp_10.42.42.5: Starting osmo-stp 09:47:01.003663 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2810): Launched 09:47:01.424828 run osmo-stp_10.42.42.5(pid=2811): Launched 09:47:01.622216 run osmo-msc_10.42.42.6: Starting osmo-msc 09:47:02.333745 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2813): Launched 09:47:02.669508 run osmo-msc_10.42.42.6(pid=2814): Launched 09:47:02.851180 run osmo-stp_10.42.42.5(pid=2811): ERR: Terminated: ERROR {rc=1} [trial-2402↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2811)] 09:47:02.986784 run osmo-stp_10.42.42.5(pid=2811): stdout: | (launched: 2022-12-14_09:47:01.365106) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:47:03.122630 run osmo-stp_10.42.42.5(pid=2811): stderr: | 20221214094701660 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214094701660 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214094701671 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214094701672 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214094701672 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214094701672 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214094701672 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:47:03.258034 run osmo-stp_10.42.42.5(pid=2811): stdout: | (launched: 2022-12-14_09:47:01.365106) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:47:03.385543 run osmo-stp_10.42.42.5(pid=2811): stderr: | 20221214094701660 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214094701660 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214094701671 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214094701672 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214094701672 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214094701672 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214094701672 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:47:03.539088 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=2811): Process ended prematurely: osmo-stp_10.42.42.5(pid=2811) [trial-2402↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2811)] [trial-2402↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18] 09:47:03.547759 tst handover.py:18: Test FAILED (6.9 sec) 09:47:03.574929 run osmo-hlr_10.42.42.2(pid=2808): ERR: Terminated: ERROR {rc=237} [trial-2402↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2808)] 09:47:03.624630 run osmo-hlr_10.42.42.2(pid=2808): stdout: | (launched: 2022-12-14_09:47:00.322673) 09:47:03.676052 run osmo-hlr_10.42.42.2(pid=2808): stderr: | 20221214094700494 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214094700494 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214094700495 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214094700495 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214094700495 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214094700495 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214094700508 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/handover_2G:trx-lms+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214094700518 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214094700518 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214094700518 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:47:03.747993 run osmo-msc_10.42.42.6(pid=2814): ERR: Terminated: ERROR {rc=2} [trial-2402↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2814)] 09:47:03.797851 run osmo-msc_10.42.42.6(pid=2814): stdout: | (launched: 2022-12-14_09:47:02.610470) 09:47:03.849466 run osmo-msc_10.42.42.6(pid=2814): stderr: | 20221214094702927 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214094702928 DLGLOBAL DEBUG validating counter group 0x7efefd64ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214094702928 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214094702928 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214094702928 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214094702928 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214094702930 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214094702930 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214094702930 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214094702930 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:47:03.901309 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2807): Terminating (SIGTERM) 09:47:03.942650 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2810): Terminating (SIGTERM) 09:47:03.984309 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2813): Terminating (SIGTERM) 09:47:04.026447 --- ParallelTerminationStrategy: PID 2807 died... 09:47:04.046451 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2807): Terminated: ok {rc=0} 09:47:04.092484 --- ParallelTerminationStrategy: PID 2810 died... 09:47:04.112091 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2810): Terminated: ok {rc=0} 09:47:04.158106 --- ParallelTerminationStrategy: PID 2813 died... 09:47:04.177655 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2813): Terminated: ok {rc=0} 09:47:04.264722 bus /sierra_3: Setting Powered False 09:47:05.362706 bus /sierra_3: Setting Powered False 09:47:06.479543 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2402 handover_2G:trx-lms+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 handover_2G:trx-lms+bts1-sysmo --------------------------------------------------------------------- 09:47:07.756709 tst handover_2G:trx-lms+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:47:07.762677 tst handover_2G:trx-lms+bts1-sysmo: Verifying 2 x bts (candidates: 11) 09:47:07.814224 tst handover_2G:trx-lms+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 09:47:07.841506 tst handover_2G:trx-lms+bts1-sysmo: Verifying 2 x modem (candidates: 12) 09:47:07.894099 tst handover_2G:trx-lms+bts1-sysmo: Reserving 2 x bts (candidates: 11) 09:47:07.946006 tst handover_2G:trx-lms+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 09:47:07.973170 tst handover_2G:trx-lms+bts1-sysmo: Reserving 2 x modem (candidates: 12) 09:47:08.520286 tst handover_2G:trx-lms+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2402 handover_2G:trx-lms+bts1-sysmo handover.py ---------------------------------------------- 09:47:08.526257 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 09:47:08.537749 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x bts (candidates: 2) 09:47:08.588078 tst handover.py: using LAC 40092 09:47:08.707168 tst handover.py: using RAC 57 09:47:08.825250 tst handover.py: using CellId 40092 09:47:08.944859 tst handover.py: using BVCI 40093 09:47:09.054925 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x bts (candidates: 2) 09:47:09.088485 tst handover.py: using LAC 40093 09:47:09.205574 tst handover.py: using RAC 58 09:47:09.332459 tst handover.py: using CellId 40093 09:47:09.457637 tst handover.py: using BVCI 40094 09:47:09.568673 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 09:47:09.579636 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 09:47:09.590286 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 09:47:09.600803 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 09:47:09.611798 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 09:47:09.622690 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x modem (candidates: 2) 09:47:09.742335 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x modem (candidates: 2) 09:47:09.860494 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:47:10.332003 run create_hlr_db(pid=2820): Launched 09:47:10.463594 bus /sierra_2: Setting Powered False 09:47:11.528515 run create_hlr_db(pid=2820): Terminated: ok {rc=0} 09:47:11.933820 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2822): Launched 09:47:12.235784 run osmo-hlr_10.42.42.2(pid=2823): Launched 09:47:12.351072 run osmo-stp_10.42.42.5: Starting osmo-stp 09:47:12.878684 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2825): Launched 09:47:13.201342 run osmo-stp_10.42.42.5(pid=2826): Launched 09:47:13.324132 run osmo-msc_10.42.42.6: Starting osmo-msc 09:47:13.879430 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2828): Launched 09:47:14.203506 run osmo-msc_10.42.42.6(pid=2829): Launched 09:47:14.383500 run osmo-stp_10.42.42.5(pid=2826): ERR: Terminated: ERROR {rc=1} [trial-2402↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2826)] 09:47:14.519604 run osmo-stp_10.42.42.5(pid=2826): stdout: | (launched: 2022-12-14_09:47:13.142371) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:47:14.655699 run osmo-stp_10.42.42.5(pid=2826): stderr: | 20221214094713329 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214094713329 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214094713329 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214094713330 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214094713330 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214094713330 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214094713330 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:47:14.790756 run osmo-stp_10.42.42.5(pid=2826): stdout: | (launched: 2022-12-14_09:47:13.142371) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:47:14.918509 run osmo-stp_10.42.42.5(pid=2826): stderr: | 20221214094713329 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214094713329 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214094713329 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214094713330 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214094713330 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214094713330 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214094713330 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:47:15.071660 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=2826): Process ended prematurely: osmo-stp_10.42.42.5(pid=2826) [trial-2402↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2826)] [trial-2402↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18] 09:47:15.080725 tst handover.py:18: Test FAILED (6.5 sec) 09:47:15.108016 run osmo-hlr_10.42.42.2(pid=2823): ERR: Terminated: ERROR {rc=237} [trial-2402↪handover_2G:trx-lms+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2823)] 09:47:15.157944 run osmo-hlr_10.42.42.2(pid=2823): stdout: | (launched: 2022-12-14_09:47:12.179952) 09:47:15.209762 run osmo-hlr_10.42.42.2(pid=2823): stderr: | 20221214094712351 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214094712351 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214094712351 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214094712351 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214094712351 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214094712351 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214094712363 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/handover_2G:trx-lms+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214094712371 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214094712372 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214094712372 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:47:15.282017 run osmo-msc_10.42.42.6(pid=2829): ERR: Terminated: ERROR {rc=2} [trial-2402↪handover_2G:trx-lms+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2829)] 09:47:15.332136 run osmo-msc_10.42.42.6(pid=2829): stdout: | (launched: 2022-12-14_09:47:14.144585) 09:47:15.383439 run osmo-msc_10.42.42.6(pid=2829): stderr: | 20221214094714461 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214094714462 DLGLOBAL DEBUG validating counter group 0x7f11cb81ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214094714462 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214094714462 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214094714462 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214094714462 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214094714464 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214094714464 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214094714464 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214094714464 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:47:15.435108 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2822): Terminating (SIGTERM) 09:47:15.476554 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2825): Terminating (SIGTERM) 09:47:15.518038 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2828): Terminating (SIGTERM) 09:47:15.559468 --- ParallelTerminationStrategy: PID 2822 died... 09:47:15.579317 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2822): Terminated: ok {rc=0} 09:47:15.624877 --- ParallelTerminationStrategy: PID 2825 died... 09:47:15.644282 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2825): Terminated: ok {rc=0} 09:47:15.689903 --- ParallelTerminationStrategy: PID 2828 died... 09:47:15.709303 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2828): Terminated: ok {rc=0} 09:47:15.795395 bus /sierra_3: Setting Powered False 09:47:16.909085 bus /sierra_3: Setting Powered False 09:47:18.027724 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2402 handover_2G:trx-lms+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 handover_2G:trx-lms+bts1-trx-b200 --------------------------------------------------------------------- 09:47:19.280650 tst handover_2G:trx-lms+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:47:19.286337 tst handover_2G:trx-lms+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 09:47:19.348809 tst handover_2G:trx-lms+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 09:47:19.374983 tst handover_2G:trx-lms+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 09:47:19.427265 tst handover_2G:trx-lms+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 09:47:19.492366 tst handover_2G:trx-lms+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 09:47:19.519516 tst handover_2G:trx-lms+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 09:47:20.064055 tst handover_2G:trx-lms+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2402 handover_2G:trx-lms+bts1-trx-b200 handover.py ---------------------------------------------- 09:47:20.070201 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 09:47:20.081571 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x bts (candidates: 2) 09:47:20.129983 tst handover.py: using LAC 40094 09:47:20.255657 tst handover.py: using RAC 59 09:47:20.374590 tst handover.py: using CellId 40094 09:47:20.494754 tst handover.py: using BVCI 40095 09:47:20.605401 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x bts (candidates: 2) 09:47:20.653046 tst handover.py: using LAC 40095 09:47:20.770989 tst handover.py: using RAC 60 09:47:20.890994 tst handover.py: using CellId 40095 09:47:21.010850 tst handover.py: using BVCI 40096 09:47:21.121644 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 09:47:21.132403 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 09:47:21.143010 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 09:47:21.153712 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 09:47:21.164575 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 09:47:21.176033 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x modem (candidates: 2) 09:47:21.296326 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x modem (candidates: 2) 09:47:21.411975 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:47:21.853897 run create_hlr_db(pid=2834): Launched 09:47:21.968048 bus /sierra_2: Setting Powered False 09:47:23.029080 run create_hlr_db(pid=2834): Terminated: ok {rc=0} 09:47:23.442561 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2836): Launched 09:47:23.766738 run osmo-hlr_10.42.42.2(pid=2837): Launched 09:47:23.889932 run osmo-stp_10.42.42.5: Starting osmo-stp 09:47:24.422024 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2839): Launched 09:47:24.745662 run osmo-stp_10.42.42.5(pid=2840): Launched 09:47:24.869092 run osmo-msc_10.42.42.6: Starting osmo-msc 09:47:25.428622 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2842): Launched 09:47:25.753477 run osmo-msc_10.42.42.6(pid=2843): Launched 09:47:25.933241 run osmo-stp_10.42.42.5(pid=2840): ERR: Terminated: ERROR {rc=1} [trial-2402↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2840)] 09:47:26.070186 run osmo-stp_10.42.42.5(pid=2840): stdout: | (launched: 2022-12-14_09:47:24.686991) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:47:26.207807 run osmo-stp_10.42.42.5(pid=2840): stderr: | 20221214094724874 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214094724874 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214094724874 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214094724875 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214094724875 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214094724875 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214094724875 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:47:26.343488 run osmo-stp_10.42.42.5(pid=2840): stdout: | (launched: 2022-12-14_09:47:24.686991) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:47:26.472709 run osmo-stp_10.42.42.5(pid=2840): stderr: | 20221214094724874 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214094724874 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214094724874 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214094724875 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214094724875 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214094724875 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214094724875 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:47:26.626682 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=2840): Process ended prematurely: osmo-stp_10.42.42.5(pid=2840) [trial-2402↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2840)] [trial-2402↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18] 09:47:26.635376 tst handover.py:18: Test FAILED (6.6 sec) 09:47:26.662842 run osmo-hlr_10.42.42.2(pid=2837): ERR: Terminated: ERROR {rc=237} [trial-2402↪handover_2G:trx-lms+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2837)] 09:47:26.713118 run osmo-hlr_10.42.42.2(pid=2837): stdout: | (launched: 2022-12-14_09:47:23.707880) 09:47:26.765241 run osmo-hlr_10.42.42.2(pid=2837): stderr: | 20221214094723902 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214094723902 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214094723902 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214094723902 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214094723902 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214094723902 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214094723915 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/handover_2G:trx-lms+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214094723923 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214094723923 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214094723923 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:47:26.837601 run osmo-msc_10.42.42.6(pid=2843): ERR: Terminated: ERROR {rc=2} [trial-2402↪handover_2G:trx-lms+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2843)] 09:47:26.887599 run osmo-msc_10.42.42.6(pid=2843): stdout: | (launched: 2022-12-14_09:47:25.693243) 09:47:26.939452 run osmo-msc_10.42.42.6(pid=2843): stderr: | 20221214094726012 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214094726012 DLGLOBAL DEBUG validating counter group 0x7f5e98bf1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214094726012 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214094726012 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214094726013 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214094726013 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214094726014 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214094726015 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214094726015 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214094726015 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:47:26.991870 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2836): Terminating (SIGTERM) 09:47:27.033301 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2839): Terminating (SIGTERM) 09:47:27.074974 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2842): Terminating (SIGTERM) 09:47:27.117071 --- ParallelTerminationStrategy: PID 2836 died... 09:47:27.137148 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2836): Terminated: ok {rc=0} 09:47:27.183253 --- ParallelTerminationStrategy: PID 2839 died... 09:47:27.202769 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2839): Terminated: ok {rc=0} 09:47:27.248593 --- ParallelTerminationStrategy: PID 2842 died... 09:47:27.268186 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2842): Terminated: ok {rc=0} 09:47:27.355714 bus /sierra_3: Setting Powered False 09:47:28.452090 bus /sierra_3: Setting Powered False 09:47:29.566430 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2402 handover_2G:trx-lms+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 handover_2G:trx-lms+bts1-trx-umtrx --------------------------------------------------------------------- 09:47:30.840221 tst handover_2G:trx-lms+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:47:30.851386 tst handover_2G:trx-lms+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 09:47:30.933392 tst handover_2G:trx-lms+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 09:47:30.962634 tst handover_2G:trx-lms+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 09:47:31.016535 tst handover_2G:trx-lms+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 09:47:31.085412 tst handover_2G:trx-lms+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 09:47:31.113467 tst handover_2G:trx-lms+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 09:47:31.655314 tst handover_2G:trx-lms+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2402 handover_2G:trx-lms+bts1-trx-umtrx handover.py ---------------------------------------------- 09:47:31.665941 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 09:47:31.678016 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 09:47:31.731416 tst handover.py: using LAC 40096 09:47:31.879717 tst handover.py: using RAC 61 09:47:32.039117 tst handover.py: using CellId 40096 09:47:32.201371 tst handover.py: using BVCI 40097 09:47:32.339283 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 09:47:32.387422 tst handover.py: using LAC 40097 09:47:32.509384 tst handover.py: using RAC 62 09:47:32.631358 tst handover.py: using CellId 40097 09:47:32.753094 tst handover.py: using BVCI 40098 09:47:32.872021 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 09:47:32.883462 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 09:47:32.894662 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 09:47:32.906026 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 09:47:32.917327 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 09:47:32.928520 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 09:47:33.045265 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 09:47:33.161320 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:47:33.604685 run create_hlr_db(pid=2848): Launched 09:47:33.722119 bus /sierra_2: Setting Powered False 09:47:34.782601 run create_hlr_db(pid=2848): Terminated: ok {rc=0} 09:47:35.198060 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2850): Launched 09:47:35.522670 run osmo-hlr_10.42.42.2(pid=2851): Launched 09:47:35.646012 run osmo-stp_10.42.42.5: Starting osmo-stp 09:47:36.172747 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2853): Launched 09:47:36.497550 run osmo-stp_10.42.42.5(pid=2854): Launched 09:47:36.621623 run osmo-msc_10.42.42.6: Starting osmo-msc 09:47:37.178146 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2856): Launched 09:47:37.501375 run osmo-msc_10.42.42.6(pid=2857): Launched 09:47:37.682491 run osmo-stp_10.42.42.5(pid=2854): ERR: Terminated: ERROR {rc=1} [trial-2402↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2854)] 09:47:37.820519 run osmo-stp_10.42.42.5(pid=2854): stdout: | (launched: 2022-12-14_09:47:36.437873) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:47:37.956800 run osmo-stp_10.42.42.5(pid=2854): stderr: | 20221214094736626 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214094736626 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214094736626 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214094736627 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214094736627 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214094736627 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214094736627 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:47:38.091836 run osmo-stp_10.42.42.5(pid=2854): stdout: | (launched: 2022-12-14_09:47:36.437873) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:47:38.219994 run osmo-stp_10.42.42.5(pid=2854): stderr: | 20221214094736626 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214094736626 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214094736626 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214094736627 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214094736627 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214094736627 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214094736627 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:47:38.373100 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=2854): Process ended prematurely: osmo-stp_10.42.42.5(pid=2854) [trial-2402↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2854)] [trial-2402↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18] 09:47:38.382123 tst handover.py:18: Test FAILED (6.7 sec) 09:47:38.409520 run osmo-hlr_10.42.42.2(pid=2851): ERR: Terminated: ERROR {rc=237} [trial-2402↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2851)] 09:47:38.459698 run osmo-hlr_10.42.42.2(pid=2851): stdout: | (launched: 2022-12-14_09:47:35.462136) 09:47:38.512004 run osmo-hlr_10.42.42.2(pid=2851): stderr: | 20221214094735657 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214094735657 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214094735657 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214094735657 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214094735657 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214094735657 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214094735669 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/handover_2G:trx-lms+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214094735678 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214094735679 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214094735679 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:47:38.584586 run osmo-msc_10.42.42.6(pid=2857): ERR: Terminated: ERROR {rc=2} [trial-2402↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2857)] 09:47:38.634733 run osmo-msc_10.42.42.6(pid=2857): stdout: | (launched: 2022-12-14_09:47:37.441192) 09:47:38.686562 run osmo-msc_10.42.42.6(pid=2857): stderr: | 20221214094737761 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214094737761 DLGLOBAL DEBUG validating counter group 0x7f0e1e76fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214094737761 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214094737761 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214094737761 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214094737761 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214094737763 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214094737763 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214094737763 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214094737764 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:47:38.738809 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2850): Terminating (SIGTERM) 09:47:38.780484 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2853): Terminating (SIGTERM) 09:47:38.821970 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2856): Terminating (SIGTERM) 09:47:38.863701 --- ParallelTerminationStrategy: PID 2850 died... 09:47:38.883424 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2850): Terminated: ok {rc=0} 09:47:38.929698 --- ParallelTerminationStrategy: PID 2853 died... 09:47:38.949214 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2853): Terminated: ok {rc=0} 09:47:38.995212 --- ParallelTerminationStrategy: PID 2856 died... 09:47:39.014702 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2856): Terminated: ok {rc=0} 09:47:39.101553 bus /sierra_3: Setting Powered False 09:47:40.200648 bus /sierra_3: Setting Powered False 09:47:41.317088 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2402 handover_2G:trx-lms+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 09:47:42.587439 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:47:42.593292 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 09:47:42.652528 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 09:47:42.679109 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 09:47:42.729317 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 09:47:42.788678 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 09:47:42.816053 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 09:47:43.370463 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2402 handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 09:47:43.375682 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 09:47:43.387036 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 09:47:43.430328 tst handover.py: using LAC 40098 09:47:43.549362 tst handover.py: using RAC 63 09:47:43.666355 tst handover.py: using CellId 40098 09:47:43.783634 tst handover.py: using BVCI 40099 09:47:43.893306 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 09:47:43.940440 tst handover.py: using LAC 40099 09:47:44.059909 tst handover.py: using RAC 64 09:47:44.180173 tst handover.py: using CellId 40099 09:47:44.302392 tst handover.py: using BVCI 40100 09:47:44.414915 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 09:47:44.426120 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 09:47:44.437209 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 09:47:44.448197 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 09:47:44.459964 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 09:47:44.471717 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 09:47:44.591175 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 09:47:44.707444 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:47:45.152225 run create_hlr_db(pid=2862): Launched 09:47:45.267321 bus /sierra_2: Setting Powered False 09:47:46.336841 run create_hlr_db(pid=2862): Terminated: ok {rc=0} 09:47:46.744496 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2864): Launched 09:47:47.064439 run osmo-hlr_10.42.42.2(pid=2865): Launched 09:47:47.273577 run osmo-stp_10.42.42.5: Starting osmo-stp 09:47:47.780392 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2867): Launched 09:47:48.084687 run osmo-stp_10.42.42.5(pid=2868): Launched 09:47:48.199061 run osmo-msc_10.42.42.6: Starting osmo-msc 09:47:48.721545 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2870): Launched 09:47:49.024917 run osmo-msc_10.42.42.6(pid=2871): Launched 09:47:49.194188 run osmo-stp_10.42.42.5(pid=2868): ERR: Terminated: ERROR {rc=1} [trial-2402↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2868)] 09:47:49.322783 run osmo-stp_10.42.42.5(pid=2868): stdout: | (launched: 2022-12-14_09:47:48.028787) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:47:49.450780 run osmo-stp_10.42.42.5(pid=2868): stderr: | 20221214094748196 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214094748196 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214094748197 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214094748197 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214094748197 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214094748198 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214094748198 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:47:49.577196 run osmo-stp_10.42.42.5(pid=2868): stdout: | (launched: 2022-12-14_09:47:48.028787) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:47:49.697117 run osmo-stp_10.42.42.5(pid=2868): stderr: | 20221214094748196 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214094748196 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214094748197 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214094748197 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214094748197 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214094748198 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214094748198 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:47:49.840369 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=2868): Process ended prematurely: osmo-stp_10.42.42.5(pid=2868) [trial-2402↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2868)] [trial-2402↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18] 09:47:49.848684 tst handover.py:18: Test FAILED (6.5 sec) 09:47:49.874530 run osmo-hlr_10.42.42.2(pid=2865): ERR: Terminated: ERROR {rc=237} [trial-2402↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2865)] 09:47:49.922821 run osmo-hlr_10.42.42.2(pid=2865): stdout: | (launched: 2022-12-14_09:47:47.008198) 09:47:49.972145 run osmo-hlr_10.42.42.2(pid=2865): stderr: | 20221214094747236 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214094747236 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214094747236 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214094747236 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214094747236 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214094747236 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214094747254 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214094747270 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214094747270 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214094747270 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:47:50.041160 run osmo-msc_10.42.42.6(pid=2871): ERR: Terminated: ERROR {rc=2} [trial-2402↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2871)] 09:47:50.088161 run osmo-msc_10.42.42.6(pid=2871): stdout: | (launched: 2022-12-14_09:47:48.968563) 09:47:50.137230 run osmo-msc_10.42.42.6(pid=2871): stderr: | 20221214094749237 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214094749237 DLGLOBAL DEBUG validating counter group 0x7ff0b7b0dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214094749237 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214094749237 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214094749237 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214094749238 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214094749239 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214094749240 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214094749240 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214094749240 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:47:50.186696 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2864): Terminating (SIGTERM) 09:47:50.226100 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2867): Terminating (SIGTERM) 09:47:50.265631 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2870): Terminating (SIGTERM) 09:47:50.305390 --- ParallelTerminationStrategy: PID 2864 died... 09:47:50.324652 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2864): Terminated: ok {rc=0} 09:47:50.368582 --- ParallelTerminationStrategy: PID 2867 died... 09:47:50.387379 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2867): Terminated: ok {rc=0} 09:47:50.430904 --- ParallelTerminationStrategy: PID 2870 died... 09:47:50.449633 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2870): Terminated: ok {rc=0} 09:47:50.533048 bus /sierra_3: Setting Powered False 09:47:51.630787 bus /sierra_3: Setting Powered False 09:47:52.748833 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2402 handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 handover_2G:trx-lms-limenet-micro+bts1-sysmo --------------------------------------------------------------------- 09:47:54.015826 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:47:54.022629 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Verifying 2 x bts (candidates: 11) 09:47:54.071193 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 09:47:54.098467 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Verifying 2 x modem (candidates: 12) 09:47:54.150323 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Reserving 2 x bts (candidates: 11) 09:47:54.198714 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 09:47:54.226253 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Reserving 2 x modem (candidates: 12) 09:47:54.778674 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2402 handover_2G:trx-lms-limenet-micro+bts1-sysmo handover.py ---------------------------------------------- 09:47:54.784058 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 09:47:54.795487 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x bts (candidates: 2) 09:47:54.840438 tst handover.py: using LAC 40100 09:47:54.970307 tst handover.py: using RAC 65 09:47:55.097351 tst handover.py: using CellId 40100 09:47:55.223076 tst handover.py: using BVCI 40101 09:47:55.340741 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x bts (candidates: 2) 09:47:55.375497 tst handover.py: using LAC 40101 09:47:55.500934 tst handover.py: using RAC 66 09:47:55.626728 tst handover.py: using CellId 40101 09:47:55.753659 tst handover.py: using BVCI 40102 09:47:55.864251 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 09:47:55.875355 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 09:47:55.886205 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 09:47:55.897111 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 09:47:55.908165 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 09:47:55.919240 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x modem (candidates: 2) 09:47:56.032607 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x modem (candidates: 2) 09:47:56.153970 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:47:56.596779 run create_hlr_db(pid=2876): Launched 09:47:56.712198 bus /sierra_2: Setting Powered False 09:47:57.771733 run create_hlr_db(pid=2876): Terminated: ok {rc=0} 09:47:58.166414 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2878): Launched 09:47:58.467284 run osmo-hlr_10.42.42.2(pid=2879): Launched 09:47:58.582197 run osmo-stp_10.42.42.5: Starting osmo-stp 09:47:59.086455 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2881): Launched 09:47:59.387622 run osmo-stp_10.42.42.5(pid=2882): Launched 09:47:59.502175 run osmo-msc_10.42.42.6: Starting osmo-msc 09:48:00.021215 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2884): Launched 09:48:00.323564 run osmo-msc_10.42.42.6(pid=2885): Launched 09:48:00.491597 run osmo-stp_10.42.42.5(pid=2882): ERR: Terminated: ERROR {rc=1} [trial-2402↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2882)] 09:48:00.620084 run osmo-stp_10.42.42.5(pid=2882): stdout: | (launched: 2022-12-14_09:47:59.331851) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:48:00.747936 run osmo-stp_10.42.42.5(pid=2882): stderr: | 20221214094759498 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214094759498 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214094759499 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214094759499 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214094759500 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214094759500 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214094759500 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:48:00.878197 run osmo-stp_10.42.42.5(pid=2882): stdout: | (launched: 2022-12-14_09:47:59.331851) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:48:01.010213 run osmo-stp_10.42.42.5(pid=2882): stderr: | 20221214094759498 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214094759498 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214094759499 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214094759499 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214094759500 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214094759500 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214094759500 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:48:01.157582 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=2882): Process ended prematurely: osmo-stp_10.42.42.5(pid=2882) [trial-2402↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2882)] [trial-2402↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18] 09:48:01.166865 tst handover.py:18: Test FAILED (6.4 sec) 09:48:01.194133 run osmo-hlr_10.42.42.2(pid=2879): ERR: Terminated: ERROR {rc=237} [trial-2402↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2879)] 09:48:01.245929 run osmo-hlr_10.42.42.2(pid=2879): stdout: | (launched: 2022-12-14_09:47:58.411554) 09:48:01.297509 run osmo-hlr_10.42.42.2(pid=2879): stderr: | 20221214094758587 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214094758587 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214094758587 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214094758587 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214094758587 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214094758587 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214094758599 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/handover_2G:trx-lms-limenet-micro+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214094758607 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214094758607 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214094758607 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:48:01.370224 run osmo-msc_10.42.42.6(pid=2885): ERR: Terminated: ERROR {rc=2} [trial-2402↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2885)] 09:48:01.418774 run osmo-msc_10.42.42.6(pid=2885): stdout: | (launched: 2022-12-14_09:48:00.267655) 09:48:01.470116 run osmo-msc_10.42.42.6(pid=2885): stderr: | 20221214094800534 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214094800534 DLGLOBAL DEBUG validating counter group 0x7fbbebc4ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214094800534 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214094800534 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214094800534 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214094800534 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214094800536 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214094800537 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214094800537 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214094800537 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:48:01.522762 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2878): Terminating (SIGTERM) 09:48:01.564421 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2881): Terminating (SIGTERM) 09:48:01.606160 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2884): Terminating (SIGTERM) 09:48:01.647679 --- ParallelTerminationStrategy: PID 2878 died... 09:48:01.668661 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2878): Terminated: ok {rc=0} 09:48:01.715061 --- ParallelTerminationStrategy: PID 2881 died... 09:48:01.735900 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2881): Terminated: ok {rc=0} 09:48:01.782047 --- ParallelTerminationStrategy: PID 2884 died... 09:48:01.802764 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2884): Terminated: ok {rc=0} 09:48:01.890477 bus /sierra_3: Setting Powered False 09:48:02.984467 bus /sierra_3: Setting Powered False 09:48:04.098345 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2402 handover_2G:trx-lms-limenet-micro+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 handover_2G:trx-lms-limenet-micro+bts1-trx-b200 --------------------------------------------------------------------- 09:48:05.354937 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:48:05.360513 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 09:48:05.420553 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 09:48:05.447927 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 09:48:05.501178 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 09:48:05.561905 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 09:48:05.589298 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 09:48:06.138245 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2402 handover_2G:trx-lms-limenet-micro+bts1-trx-b200 handover.py ---------------------------------------------- 09:48:06.143335 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 09:48:06.154450 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x bts (candidates: 2) 09:48:06.201685 tst handover.py: using LAC 40102 09:48:06.320697 tst handover.py: using RAC 67 09:48:06.437946 tst handover.py: using CellId 40102 09:48:06.557741 tst handover.py: using BVCI 40103 09:48:06.675393 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x bts (candidates: 2) 09:48:06.729199 tst handover.py: using LAC 40103 09:48:06.859657 tst handover.py: using RAC 68 09:48:06.986279 tst handover.py: using CellId 40103 09:48:07.112423 tst handover.py: using BVCI 40104 09:48:07.229718 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 09:48:07.241294 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 09:48:07.252541 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 09:48:07.263989 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 09:48:07.275299 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 09:48:07.286703 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x modem (candidates: 2) 09:48:07.403830 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x modem (candidates: 2) 09:48:07.523236 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:48:07.998333 run create_hlr_db(pid=2890): Launched 09:48:08.128721 bus /sierra_2: Setting Powered False 09:48:09.192531 run create_hlr_db(pid=2890): Terminated: ok {rc=0} 09:48:09.614200 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2892): Launched 09:48:09.939461 run osmo-hlr_10.42.42.2(pid=2893): Launched 09:48:10.062469 run osmo-stp_10.42.42.5: Starting osmo-stp 09:48:10.590578 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2895): Launched 09:48:10.915732 run osmo-stp_10.42.42.5(pid=2896): Launched 09:48:11.040179 run osmo-msc_10.42.42.6: Starting osmo-msc 09:48:11.598703 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2898): Launched 09:48:11.922681 run osmo-msc_10.42.42.6(pid=2899): Launched 09:48:12.103503 run osmo-stp_10.42.42.5(pid=2896): ERR: Terminated: ERROR {rc=1} [trial-2402↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2896)] 09:48:12.239945 run osmo-stp_10.42.42.5(pid=2896): stdout: | (launched: 2022-12-14_09:48:10.856065) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:48:12.376121 run osmo-stp_10.42.42.5(pid=2896): stderr: | 20221214094811043 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214094811043 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214094811044 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214094811044 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214094811044 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214094811045 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214094811045 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:48:12.511767 run osmo-stp_10.42.42.5(pid=2896): stdout: | (launched: 2022-12-14_09:48:10.856065) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:48:12.639793 run osmo-stp_10.42.42.5(pid=2896): stderr: | 20221214094811043 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214094811043 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214094811044 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214094811044 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214094811044 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214094811045 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214094811045 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:48:12.793067 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=2896): Process ended prematurely: osmo-stp_10.42.42.5(pid=2896) [trial-2402↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2896)] [trial-2402↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18] 09:48:12.801956 tst handover.py:18: Test FAILED (6.7 sec) 09:48:12.829666 run osmo-hlr_10.42.42.2(pid=2893): ERR: Terminated: ERROR {rc=237} [trial-2402↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2893)] 09:48:12.879811 run osmo-hlr_10.42.42.2(pid=2893): stdout: | (launched: 2022-12-14_09:48:09.879928) 09:48:12.931464 run osmo-hlr_10.42.42.2(pid=2893): stderr: | 20221214094810076 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214094810076 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214094810076 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214094810076 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214094810076 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214094810076 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214094810089 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/handover_2G:trx-lms-limenet-micro+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214094810097 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214094810097 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214094810097 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:48:13.003587 run osmo-msc_10.42.42.6(pid=2899): ERR: Terminated: ERROR {rc=2} [trial-2402↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2899)] 09:48:13.053458 run osmo-msc_10.42.42.6(pid=2899): stdout: | (launched: 2022-12-14_09:48:11.863205) 09:48:13.104935 run osmo-msc_10.42.42.6(pid=2899): stderr: | 20221214094812181 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214094812181 DLGLOBAL DEBUG validating counter group 0x7fd8cfa1cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214094812181 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214094812181 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214094812182 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214094812182 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214094812183 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214094812184 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214094812184 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214094812184 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:48:13.156873 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2892): Terminating (SIGTERM) 09:48:13.198586 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2895): Terminating (SIGTERM) 09:48:13.240312 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2898): Terminating (SIGTERM) 09:48:13.282509 --- ParallelTerminationStrategy: PID 2892 died... 09:48:13.302707 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2892): Terminated: ok {rc=0} 09:48:13.349071 --- ParallelTerminationStrategy: PID 2895 died... 09:48:13.368497 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2895): Terminated: ok {rc=0} 09:48:13.414854 --- ParallelTerminationStrategy: PID 2898 died... 09:48:13.434561 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2898): Terminated: ok {rc=0} 09:48:13.522333 bus /sierra_3: Setting Powered False 09:48:14.619337 bus /sierra_3: Setting Powered False 09:48:15.736774 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2402 handover_2G:trx-lms-limenet-micro+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx --------------------------------------------------------------------- 09:48:17.059036 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:48:17.064793 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 09:48:17.125444 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 09:48:17.154867 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 09:48:17.209460 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 09:48:17.271120 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 09:48:17.297943 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 09:48:17.848678 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2402 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx handover.py ---------------------------------------------- 09:48:17.854826 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 09:48:17.866961 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 09:48:17.912000 tst handover.py: using LAC 40104 09:48:18.041118 tst handover.py: using RAC 69 09:48:18.167845 tst handover.py: using CellId 40104 09:48:18.296620 tst handover.py: using BVCI 40105 09:48:18.414231 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 09:48:18.463807 tst handover.py: using LAC 40105 09:48:18.592473 tst handover.py: using RAC 70 09:48:18.720721 tst handover.py: using CellId 40105 09:48:18.847647 tst handover.py: using BVCI 40106 09:48:18.967153 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 09:48:18.978805 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 09:48:18.990368 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 09:48:19.001958 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 09:48:19.013419 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 09:48:19.024764 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 09:48:19.139689 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 09:48:19.259162 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:48:19.733755 run create_hlr_db(pid=2904): Launched 09:48:19.866159 bus /sierra_2: Setting Powered False 09:48:20.930413 run create_hlr_db(pid=2904): Terminated: ok {rc=0} 09:48:21.352920 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2906): Launched 09:48:21.676672 run osmo-hlr_10.42.42.2(pid=2907): Launched 09:48:21.799441 run osmo-stp_10.42.42.5: Starting osmo-stp 09:48:22.335614 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2909): Launched 09:48:22.658888 run osmo-stp_10.42.42.5(pid=2910): Launched 09:48:22.783449 run osmo-msc_10.42.42.6: Starting osmo-msc 09:48:23.337724 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2912): Launched 09:48:23.662242 run osmo-msc_10.42.42.6(pid=2913): Launched 09:48:23.844928 run osmo-stp_10.42.42.5(pid=2910): ERR: Terminated: ERROR {rc=1} [trial-2402↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2910)] 09:48:23.981387 run osmo-stp_10.42.42.5(pid=2910): stdout: | (launched: 2022-12-14_09:48:22.599570) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:48:24.117541 run osmo-stp_10.42.42.5(pid=2910): stderr: | 20221214094822787 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214094822788 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214094822788 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214094822788 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214094822789 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214094822789 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214094822789 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:48:24.251877 run osmo-stp_10.42.42.5(pid=2910): stdout: | (launched: 2022-12-14_09:48:22.599570) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:48:24.379740 run osmo-stp_10.42.42.5(pid=2910): stderr: | 20221214094822787 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214094822788 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214094822788 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214094822788 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214094822789 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214094822789 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214094822789 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:48:24.532624 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=2910): Process ended prematurely: osmo-stp_10.42.42.5(pid=2910) [trial-2402↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2910)] [trial-2402↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18] 09:48:24.541976 tst handover.py:18: Test FAILED (6.7 sec) 09:48:24.569414 run osmo-hlr_10.42.42.2(pid=2907): ERR: Terminated: ERROR {rc=237} [trial-2402↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2907)] 09:48:24.619002 run osmo-hlr_10.42.42.2(pid=2907): stdout: | (launched: 2022-12-14_09:48:21.617303) 09:48:24.670251 run osmo-hlr_10.42.42.2(pid=2907): stderr: | 20221214094821812 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214094821812 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214094821812 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214094821813 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214094821813 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214094821813 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214094821825 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214094821833 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214094821833 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214094821833 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:48:24.742123 run osmo-msc_10.42.42.6(pid=2913): ERR: Terminated: ERROR {rc=2} [trial-2402↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2913)] 09:48:24.791742 run osmo-msc_10.42.42.6(pid=2913): stdout: | (launched: 2022-12-14_09:48:23.602718) 09:48:24.843051 run osmo-msc_10.42.42.6(pid=2913): stderr: | 20221214094823920 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214094823920 DLGLOBAL DEBUG validating counter group 0x7f3ebb055c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214094823921 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214094823921 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214094823921 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214094823921 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214094823923 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214094823923 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214094823923 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214094823923 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:48:24.894661 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2906): Terminating (SIGTERM) 09:48:24.935968 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2909): Terminating (SIGTERM) 09:48:24.977290 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2912): Terminating (SIGTERM) 09:48:25.018753 --- ParallelTerminationStrategy: PID 2906 died... 09:48:25.038695 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2906): Terminated: ok {rc=0} 09:48:25.084774 --- ParallelTerminationStrategy: PID 2909 died... 09:48:25.104256 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2909): Terminated: ok {rc=0} 09:48:25.150252 --- ParallelTerminationStrategy: PID 2912 died... 09:48:25.169749 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2912): Terminated: ok {rc=0} 09:48:25.257013 bus /sierra_3: Setting Powered False 09:48:26.355128 bus /sierra_3: Setting Powered False 09:48:27.469077 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2402 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 handover_2G:trx-sysmocell5000+bts1-sysmo --------------------------------------------------------------------- 09:48:28.737476 tst handover_2G:trx-sysmocell5000+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:48:28.742949 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Verifying 2 x bts (candidates: 11) 09:48:28.795567 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 09:48:28.823027 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Verifying 2 x modem (candidates: 12) 09:48:28.875230 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Reserving 2 x bts (candidates: 11) 09:48:28.927436 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 09:48:28.954721 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Reserving 2 x modem (candidates: 12) 09:48:29.507745 tst handover_2G:trx-sysmocell5000+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts sysmoCell 5000 sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2402 handover_2G:trx-sysmocell5000+bts1-sysmo handover.py ---------------------------------------------- 09:48:29.513821 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 09:48:29.524671 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x bts (candidates: 2) 09:48:29.575736 tst handover.py: using LAC 40106 09:48:29.695051 tst handover.py: using RAC 71 09:48:29.812658 tst handover.py: using CellId 40106 09:48:29.930255 tst handover.py: using BVCI 40107 09:48:30.041890 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x bts (candidates: 2) 09:48:30.075122 tst handover.py: using LAC 40107 09:48:30.202127 tst handover.py: using RAC 72 09:48:30.327151 tst handover.py: using CellId 40107 09:48:30.452526 tst handover.py: using BVCI 40108 09:48:30.572330 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 09:48:30.583825 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 09:48:30.595068 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 09:48:30.606404 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 09:48:30.617763 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 09:48:30.628927 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x modem (candidates: 2) 09:48:30.745941 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x modem (candidates: 2) 09:48:30.874229 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:48:31.355214 run create_hlr_db(pid=2918): Launched 09:48:31.515176 bus /sierra_2: Setting Powered False 09:48:32.575682 run create_hlr_db(pid=2918): Terminated: ok {rc=0} 09:48:32.990116 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2920): Launched 09:48:33.314858 run osmo-hlr_10.42.42.2(pid=2921): Launched 09:48:33.439117 run osmo-stp_10.42.42.5: Starting osmo-stp 09:48:33.970849 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2923): Launched 09:48:34.296223 run osmo-stp_10.42.42.5(pid=2924): Launched 09:48:34.419292 run osmo-msc_10.42.42.6: Starting osmo-msc 09:48:34.976284 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2926): Launched 09:48:35.301384 run osmo-msc_10.42.42.6(pid=2927): Launched 09:48:35.483033 run osmo-stp_10.42.42.5(pid=2924): ERR: Terminated: ERROR {rc=1} [trial-2402↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2924)] 09:48:35.620355 run osmo-stp_10.42.42.5(pid=2924): stdout: | (launched: 2022-12-14_09:48:34.236713) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:48:35.757708 run osmo-stp_10.42.42.5(pid=2924): stderr: | 20221214094834426 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214094834426 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214094834427 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214094834427 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214094834427 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214094834428 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214094834428 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:48:35.893083 run osmo-stp_10.42.42.5(pid=2924): stdout: | (launched: 2022-12-14_09:48:34.236713) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:48:36.021856 run osmo-stp_10.42.42.5(pid=2924): stderr: | 20221214094834426 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214094834426 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214094834427 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214094834427 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214094834427 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214094834428 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214094834428 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:48:36.175212 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=2924): Process ended prematurely: osmo-stp_10.42.42.5(pid=2924) [trial-2402↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2924)] [trial-2402↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18] 09:48:36.184063 tst handover.py:18: Test FAILED (6.7 sec) 09:48:36.211711 run osmo-hlr_10.42.42.2(pid=2921): ERR: Terminated: ERROR {rc=237} [trial-2402↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2921)] 09:48:36.261959 run osmo-hlr_10.42.42.2(pid=2921): stdout: | (launched: 2022-12-14_09:48:33.255299) 09:48:36.314168 run osmo-hlr_10.42.42.2(pid=2921): stderr: | 20221214094833451 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214094833451 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214094833451 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214094833452 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214094833452 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214094833452 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214094833462 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/handover_2G:trx-sysmocell5000+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214094833471 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214094833471 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214094833471 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:48:36.387046 run osmo-msc_10.42.42.6(pid=2927): ERR: Terminated: ERROR {rc=2} [trial-2402↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2927)] 09:48:36.437118 run osmo-msc_10.42.42.6(pid=2927): stdout: | (launched: 2022-12-14_09:48:35.241851) 09:48:36.488787 run osmo-msc_10.42.42.6(pid=2927): stderr: | 20221214094835559 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214094835559 DLGLOBAL DEBUG validating counter group 0x7f74482c2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214094835559 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214094835559 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214094835559 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214094835560 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214094835561 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214094835562 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214094835562 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214094835562 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:48:36.541529 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2920): Terminating (SIGTERM) 09:48:36.583392 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2923): Terminating (SIGTERM) 09:48:36.625034 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2926): Terminating (SIGTERM) 09:48:36.666930 --- ParallelTerminationStrategy: PID 2920 died... 09:48:36.687003 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2920): Terminated: ok {rc=0} 09:48:36.733081 --- ParallelTerminationStrategy: PID 2923 died... 09:48:36.752643 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2923): Terminated: ok {rc=0} 09:48:36.798473 --- ParallelTerminationStrategy: PID 2926 died... 09:48:36.818135 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2926): Terminated: ok {rc=0} 09:48:36.905411 bus /sierra_3: Setting Powered False 09:48:38.004584 bus /sierra_3: Setting Powered False 09:48:39.122551 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2402 handover_2G:trx-sysmocell5000+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 handover_2G:trx-sysmocell5000+bts1-trx-b200 --------------------------------------------------------------------- 09:48:40.376112 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:48:40.381433 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 09:48:40.444822 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 09:48:40.471034 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 09:48:40.523352 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 09:48:40.592029 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 09:48:40.619288 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 09:48:41.168229 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts sysmoCell 5000 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2402 handover_2G:trx-sysmocell5000+bts1-trx-b200 handover.py ---------------------------------------------- 09:48:41.174619 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 09:48:41.186784 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x bts (candidates: 2) 09:48:41.238219 tst handover.py: using LAC 40108 09:48:41.365848 tst handover.py: using RAC 73 09:48:41.493076 tst handover.py: using CellId 40108 09:48:41.614528 tst handover.py: using BVCI 40109 09:48:41.726202 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x bts (candidates: 2) 09:48:41.774025 tst handover.py: using LAC 40109 09:48:41.896424 tst handover.py: using RAC 74 09:48:42.015158 tst handover.py: using CellId 40109 09:48:42.136258 tst handover.py: using BVCI 40110 09:48:42.246577 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 09:48:42.257641 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 09:48:42.268351 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 09:48:42.279295 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 09:48:42.290964 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 09:48:42.302581 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x modem (candidates: 2) 09:48:42.423536 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x modem (candidates: 2) 09:48:42.539519 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:48:42.982771 run create_hlr_db(pid=2932): Launched 09:48:43.099319 bus /sierra_2: Setting Powered False 09:48:44.159629 run create_hlr_db(pid=2932): Terminated: ok {rc=0} 09:48:44.555618 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2934): Launched 09:48:44.857548 run osmo-hlr_10.42.42.2(pid=2935): Launched 09:48:44.973054 run osmo-stp_10.42.42.5: Starting osmo-stp 09:48:45.479983 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2937): Launched 09:48:45.782590 run osmo-stp_10.42.42.5(pid=2938): Launched 09:48:46.027656 run osmo-msc_10.42.42.6: Starting osmo-msc 09:48:46.598978 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2940): Launched 09:48:46.942986 run osmo-msc_10.42.42.6(pid=2941): Launched 09:48:47.252095 run osmo-stp_10.42.42.5(pid=2938): ERR: Terminated: ERROR {rc=1} [trial-2402↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2938)] 09:48:47.390385 run osmo-stp_10.42.42.5(pid=2938): stdout: | (launched: 2022-12-14_09:48:45.726631) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:48:47.529410 run osmo-stp_10.42.42.5(pid=2938): stderr: | 20221214094845943 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214094845943 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214094845943 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214094845943 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214094845944 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214094845944 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214094845944 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:48:47.665184 run osmo-stp_10.42.42.5(pid=2938): stdout: | (launched: 2022-12-14_09:48:45.726631) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:48:47.793724 run osmo-stp_10.42.42.5(pid=2938): stderr: | 20221214094845943 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214094845943 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214094845943 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214094845943 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214094845944 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214094845944 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214094845944 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:48:47.947233 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=2938): Process ended prematurely: osmo-stp_10.42.42.5(pid=2938) [trial-2402↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2938)] [trial-2402↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18] 09:48:47.956292 tst handover.py:18: Test FAILED (6.8 sec) 09:48:47.983786 run osmo-hlr_10.42.42.2(pid=2935): ERR: Terminated: ERROR {rc=237} [trial-2402↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2935)] 09:48:48.033588 run osmo-hlr_10.42.42.2(pid=2935): stdout: | (launched: 2022-12-14_09:48:44.801646) 09:48:48.085962 run osmo-hlr_10.42.42.2(pid=2935): stderr: | 20221214094844975 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214094844975 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214094844975 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214094844975 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214094844975 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214094844975 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214094844987 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/handover_2G:trx-sysmocell5000+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214094844995 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214094844995 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214094844995 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:48:48.157728 run osmo-msc_10.42.42.6(pid=2941): ERR: Terminated: ERROR {rc=2} [trial-2402↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2941)] 09:48:48.207584 run osmo-msc_10.42.42.6(pid=2941): stdout: | (launched: 2022-12-14_09:48:46.882396) 09:48:48.259189 run osmo-msc_10.42.42.6(pid=2941): stderr: | 20221214094847278 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214094847279 DLGLOBAL DEBUG validating counter group 0x7f272937cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214094847279 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214094847279 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214094847279 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214094847279 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214094847281 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214094847282 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214094847282 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214094847282 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:48:48.310949 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2934): Terminating (SIGTERM) 09:48:48.352312 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2937): Terminating (SIGTERM) 09:48:48.393694 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2940): Terminating (SIGTERM) 09:48:48.435340 --- ParallelTerminationStrategy: PID 2934 died... 09:48:48.455397 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2934): Terminated: ok {rc=0} 09:48:48.501379 --- ParallelTerminationStrategy: PID 2937 died... 09:48:48.521324 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2937): Terminated: ok {rc=0} 09:48:48.567318 --- ParallelTerminationStrategy: PID 2940 died... 09:48:48.586701 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2940): Terminated: ok {rc=0} 09:48:48.673861 bus /sierra_3: Setting Powered False 09:48:49.771851 bus /sierra_3: Setting Powered False 09:48:50.883736 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2402 handover_2G:trx-sysmocell5000+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 handover_2G:trx-sysmocell5000+bts1-trx-umtrx --------------------------------------------------------------------- 09:48:52.159321 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:48:52.165455 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 09:48:52.229647 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 09:48:52.256912 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 09:48:52.309446 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 09:48:52.374225 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 09:48:52.401400 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 09:48:52.953412 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts sysmoCell 5000 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2402 handover_2G:trx-sysmocell5000+bts1-trx-umtrx handover.py ---------------------------------------------- 09:48:52.958690 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 09:48:52.970288 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 09:48:53.020901 tst handover.py: using LAC 40110 09:48:53.148314 tst handover.py: using RAC 75 09:48:53.275648 tst handover.py: using CellId 40110 09:48:53.402539 tst handover.py: using BVCI 40111 09:48:53.522271 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 09:48:53.572291 tst handover.py: using LAC 40111 09:48:53.700820 tst handover.py: using RAC 76 09:48:53.828892 tst handover.py: using CellId 40111 09:48:53.948142 tst handover.py: using BVCI 40112 09:48:54.059787 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 09:48:54.070952 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 09:48:54.082012 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 09:48:54.093170 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 09:48:54.104507 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 09:48:54.115807 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 09:48:54.235929 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 09:48:54.351500 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:48:54.795101 run create_hlr_db(pid=2946): Launched 09:48:54.909890 bus /sierra_2: Setting Powered False 09:48:55.969717 run create_hlr_db(pid=2946): Terminated: ok {rc=0} 09:48:56.383281 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2948): Launched 09:48:56.708850 run osmo-hlr_10.42.42.2(pid=2949): Launched 09:48:56.831578 run osmo-stp_10.42.42.5: Starting osmo-stp 09:48:57.358212 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2951): Launched 09:48:57.682221 run osmo-stp_10.42.42.5(pid=2952): Launched 09:48:57.806158 run osmo-msc_10.42.42.6: Starting osmo-msc 09:48:58.361695 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2954): Launched 09:48:58.685405 run osmo-msc_10.42.42.6(pid=2955): Launched 09:48:58.866610 run osmo-stp_10.42.42.5(pid=2952): ERR: Terminated: ERROR {rc=1} [trial-2402↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2952)] 09:48:59.003433 run osmo-stp_10.42.42.5(pid=2952): stdout: | (launched: 2022-12-14_09:48:57.622439) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:48:59.140289 run osmo-stp_10.42.42.5(pid=2952): stderr: | 20221214094857812 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214094857812 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214094857813 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214094857813 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214094857813 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214094857814 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214094857814 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:48:59.274983 run osmo-stp_10.42.42.5(pid=2952): stdout: | (launched: 2022-12-14_09:48:57.622439) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:48:59.403259 run osmo-stp_10.42.42.5(pid=2952): stderr: | 20221214094857812 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214094857812 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214094857813 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214094857813 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214094857813 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214094857814 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214094857814 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:48:59.556595 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=2952): Process ended prematurely: osmo-stp_10.42.42.5(pid=2952) [trial-2402↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2952)] [trial-2402↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18] 09:48:59.565970 tst handover.py:18: Test FAILED (6.6 sec) 09:48:59.593550 run osmo-hlr_10.42.42.2(pid=2949): ERR: Terminated: ERROR {rc=237} [trial-2402↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2949)] 09:48:59.643129 run osmo-hlr_10.42.42.2(pid=2949): stdout: | (launched: 2022-12-14_09:48:56.649605) 09:48:59.694394 run osmo-hlr_10.42.42.2(pid=2949): stderr: | 20221214094856847 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214094856847 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214094856847 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214094856847 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214094856847 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214094856847 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214094856859 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/handover_2G:trx-sysmocell5000+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214094856868 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214094856868 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214094856868 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:48:59.766218 run osmo-msc_10.42.42.6(pid=2955): ERR: Terminated: ERROR {rc=2} [trial-2402↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2955)] 09:48:59.815882 run osmo-msc_10.42.42.6(pid=2955): stdout: | (launched: 2022-12-14_09:48:58.625994) 09:48:59.867577 run osmo-msc_10.42.42.6(pid=2955): stderr: | 20221214094858944 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214094858944 DLGLOBAL DEBUG validating counter group 0x7fc944f0fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214094858944 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214094858944 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214094858944 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214094858945 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214094858946 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214094858947 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214094858947 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214094858947 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:48:59.919120 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2948): Terminating (SIGTERM) 09:48:59.960215 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2951): Terminating (SIGTERM) 09:49:00.001536 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2954): Terminating (SIGTERM) 09:49:00.043036 --- ParallelTerminationStrategy: PID 2948 died... 09:49:00.062754 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2948): Terminated: ok {rc=0} 09:49:00.108540 --- ParallelTerminationStrategy: PID 2951 died... 09:49:00.127979 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2951): Terminated: ok {rc=0} 09:49:00.173326 --- ParallelTerminationStrategy: PID 2954 died... 09:49:00.192453 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2954): Terminated: ok {rc=0} 09:49:00.278966 bus /sierra_3: Setting Powered False 09:49:01.376219 bus /sierra_3: Setting Powered False 09:49:02.493946 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2402 handover_2G:trx-sysmocell5000+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 handover_2G:sysmo+bts1-trx-b200 --------------------------------------------------------------------- 09:49:03.762391 tst handover_2G:sysmo+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:49:03.769197 tst handover_2G:sysmo+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 09:49:03.820733 tst handover_2G:sysmo+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 09:49:03.848038 tst handover_2G:sysmo+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 09:49:03.900273 tst handover_2G:sysmo+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 09:49:03.952506 tst handover_2G:sysmo+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 09:49:03.980010 tst handover_2G:sysmo+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 09:49:04.537356 tst handover_2G:sysmo+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts sysmoBTS 1002 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2402 handover_2G:sysmo+bts1-trx-b200 handover.py ---------------------------------------------- 09:49:04.542683 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 09:49:04.554035 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x bts (candidates: 2) 09:49:04.587997 tst handover.py: using LAC 40112 09:49:04.712887 tst handover.py: using RAC 77 09:49:04.837986 tst handover.py: using CellId 40112 09:49:04.966544 tst handover.py: using BVCI 40113 09:49:05.084935 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x bts (candidates: 2) 09:49:05.132899 tst handover.py: using LAC 40113 09:49:05.251614 tst handover.py: using RAC 78 09:49:05.369135 tst handover.py: using CellId 40113 09:49:05.489510 tst handover.py: using BVCI 40114 09:49:05.601626 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 09:49:05.612430 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 09:49:05.623078 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 09:49:05.633758 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 09:49:05.644815 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 09:49:05.656215 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x modem (candidates: 2) 09:49:05.775268 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x modem (candidates: 2) 09:49:05.891092 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:49:06.335559 run create_hlr_db(pid=2960): Launched 09:49:06.450443 bus /sierra_2: Setting Powered False 09:49:07.510905 run create_hlr_db(pid=2960): Terminated: ok {rc=0} 09:49:07.906931 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2962): Launched 09:49:08.208543 run osmo-hlr_10.42.42.2(pid=2963): Launched 09:49:08.323809 run osmo-stp_10.42.42.5: Starting osmo-stp 09:49:08.831031 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2965): Launched 09:49:09.133329 run osmo-stp_10.42.42.5(pid=2966): Launched 09:49:09.247927 run osmo-msc_10.42.42.6: Starting osmo-msc 09:49:09.769654 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2968): Launched 09:49:10.072388 run osmo-msc_10.42.42.6(pid=2969): Launched 09:49:10.240118 run osmo-stp_10.42.42.5(pid=2966): ERR: Terminated: ERROR {rc=1} [trial-2402↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2966)] 09:49:10.367704 run osmo-stp_10.42.42.5(pid=2966): stdout: | (launched: 2022-12-14_09:49:09.077182) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:49:10.494767 run osmo-stp_10.42.42.5(pid=2966): stderr: | 20221214094909247 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214094909247 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214094909247 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214094909248 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214094909248 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214094909248 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214094909248 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:49:10.620811 run osmo-stp_10.42.42.5(pid=2966): stdout: | (launched: 2022-12-14_09:49:09.077182) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:49:10.740068 run osmo-stp_10.42.42.5(pid=2966): stderr: | 20221214094909247 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214094909247 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214094909247 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214094909248 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214094909248 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214094909248 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214094909248 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:49:10.883138 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=2966): Process ended prematurely: osmo-stp_10.42.42.5(pid=2966) [trial-2402↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2966)] [trial-2402↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18] 09:49:10.891414 tst handover.py:18: Test FAILED (6.3 sec) 09:49:10.917175 run osmo-hlr_10.42.42.2(pid=2963): ERR: Terminated: ERROR {rc=237} [trial-2402↪handover_2G:sysmo+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2963)] 09:49:10.965452 run osmo-hlr_10.42.42.2(pid=2963): stdout: | (launched: 2022-12-14_09:49:08.152635) 09:49:11.014401 run osmo-hlr_10.42.42.2(pid=2963): stderr: | 20221214094908325 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214094908325 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214094908325 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214094908325 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214094908325 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214094908325 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214094908340 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/handover_2G:sysmo+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214094908350 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214094908350 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214094908351 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:49:11.083512 run osmo-msc_10.42.42.6(pid=2969): ERR: Terminated: ERROR {rc=2} [trial-2402↪handover_2G:sysmo+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2969)] 09:49:11.130546 run osmo-msc_10.42.42.6(pid=2969): stdout: | (launched: 2022-12-14_09:49:10.016231) 09:49:11.179600 run osmo-msc_10.42.42.6(pid=2969): stderr: | 20221214094910286 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214094910286 DLGLOBAL DEBUG validating counter group 0x7fdd00d02c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214094910286 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214094910286 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214094910286 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214094910287 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214094910288 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214094910289 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214094910289 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214094910289 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:49:11.229051 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2962): Terminating (SIGTERM) 09:49:11.268497 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2965): Terminating (SIGTERM) 09:49:11.308109 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2968): Terminating (SIGTERM) 09:49:11.348050 --- ParallelTerminationStrategy: PID 2962 died... 09:49:11.367117 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2962): Terminated: ok {rc=0} 09:49:11.411213 --- ParallelTerminationStrategy: PID 2965 died... 09:49:11.430014 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2965): Terminated: ok {rc=0} 09:49:11.473508 --- ParallelTerminationStrategy: PID 2968 died... 09:49:11.492282 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2968): Terminated: ok {rc=0} 09:49:11.578420 bus /sierra_3: Setting Powered False 09:49:12.675845 bus /sierra_3: Setting Powered False 09:49:13.787606 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2402 handover_2G:sysmo+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 handover_2G:sysmo+bts1-trx-umtrx --------------------------------------------------------------------- 09:49:15.046978 tst handover_2G:sysmo+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:49:15.053782 tst handover_2G:sysmo+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 09:49:15.105360 tst handover_2G:sysmo+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 09:49:15.132825 tst handover_2G:sysmo+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 09:49:15.184677 tst handover_2G:sysmo+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 09:49:15.236328 tst handover_2G:sysmo+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 09:49:15.263391 tst handover_2G:sysmo+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 09:49:15.815764 tst handover_2G:sysmo+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts sysmoBTS 1002 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2402 handover_2G:sysmo+bts1-trx-umtrx handover.py ---------------------------------------------- 09:49:15.821209 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 09:49:15.843347 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 09:49:15.881210 tst handover.py: using LAC 40114 09:49:16.017138 tst handover.py: using RAC 79 09:49:16.138185 tst handover.py: using CellId 40114 09:49:16.265535 tst handover.py: using BVCI 40115 09:49:16.420659 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 09:49:16.470089 tst handover.py: using LAC 40115 09:49:16.600141 tst handover.py: using RAC 80 09:49:16.763930 tst handover.py: using CellId 40115 09:49:16.895046 tst handover.py: using BVCI 40116 09:49:17.030308 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 09:49:17.042529 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 09:49:17.054321 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 09:49:17.066180 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 09:49:17.078909 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 09:49:17.091522 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 09:49:17.228830 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 09:49:17.363945 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:49:17.839471 run create_hlr_db(pid=2974): Launched 09:49:17.965146 bus /sierra_2: Setting Powered False 09:49:19.025523 run create_hlr_db(pid=2974): Terminated: ok {rc=0} 09:49:19.439920 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2976): Launched 09:49:19.764809 run osmo-hlr_10.42.42.2(pid=2977): Launched 09:49:19.888704 run osmo-stp_10.42.42.5: Starting osmo-stp 09:49:20.420659 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2979): Launched 09:49:20.746270 run osmo-stp_10.42.42.5(pid=2980): Launched 09:49:20.870865 run osmo-msc_10.42.42.6: Starting osmo-msc 09:49:21.393431 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2982): Launched 09:49:21.696567 run osmo-msc_10.42.42.6(pid=2983): Launched 09:49:21.866201 run osmo-stp_10.42.42.5(pid=2980): ERR: Terminated: ERROR {rc=1} [trial-2402↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2980)] 09:49:21.995409 run osmo-stp_10.42.42.5(pid=2980): stdout: | (launched: 2022-12-14_09:49:20.686786) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:49:22.123868 run osmo-stp_10.42.42.5(pid=2980): stderr: | 20221214094920857 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214094920857 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214094920858 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214094920858 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214094920858 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214094920859 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214094920859 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:49:22.251027 run osmo-stp_10.42.42.5(pid=2980): stdout: | (launched: 2022-12-14_09:49:20.686786) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:49:22.371616 run osmo-stp_10.42.42.5(pid=2980): stderr: | 20221214094920857 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214094920857 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214094920858 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214094920858 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214094920858 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214094920859 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214094920859 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:49:22.515042 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=2980): Process ended prematurely: osmo-stp_10.42.42.5(pid=2980) [trial-2402↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2980)] [trial-2402↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18] 09:49:22.523471 tst handover.py:18: Test FAILED (6.7 sec) 09:49:22.549785 run osmo-hlr_10.42.42.2(pid=2977): ERR: Terminated: ERROR {rc=237} [trial-2402↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2977)] 09:49:22.598640 run osmo-hlr_10.42.42.2(pid=2977): stdout: | (launched: 2022-12-14_09:49:19.705326) 09:49:22.648260 run osmo-hlr_10.42.42.2(pid=2977): stderr: | 20221214094919901 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214094919901 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214094919901 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214094919901 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214094919901 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214094919901 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214094919918 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/handover_2G:sysmo+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214094919928 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214094919928 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214094919928 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:49:22.717866 run osmo-msc_10.42.42.6(pid=2983): ERR: Terminated: ERROR {rc=2} [trial-2402↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2983)] 09:49:22.767407 run osmo-msc_10.42.42.6(pid=2983): stdout: | (launched: 2022-12-14_09:49:21.640240) 09:49:22.822163 run osmo-msc_10.42.42.6(pid=2983): stderr: | 20221214094921910 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214094921910 DLGLOBAL DEBUG validating counter group 0x7f19bd630c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214094921910 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214094921910 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214094921910 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214094921910 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214094921912 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214094921913 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214094921913 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214094921913 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:49:22.880484 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2976): Terminating (SIGTERM) 09:49:22.921367 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2979): Terminating (SIGTERM) 09:49:22.961203 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2982): Terminating (SIGTERM) 09:49:23.001178 --- ParallelTerminationStrategy: PID 2976 died... 09:49:23.020324 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2976): Terminated: ok {rc=0} 09:49:23.064561 --- ParallelTerminationStrategy: PID 2979 died... 09:49:23.083521 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2979): Terminated: ok {rc=0} 09:49:23.127312 --- ParallelTerminationStrategy: PID 2982 died... 09:49:23.146325 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2982): Terminated: ok {rc=0} 09:49:23.232359 bus /sierra_3: Setting Powered False 09:49:24.332443 bus /sierra_3: Setting Powered False 09:49:25.447461 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2402 handover_2G:sysmo+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2402 handover_2G:trx-b200+bts1-trx-umtrx --------------------------------------------------------------------- 09:49:26.708122 tst handover_2G:trx-b200+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:49:26.714001 tst handover_2G:trx-b200+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 09:49:26.777814 tst handover_2G:trx-b200+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 09:49:26.805235 tst handover_2G:trx-b200+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 09:49:26.859090 tst handover_2G:trx-b200+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 09:49:26.923366 tst handover_2G:trx-b200+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 09:49:26.950622 tst handover_2G:trx-b200+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 09:49:27.498409 tst handover_2G:trx-b200+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts Ettus B200 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2402 handover_2G:trx-b200+bts1-trx-umtrx handover.py ---------------------------------------------- 09:49:27.503975 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 09:49:27.515034 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 09:49:27.562389 tst handover.py: using LAC 40116 09:49:27.690360 tst handover.py: using RAC 81 09:49:27.821439 tst handover.py: using CellId 40116 09:49:27.947675 tst handover.py: using BVCI 40117 09:49:28.058491 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 09:49:28.108563 tst handover.py: using LAC 40117 09:49:28.241412 tst handover.py: using RAC 82 09:49:28.373127 tst handover.py: using CellId 40117 09:49:28.500329 tst handover.py: using BVCI 40118 09:49:28.618554 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 09:49:28.630211 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 09:49:28.641593 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 09:49:28.652697 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 09:49:28.663913 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 09:49:28.675106 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 09:49:28.792912 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 09:49:28.911917 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:49:29.356550 run create_hlr_db(pid=2999): Launched 09:49:29.473671 bus /sierra_2: Setting Powered False 09:49:30.534370 run create_hlr_db(pid=2999): Terminated: ok {rc=0} 09:49:30.949848 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3001): Launched 09:49:31.270576 run osmo-hlr_10.42.42.2(pid=3002): Launched 09:49:31.532446 run osmo-stp_10.42.42.5: Starting osmo-stp 09:49:32.145784 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3004): Launched 09:49:32.497783 run osmo-stp_10.42.42.5(pid=3005): Launched 09:49:32.623629 run osmo-msc_10.42.42.6: Starting osmo-msc 09:49:33.182820 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3007): Launched 09:49:33.508460 run osmo-msc_10.42.42.6(pid=3008): Launched 09:49:33.688774 run osmo-stp_10.42.42.5(pid=3005): ERR: Terminated: ERROR {rc=1} [trial-2402↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3005)] 09:49:33.824848 run osmo-stp_10.42.42.5(pid=3005): stdout: | (launched: 2022-12-14_09:49:32.438201) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:49:33.961567 run osmo-stp_10.42.42.5(pid=3005): stderr: | 20221214094932625 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214094932625 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214094932625 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214094932626 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214094932626 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214094932626 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214094932626 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:49:34.097377 run osmo-stp_10.42.42.5(pid=3005): stdout: | (launched: 2022-12-14_09:49:32.438201) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:49:34.227034 run osmo-stp_10.42.42.5(pid=3005): stderr: | 20221214094932625 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214094932625 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214094932625 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214094932626 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214094932626 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214094932626 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214094932626 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:49:34.380483 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=3005): Process ended prematurely: osmo-stp_10.42.42.5(pid=3005) [trial-2402↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3005)] [trial-2402↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18] 09:49:34.389610 tst handover.py:18: Test FAILED (6.9 sec) 09:49:34.417456 run osmo-hlr_10.42.42.2(pid=3002): ERR: Terminated: ERROR {rc=237} [trial-2402↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3002)] 09:49:34.468602 run osmo-hlr_10.42.42.2(pid=3002): stdout: | (launched: 2022-12-14_09:49:31.212173) 09:49:34.520840 run osmo-hlr_10.42.42.2(pid=3002): stderr: | 20221214094931545 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214094931545 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214094931545 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214094931545 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214094931546 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214094931546 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214094931571 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/handover_2G:trx-b200+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214094931583 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214094931583 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214094931583 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:49:34.594575 run osmo-msc_10.42.42.6(pid=3008): ERR: Terminated: ERROR {rc=2} [trial-2402↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3008)] 09:49:34.644856 run osmo-msc_10.42.42.6(pid=3008): stdout: | (launched: 2022-12-14_09:49:33.448391) 09:49:34.697065 run osmo-msc_10.42.42.6(pid=3008): stderr: | 20221214094933766 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214094933766 DLGLOBAL DEBUG validating counter group 0x7f7523348c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214094933766 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214094933767 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214094933767 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214094933767 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214094933768 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214094933769 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214094933769 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214094933769 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:49:34.749684 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3001): Terminating (SIGTERM) 09:49:34.791545 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3004): Terminating (SIGTERM) 09:49:34.833500 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3007): Terminating (SIGTERM) 09:49:34.875748 --- ParallelTerminationStrategy: PID 3001 died... 09:49:34.895911 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3001): Terminated: ok {rc=0} 09:49:34.943001 --- ParallelTerminationStrategy: PID 3004 died... 09:49:34.963036 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3004): Terminated: ok {rc=0} 09:49:35.009316 --- ParallelTerminationStrategy: PID 3007 died... 09:49:35.028826 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3007): Terminated: ok {rc=0} 09:49:35.116242 bus /sierra_3: Setting Powered False 09:49:36.214252 bus /sierra_3: Setting Powered False 09:49:37.329146 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2402 handover_2G:trx-b200+bts1-trx-umtrx FAIL --------------------------------------------------------------------- 09:49:38.603362 tst trial-2402: Storing JUnit report in /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402/run.2022-12-14_08-25-21/trial-2402.xml -------------------------------------------------------------------------------------------- trial-2402 FAIL -------------------------------------------------------------------------------------------- 09:49:40.538510 tst trial-2402: trial-2402: FAIL, 200 suites failed FAIL: nitb_sms:sysmo (fail: 1) FAIL: mo_mt_sms.py (5.0 sec) Error: osmo-nitb_10.42.42.2(pid=28236): Process ended prematurely: osmo-nitb_10.42.42.2(pid=28236) [trial-2402↪nitb_sms:sysmo↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=28236)] FAIL: sms:sysmo (fail: 1) FAIL: mo_mt_sms.py (14.3 sec) Error: osmo-stp_10.42.42.5(pid=28247): Process ended prematurely: osmo-stp_10.42.42.5(pid=28247) [trial-2402↪sms:sysmo↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28247)] FAIL: nitb_ussd:sysmo (fail: 1) FAIL: assert_extension.py (3.1 sec) Error: osmo-nitb_10.42.42.2(pid=28258): Process ended prematurely: osmo-nitb_10.42.42.2(pid=28258) [trial-2402↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=28258)] FAIL: ussd:sysmo (fail: 1) FAIL: assert_extension.py (5.8 sec) Error: osmo-stp_10.42.42.5(pid=28268): Process ended prematurely: osmo-stp_10.42.42.5(pid=28268) [trial-2402↪ussd:sysmo↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28268)] FAIL: voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=28282): Process ended prematurely: osmo-stp_10.42.42.5(pid=28282) [trial-2402↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28282)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=28293): Process ended prematurely: osmo-stp_10.42.42.5(pid=28293) [trial-2402↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28293)] FAIL: voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=28307): Process ended prematurely: osmo-stp_10.42.42.5(pid=28307) [trial-2402↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28307)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=28318): Process ended prematurely: osmo-stp_10.42.42.5(pid=28318) [trial-2402↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28318)] FAIL: voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=28346): Process ended prematurely: osmo-stp_10.42.42.5(pid=28346) [trial-2402↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28346)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=28357): Process ended prematurely: osmo-stp_10.42.42.5(pid=28357) [trial-2402↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28357)] FAIL: voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=28372): Process ended prematurely: osmo-stp_10.42.42.5(pid=28372) [trial-2402↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28372)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=28383): Process ended prematurely: osmo-stp_10.42.42.5(pid=28383) [trial-2402↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28383)] FAIL: voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=28397): Process ended prematurely: osmo-stp_10.42.42.5(pid=28397) [trial-2402↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28397)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=28408): Process ended prematurely: osmo-stp_10.42.42.5(pid=28408) [trial-2402↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28408)] FAIL: voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=28425): Process ended prematurely: osmo-stp_10.42.42.5(pid=28425) [trial-2402↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28425)] FAIL: mo_mt_call_osmux.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=28436): Process ended prematurely: osmo-stp_10.42.42.5(pid=28436) [trial-2402↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28436)] FAIL: voice:sysmo+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=28450): Process ended prematurely: osmo-stp_10.42.42.5(pid=28450) [trial-2402↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28450)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=28461): Process ended prematurely: osmo-stp_10.42.42.5(pid=28461) [trial-2402↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28461)] FAIL: emergency:sysmo (fail: 2) FAIL: emergency_mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=28475): Process ended prematurely: osmo-stp_10.42.42.5(pid=28475) [trial-2402↪emergency:sysmo↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28475)] FAIL: emergency_preemptive_call.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=28487): Process ended prematurely: osmo-stp_10.42.42.5(pid=28487) [trial-2402↪emergency:sysmo↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28487)] FAIL: gprs:sysmo (fail: 5) FAIL: cs_paging_gprs_active.py (10.2 sec) Error: osmo-stp_10.42.42.5(pid=28505): Process ended prematurely: osmo-stp_10.42.42.5(pid=28505) [trial-2402↪gprs:sysmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28505)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=28517): Process ended prematurely: osmo-stp_10.42.42.5(pid=28517) [trial-2402↪gprs:sysmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28517)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=28535): Process ended prematurely: osmo-stp_10.42.42.5(pid=28535) [trial-2402↪gprs:sysmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28535)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=28545): Process ended prematurely: osmo-stp_10.42.42.5(pid=28545) [trial-2402↪gprs:sysmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28545)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=28555): Process ended prematurely: osmo-stp_10.42.42.5(pid=28555) [trial-2402↪gprs:sysmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28555)] FAIL: gprs:sysmo+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (9.0 sec) Error: osmo-stp_10.42.42.5(pid=28572): Process ended prematurely: osmo-stp_10.42.42.5(pid=28572) [trial-2402↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28572)] FAIL: iperf3.py (8.0 sec) Error: osmo-stp_10.42.42.5(pid=28584): Process ended prematurely: osmo-stp_10.42.42.5(pid=28584) [trial-2402↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28584)] FAIL: iperf3m4.py (11.3 sec) Error: osmo-stp_10.42.42.5(pid=28602): Process ended prematurely: osmo-stp_10.42.42.5(pid=28602) [trial-2402↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28602)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=28613): Process ended prematurely: osmo-stp_10.42.42.5(pid=28613) [trial-2402↪gprs:sysmo+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28613)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=28624): Process ended prematurely: osmo-stp_10.42.42.5(pid=28624) [trial-2402↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28624)] FAIL: gprs:sysmo+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (9.0 sec) Error: osmo-stp_10.42.42.5(pid=28643): Process ended prematurely: osmo-stp_10.42.42.5(pid=28643) [trial-2402↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28643)] FAIL: iperf3.py (7.9 sec) Error: osmo-stp_10.42.42.5(pid=28656): Process ended prematurely: osmo-stp_10.42.42.5(pid=28656) [trial-2402↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28656)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=28674): Process ended prematurely: osmo-stp_10.42.42.5(pid=28674) [trial-2402↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28674)] FAIL: ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=28684): Process ended prematurely: osmo-stp_10.42.42.5(pid=28684) [trial-2402↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28684)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=28694): Process ended prematurely: osmo-stp_10.42.42.5(pid=28694) [trial-2402↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28694)] FAIL: gprs:sysmo+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=28712): Process ended prematurely: osmo-stp_10.42.42.5(pid=28712) [trial-2402↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28712)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=28725): Process ended prematurely: osmo-stp_10.42.42.5(pid=28725) [trial-2402↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28725)] FAIL: iperf3m4.py (11.2 sec) Error: osmo-stp_10.42.42.5(pid=28743): Process ended prematurely: osmo-stp_10.42.42.5(pid=28743) [trial-2402↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28743)] FAIL: ping.py (7.2 sec) Error: osmo-stp_10.42.42.5(pid=28756): Process ended prematurely: osmo-stp_10.42.42.5(pid=28756) [trial-2402↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28756)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=28766): Process ended prematurely: osmo-stp_10.42.42.5(pid=28766) [trial-2402↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28766)] FAIL: dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=28779): Process ended prematurely: osmo-stp_10.42.42.5(pid=28779) [trial-2402↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28779)] FAIL: dynts:sysmo+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=28792): Process ended prematurely: osmo-stp_10.42.42.5(pid=28792) [trial-2402↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28792)] FAIL: nitb_sms:oc2g (fail: 1) FAIL: mo_mt_sms.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=28801): Process ended prematurely: osmo-nitb_10.42.42.2(pid=28801) [trial-2402↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=28801)] FAIL: sms:oc2g (fail: 1) FAIL: mo_mt_sms.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=28811): Process ended prematurely: osmo-stp_10.42.42.5(pid=28811) [trial-2402↪sms:oc2g↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28811)] FAIL: nitb_ussd:oc2g (fail: 1) FAIL: assert_extension.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=28821): Process ended prematurely: osmo-nitb_10.42.42.2(pid=28821) [trial-2402↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=28821)] FAIL: ussd:oc2g (fail: 1) FAIL: assert_extension.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=28831): Process ended prematurely: osmo-stp_10.42.42.5(pid=28831) [trial-2402↪ussd:oc2g↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28831)] FAIL: voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=28845): Process ended prematurely: osmo-stp_10.42.42.5(pid=28845) [trial-2402↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28845)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=28856): Process ended prematurely: osmo-stp_10.42.42.5(pid=28856) [trial-2402↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28856)] FAIL: voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=28870): Process ended prematurely: osmo-stp_10.42.42.5(pid=28870) [trial-2402↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28870)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=28881): Process ended prematurely: osmo-stp_10.42.42.5(pid=28881) [trial-2402↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28881)] FAIL: voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=28895): Process ended prematurely: osmo-stp_10.42.42.5(pid=28895) [trial-2402↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28895)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=28906): Process ended prematurely: osmo-stp_10.42.42.5(pid=28906) [trial-2402↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28906)] FAIL: voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=28920): Process ended prematurely: osmo-stp_10.42.42.5(pid=28920) [trial-2402↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28920)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=28931): Process ended prematurely: osmo-stp_10.42.42.5(pid=28931) [trial-2402↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28931)] FAIL: voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=28945): Process ended prematurely: osmo-stp_10.42.42.5(pid=28945) [trial-2402↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28945)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=28956): Process ended prematurely: osmo-stp_10.42.42.5(pid=28956) [trial-2402↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28956)] FAIL: voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=28970): Process ended prematurely: osmo-stp_10.42.42.5(pid=28970) [trial-2402↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28970)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=28981): Process ended prematurely: osmo-stp_10.42.42.5(pid=28981) [trial-2402↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28981)] FAIL: voice:oc2g+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=28995): Process ended prematurely: osmo-stp_10.42.42.5(pid=28995) [trial-2402↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28995)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=29006): Process ended prematurely: osmo-stp_10.42.42.5(pid=29006) [trial-2402↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29006)] FAIL: emergency:oc2g (fail: 2) FAIL: emergency_mo_mt_call.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=29020): Process ended prematurely: osmo-stp_10.42.42.5(pid=29020) [trial-2402↪emergency:oc2g↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29020)] FAIL: emergency_preemptive_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=29031): Process ended prematurely: osmo-stp_10.42.42.5(pid=29031) [trial-2402↪emergency:oc2g↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29031)] FAIL: gprs:oc2g (fail: 5) FAIL: cs_paging_gprs_active.py (9.6 sec) Error: osmo-stp_10.42.42.5(pid=29322): Process ended prematurely: osmo-stp_10.42.42.5(pid=29322) [trial-2402↪gprs:oc2g↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29322)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=29336): Process ended prematurely: osmo-stp_10.42.42.5(pid=29336) [trial-2402↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29336)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=29355): Process ended prematurely: osmo-stp_10.42.42.5(pid=29355) [trial-2402↪gprs:oc2g↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29355)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=29365): Process ended prematurely: osmo-stp_10.42.42.5(pid=29365) [trial-2402↪gprs:oc2g↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29365)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=29378): Process ended prematurely: osmo-stp_10.42.42.5(pid=29378) [trial-2402↪gprs:oc2g↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29378)] FAIL: gprs:oc2g+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=29396): Process ended prematurely: osmo-stp_10.42.42.5(pid=29396) [trial-2402↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29396)] FAIL: iperf3.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=29408): Process ended prematurely: osmo-stp_10.42.42.5(pid=29408) [trial-2402↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29408)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=29426): Process ended prematurely: osmo-stp_10.42.42.5(pid=29426) [trial-2402↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29426)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=29437): Process ended prematurely: osmo-stp_10.42.42.5(pid=29437) [trial-2402↪gprs:oc2g+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29437)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=29447): Process ended prematurely: osmo-stp_10.42.42.5(pid=29447) [trial-2402↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29447)] FAIL: gprs:oc2g+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.4 sec) Error: osmo-stp_10.42.42.5(pid=29466): Process ended prematurely: osmo-stp_10.42.42.5(pid=29466) [trial-2402↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29466)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=29478): Process ended prematurely: osmo-stp_10.42.42.5(pid=29478) [trial-2402↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29478)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=29496): Process ended prematurely: osmo-stp_10.42.42.5(pid=29496) [trial-2402↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29496)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=29506): Process ended prematurely: osmo-stp_10.42.42.5(pid=29506) [trial-2402↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29506)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=29518): Process ended prematurely: osmo-stp_10.42.42.5(pid=29518) [trial-2402↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29518)] FAIL: gprs:oc2g+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=29535): Process ended prematurely: osmo-stp_10.42.42.5(pid=29535) [trial-2402↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29535)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=29547): Process ended prematurely: osmo-stp_10.42.42.5(pid=29547) [trial-2402↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29547)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=29565): Process ended prematurely: osmo-stp_10.42.42.5(pid=29565) [trial-2402↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29565)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=29575): Process ended prematurely: osmo-stp_10.42.42.5(pid=29575) [trial-2402↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29575)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=29585): Process ended prematurely: osmo-stp_10.42.42.5(pid=29585) [trial-2402↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29585)] FAIL: dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=29598): Process ended prematurely: osmo-stp_10.42.42.5(pid=29598) [trial-2402↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29598)] FAIL: dynts:oc2g+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=29611): Process ended prematurely: osmo-stp_10.42.42.5(pid=29611) [trial-2402↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29611)] FAIL: nitb_sms:trx-b200 (fail: 1) FAIL: mo_mt_sms.py (3.4 sec) Error: osmo-nitb_10.42.42.2(pid=29619): Process ended prematurely: osmo-nitb_10.42.42.2(pid=29619) [trial-2402↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=29619)] FAIL: sms:trx-b200 (fail: 1) FAIL: mo_mt_sms.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=29629): Process ended prematurely: osmo-stp_10.42.42.5(pid=29629) [trial-2402↪sms:trx-b200↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29629)] FAIL: nitb_ussd:trx-b200 (fail: 1) FAIL: assert_extension.py (3.1 sec) Error: osmo-nitb_10.42.42.2(pid=29638): Process ended prematurely: osmo-nitb_10.42.42.2(pid=29638) [trial-2402↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=29638)] FAIL: ussd:trx-b200 (fail: 1) FAIL: assert_extension.py (5.7 sec) Error: osmo-stp_10.42.42.5(pid=29649): Process ended prematurely: osmo-stp_10.42.42.5(pid=29649) [trial-2402↪ussd:trx-b200↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29649)] FAIL: voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=29663): Process ended prematurely: osmo-stp_10.42.42.5(pid=29663) [trial-2402↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29663)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=29674): Process ended prematurely: osmo-stp_10.42.42.5(pid=29674) [trial-2402↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29674)] FAIL: voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=29688): Process ended prematurely: osmo-stp_10.42.42.5(pid=29688) [trial-2402↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29688)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=29699): Process ended prematurely: osmo-stp_10.42.42.5(pid=29699) [trial-2402↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29699)] FAIL: voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=29715): Process ended prematurely: osmo-stp_10.42.42.5(pid=29715) [trial-2402↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29715)] FAIL: mo_mt_call_osmux.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=29726): Process ended prematurely: osmo-stp_10.42.42.5(pid=29726) [trial-2402↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29726)] FAIL: voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=29743): Process ended prematurely: osmo-stp_10.42.42.5(pid=29743) [trial-2402↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29743)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=29754): Process ended prematurely: osmo-stp_10.42.42.5(pid=29754) [trial-2402↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29754)] FAIL: voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=29768): Process ended prematurely: osmo-stp_10.42.42.5(pid=29768) [trial-2402↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29768)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=29779): Process ended prematurely: osmo-stp_10.42.42.5(pid=29779) [trial-2402↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29779)] FAIL: voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=29794): Process ended prematurely: osmo-stp_10.42.42.5(pid=29794) [trial-2402↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29794)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=29805): Process ended prematurely: osmo-stp_10.42.42.5(pid=29805) [trial-2402↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29805)] FAIL: voice:trx-b200+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=29819): Process ended prematurely: osmo-stp_10.42.42.5(pid=29819) [trial-2402↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29819)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=29830): Process ended prematurely: osmo-stp_10.42.42.5(pid=29830) [trial-2402↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29830)] FAIL: voice:trx-b200+mod-bts0-trxdversion0 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=29844): Process ended prematurely: osmo-stp_10.42.42.5(pid=29844) [trial-2402↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29844)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=29855): Process ended prematurely: osmo-stp_10.42.42.5(pid=29855) [trial-2402↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29855)] FAIL: voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 2) FAIL: mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=29869): Process ended prematurely: osmo-stp_10.42.42.5(pid=29869) [trial-2402↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29869)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=29880): Process ended prematurely: osmo-stp_10.42.42.5(pid=29880) [trial-2402↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29880)] FAIL: emergency:trx-b200 (fail: 2) FAIL: emergency_mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=29895): Process ended prematurely: osmo-stp_10.42.42.5(pid=29895) [trial-2402↪emergency:trx-b200↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29895)] FAIL: emergency_preemptive_call.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=29906): Process ended prematurely: osmo-stp_10.42.42.5(pid=29906) [trial-2402↪emergency:trx-b200↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29906)] FAIL: gprs:trx-b200 (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=29924): Process ended prematurely: osmo-stp_10.42.42.5(pid=29924) [trial-2402↪gprs:trx-b200↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29924)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=29936): Process ended prematurely: osmo-stp_10.42.42.5(pid=29936) [trial-2402↪gprs:trx-b200↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29936)] FAIL: iperf3m4.py (10.5 sec) Error: osmo-stp_10.42.42.5(pid=29954): Process ended prematurely: osmo-stp_10.42.42.5(pid=29954) [trial-2402↪gprs:trx-b200↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29954)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=29965): Process ended prematurely: osmo-stp_10.42.42.5(pid=29965) [trial-2402↪gprs:trx-b200↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29965)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=29975): Process ended prematurely: osmo-stp_10.42.42.5(pid=29975) [trial-2402↪gprs:trx-b200↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29975)] FAIL: gprs:trx-b200+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=29994): Process ended prematurely: osmo-stp_10.42.42.5(pid=29994) [trial-2402↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29994)] FAIL: iperf3.py (7.9 sec) Error: osmo-stp_10.42.42.5(pid=30006): Process ended prematurely: osmo-stp_10.42.42.5(pid=30006) [trial-2402↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30006)] FAIL: iperf3m4.py (10.5 sec) Error: osmo-stp_10.42.42.5(pid=30024): Process ended prematurely: osmo-stp_10.42.42.5(pid=30024) [trial-2402↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30024)] FAIL: ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=30034): Process ended prematurely: osmo-stp_10.42.42.5(pid=30034) [trial-2402↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30034)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=30044): Process ended prematurely: osmo-stp_10.42.42.5(pid=30044) [trial-2402↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30044)] FAIL: gprs:trx-b200+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=30063): Process ended prematurely: osmo-stp_10.42.42.5(pid=30063) [trial-2402↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30063)] FAIL: iperf3.py (8.1 sec) Error: osmo-stp_10.42.42.5(pid=30079): Process ended prematurely: osmo-stp_10.42.42.5(pid=30079) [trial-2402↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30079)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=30097): Process ended prematurely: osmo-stp_10.42.42.5(pid=30097) [trial-2402↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30097)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=30107): Process ended prematurely: osmo-stp_10.42.42.5(pid=30107) [trial-2402↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30107)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=30117): Process ended prematurely: osmo-stp_10.42.42.5(pid=30117) [trial-2402↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30117)] FAIL: gprs:trx-b200+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=30137): Process ended prematurely: osmo-stp_10.42.42.5(pid=30137) [trial-2402↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30137)] FAIL: iperf3.py (8.0 sec) Error: osmo-stp_10.42.42.5(pid=30149): Process ended prematurely: osmo-stp_10.42.42.5(pid=30149) [trial-2402↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30149)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=30167): Process ended prematurely: osmo-stp_10.42.42.5(pid=30167) [trial-2402↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30167)] FAIL: ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=30177): Process ended prematurely: osmo-stp_10.42.42.5(pid=30177) [trial-2402↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30177)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=30187): Process ended prematurely: osmo-stp_10.42.42.5(pid=30187) [trial-2402↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30187)] FAIL: gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=30204): Process ended prematurely: osmo-stp_10.42.42.5(pid=30204) [trial-2402↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30204)] FAIL: iperf3.py (7.9 sec) Error: osmo-stp_10.42.42.5(pid=30216): Process ended prematurely: osmo-stp_10.42.42.5(pid=30216) [trial-2402↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30216)] FAIL: iperf3m4.py (10.5 sec) Error: osmo-stp_10.42.42.5(pid=30234): Process ended prematurely: osmo-stp_10.42.42.5(pid=30234) [trial-2402↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30234)] FAIL: ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=30244): Process ended prematurely: osmo-stp_10.42.42.5(pid=30244) [trial-2402↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30244)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=30254): Process ended prematurely: osmo-stp_10.42.42.5(pid=30254) [trial-2402↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30254)] FAIL: dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=30269): Process ended prematurely: osmo-stp_10.42.42.5(pid=30269) [trial-2402↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30269)] FAIL: dynts:trx-b200+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=30283): Process ended prematurely: osmo-stp_10.42.42.5(pid=30283) [trial-2402↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30283)] FAIL: nitb_sms:trx-sysmocell5000 (fail: 1) FAIL: mo_mt_sms.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=30291): Process ended prematurely: osmo-nitb_10.42.42.2(pid=30291) [trial-2402↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=30291)] FAIL: sms:trx-sysmocell5000 (fail: 1) FAIL: mo_mt_sms.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=30301): Process ended prematurely: osmo-stp_10.42.42.5(pid=30301) [trial-2402↪sms:trx-sysmocell5000↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30301)] FAIL: nitb_ussd:trx-sysmocell5000 (fail: 1) FAIL: assert_extension.py (3.1 sec) Error: osmo-nitb_10.42.42.2(pid=30310): Process ended prematurely: osmo-nitb_10.42.42.2(pid=30310) [trial-2402↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=30310)] FAIL: ussd:trx-sysmocell5000 (fail: 1) FAIL: assert_extension.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=30320): Process ended prematurely: osmo-stp_10.42.42.5(pid=30320) [trial-2402↪ussd:trx-sysmocell5000↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30320)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=30336): Process ended prematurely: osmo-stp_10.42.42.5(pid=30336) [trial-2402↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30336)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=30347): Process ended prematurely: osmo-stp_10.42.42.5(pid=30347) [trial-2402↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30347)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=30634): Process ended prematurely: osmo-stp_10.42.42.5(pid=30634) [trial-2402↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30634)] FAIL: mo_mt_call_osmux.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=30645): Process ended prematurely: osmo-stp_10.42.42.5(pid=30645) [trial-2402↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30645)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=30659): Process ended prematurely: osmo-stp_10.42.42.5(pid=30659) [trial-2402↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30659)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=30670): Process ended prematurely: osmo-stp_10.42.42.5(pid=30670) [trial-2402↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30670)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=30684): Process ended prematurely: osmo-stp_10.42.42.5(pid=30684) [trial-2402↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30684)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=30698): Process ended prematurely: osmo-stp_10.42.42.5(pid=30698) [trial-2402↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30698)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=30716): Process ended prematurely: osmo-stp_10.42.42.5(pid=30716) [trial-2402↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30716)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=30730): Process ended prematurely: osmo-stp_10.42.42.5(pid=30730) [trial-2402↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30730)] FAIL: voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=30744): Process ended prematurely: osmo-stp_10.42.42.5(pid=30744) [trial-2402↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30744)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=30755): Process ended prematurely: osmo-stp_10.42.42.5(pid=30755) [trial-2402↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30755)] FAIL: voice:trx-sysmocell5000+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=30770): Process ended prematurely: osmo-stp_10.42.42.5(pid=30770) [trial-2402↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30770)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=30781): Process ended prematurely: osmo-stp_10.42.42.5(pid=30781) [trial-2402↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30781)] FAIL: emergency:trx-sysmocell5000 (fail: 2) FAIL: emergency_mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=30795): Process ended prematurely: osmo-stp_10.42.42.5(pid=30795) [trial-2402↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30795)] FAIL: emergency_preemptive_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=30806): Process ended prematurely: osmo-stp_10.42.42.5(pid=30806) [trial-2402↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30806)] FAIL: gprs:trx-sysmocell5000 (fail: 5) FAIL: cs_paging_gprs_active.py (9.0 sec) Error: osmo-stp_10.42.42.5(pid=30824): Process ended prematurely: osmo-stp_10.42.42.5(pid=30824) [trial-2402↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30824)] FAIL: iperf3.py (7.3 sec) Error: osmo-stp_10.42.42.5(pid=30836): Process ended prematurely: osmo-stp_10.42.42.5(pid=30836) [trial-2402↪gprs:trx-sysmocell5000↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30836)] FAIL: iperf3m4.py (10.5 sec) Error: osmo-stp_10.42.42.5(pid=30902): Process ended prematurely: osmo-stp_10.42.42.5(pid=30902) [trial-2402↪gprs:trx-sysmocell5000↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30902)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=30912): Process ended prematurely: osmo-stp_10.42.42.5(pid=30912) [trial-2402↪gprs:trx-sysmocell5000↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30912)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=30922): Process ended prematurely: osmo-stp_10.42.42.5(pid=30922) [trial-2402↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30922)] FAIL: gprs:trx-sysmocell5000+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=30940): Process ended prematurely: osmo-stp_10.42.42.5(pid=30940) [trial-2402↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30940)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=30952): Process ended prematurely: osmo-stp_10.42.42.5(pid=30952) [trial-2402↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30952)] FAIL: iperf3m4.py (10.5 sec) Error: osmo-stp_10.42.42.5(pid=30970): Process ended prematurely: osmo-stp_10.42.42.5(pid=30970) [trial-2402↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30970)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=30980): Process ended prematurely: osmo-stp_10.42.42.5(pid=30980) [trial-2402↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30980)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=30990): Process ended prematurely: osmo-stp_10.42.42.5(pid=30990) [trial-2402↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30990)] FAIL: gprs:trx-sysmocell5000+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=31008): Process ended prematurely: osmo-stp_10.42.42.5(pid=31008) [trial-2402↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31008)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=31020): Process ended prematurely: osmo-stp_10.42.42.5(pid=31020) [trial-2402↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31020)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=31038): Process ended prematurely: osmo-stp_10.42.42.5(pid=31038) [trial-2402↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31038)] FAIL: ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=31048): Process ended prematurely: osmo-stp_10.42.42.5(pid=31048) [trial-2402↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31048)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=31058): Process ended prematurely: osmo-stp_10.42.42.5(pid=31058) [trial-2402↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31058)] FAIL: gprs:trx-sysmocell5000+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=31075): Process ended prematurely: osmo-stp_10.42.42.5(pid=31075) [trial-2402↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31075)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=31087): Process ended prematurely: osmo-stp_10.42.42.5(pid=31087) [trial-2402↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31087)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=31129): Process ended prematurely: osmo-stp_10.42.42.5(pid=31129) [trial-2402↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31129)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=31142): Process ended prematurely: osmo-stp_10.42.42.5(pid=31142) [trial-2402↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31142)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=31152): Process ended prematurely: osmo-stp_10.42.42.5(pid=31152) [trial-2402↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31152)] FAIL: dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=31165): Process ended prematurely: osmo-stp_10.42.42.5(pid=31165) [trial-2402↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31165)] FAIL: dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=31180): Process ended prematurely: osmo-stp_10.42.42.5(pid=31180) [trial-2402↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31180)] FAIL: nitb_sms:trx-umtrx (fail: 1) FAIL: mo_mt_sms.py (3.4 sec) Error: osmo-nitb_10.42.42.2(pid=31188): Process ended prematurely: osmo-nitb_10.42.42.2(pid=31188) [trial-2402↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=31188)] FAIL: sms:trx-umtrx (fail: 1) FAIL: mo_mt_sms.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=31198): Process ended prematurely: osmo-stp_10.42.42.5(pid=31198) [trial-2402↪sms:trx-umtrx↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31198)] FAIL: nitb_ussd:trx-umtrx (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=31207): Process ended prematurely: osmo-nitb_10.42.42.2(pid=31207) [trial-2402↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=31207)] FAIL: ussd:trx-umtrx (fail: 1) FAIL: assert_extension.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=31217): Process ended prematurely: osmo-stp_10.42.42.5(pid=31217) [trial-2402↪ussd:trx-umtrx↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31217)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=31231): Process ended prematurely: osmo-stp_10.42.42.5(pid=31231) [trial-2402↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31231)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=31242): Process ended prematurely: osmo-stp_10.42.42.5(pid=31242) [trial-2402↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31242)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=31256): Process ended prematurely: osmo-stp_10.42.42.5(pid=31256) [trial-2402↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31256)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=31267): Process ended prematurely: osmo-stp_10.42.42.5(pid=31267) [trial-2402↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31267)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=31281): Process ended prematurely: osmo-stp_10.42.42.5(pid=31281) [trial-2402↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31281)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=31292): Process ended prematurely: osmo-stp_10.42.42.5(pid=31292) [trial-2402↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31292)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=31306): Process ended prematurely: osmo-stp_10.42.42.5(pid=31306) [trial-2402↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31306)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=31317): Process ended prematurely: osmo-stp_10.42.42.5(pid=31317) [trial-2402↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31317)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=31332): Process ended prematurely: osmo-stp_10.42.42.5(pid=31332) [trial-2402↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31332)] FAIL: mo_mt_call_osmux.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=31343): Process ended prematurely: osmo-stp_10.42.42.5(pid=31343) [trial-2402↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31343)] FAIL: voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=31357): Process ended prematurely: osmo-stp_10.42.42.5(pid=31357) [trial-2402↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31357)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=31368): Process ended prematurely: osmo-stp_10.42.42.5(pid=31368) [trial-2402↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31368)] FAIL: voice:trx-umtrx+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=31382): Process ended prematurely: osmo-stp_10.42.42.5(pid=31382) [trial-2402↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31382)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=31393): Process ended prematurely: osmo-stp_10.42.42.5(pid=31393) [trial-2402↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31393)] FAIL: voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=31407): Process ended prematurely: osmo-stp_10.42.42.5(pid=31407) [trial-2402↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31407)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=31418): Process ended prematurely: osmo-stp_10.42.42.5(pid=31418) [trial-2402↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31418)] FAIL: emergency:trx-umtrx (fail: 2) FAIL: emergency_mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=31433): Process ended prematurely: osmo-stp_10.42.42.5(pid=31433) [trial-2402↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31433)] FAIL: emergency_preemptive_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=31444): Process ended prematurely: osmo-stp_10.42.42.5(pid=31444) [trial-2402↪emergency:trx-umtrx↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31444)] FAIL: gprs:trx-umtrx (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=31462): Process ended prematurely: osmo-stp_10.42.42.5(pid=31462) [trial-2402↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31462)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=31477): Process ended prematurely: osmo-stp_10.42.42.5(pid=31477) [trial-2402↪gprs:trx-umtrx↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31477)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=31495): Process ended prematurely: osmo-stp_10.42.42.5(pid=31495) [trial-2402↪gprs:trx-umtrx↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31495)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=31507): Process ended prematurely: osmo-stp_10.42.42.5(pid=31507) [trial-2402↪gprs:trx-umtrx↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31507)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=31517): Process ended prematurely: osmo-stp_10.42.42.5(pid=31517) [trial-2402↪gprs:trx-umtrx↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31517)] FAIL: gprs:trx-umtrx+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=31535): Process ended prematurely: osmo-stp_10.42.42.5(pid=31535) [trial-2402↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31535)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=31547): Process ended prematurely: osmo-stp_10.42.42.5(pid=31547) [trial-2402↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31547)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=31565): Process ended prematurely: osmo-stp_10.42.42.5(pid=31565) [trial-2402↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31565)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=31575): Process ended prematurely: osmo-stp_10.42.42.5(pid=31575) [trial-2402↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31575)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=31585): Process ended prematurely: osmo-stp_10.42.42.5(pid=31585) [trial-2402↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31585)] FAIL: gprs:trx-umtrx+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=31602): Process ended prematurely: osmo-stp_10.42.42.5(pid=31602) [trial-2402↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31602)] FAIL: iperf3.py (7.9 sec) Error: osmo-stp_10.42.42.5(pid=31615): Process ended prematurely: osmo-stp_10.42.42.5(pid=31615) [trial-2402↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31615)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=31634): Process ended prematurely: osmo-stp_10.42.42.5(pid=31634) [trial-2402↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31634)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=31644): Process ended prematurely: osmo-stp_10.42.42.5(pid=31644) [trial-2402↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31644)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=31654): Process ended prematurely: osmo-stp_10.42.42.5(pid=31654) [trial-2402↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31654)] FAIL: gprs:trx-umtrx+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=31671): Process ended prematurely: osmo-stp_10.42.42.5(pid=31671) [trial-2402↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31671)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=31683): Process ended prematurely: osmo-stp_10.42.42.5(pid=31683) [trial-2402↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31683)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=31701): Process ended prematurely: osmo-stp_10.42.42.5(pid=31701) [trial-2402↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31701)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=31712): Process ended prematurely: osmo-stp_10.42.42.5(pid=31712) [trial-2402↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31712)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=31722): Process ended prematurely: osmo-stp_10.42.42.5(pid=31722) [trial-2402↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31722)] FAIL: gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=31739): Process ended prematurely: osmo-stp_10.42.42.5(pid=31739) [trial-2402↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31739)] FAIL: iperf3.py (8.4 sec) Error: osmo-stp_10.42.42.5(pid=32022): Process ended prematurely: osmo-stp_10.42.42.5(pid=32022) [trial-2402↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32022)] FAIL: iperf3m4.py (11.4 sec) Error: osmo-stp_10.42.42.5(pid=32041): Process ended prematurely: osmo-stp_10.42.42.5(pid=32041) [trial-2402↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32041)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=32051): Process ended prematurely: osmo-stp_10.42.42.5(pid=32051) [trial-2402↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32051)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=32061): Process ended prematurely: osmo-stp_10.42.42.5(pid=32061) [trial-2402↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32061)] FAIL: dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=32075): Process ended prematurely: osmo-stp_10.42.42.5(pid=32075) [trial-2402↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32075)] FAIL: dynts:trx-umtrx+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=32092): Process ended prematurely: osmo-stp_10.42.42.5(pid=32092) [trial-2402↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32092)] FAIL: nitb_sms:trx-lms (fail: 1) FAIL: mo_mt_sms.py (3.4 sec) Error: osmo-nitb_10.42.42.2(pid=32100): Process ended prematurely: osmo-nitb_10.42.42.2(pid=32100) [trial-2402↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=32100)] FAIL: sms:trx-lms (fail: 1) FAIL: mo_mt_sms.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=32110): Process ended prematurely: osmo-stp_10.42.42.5(pid=32110) [trial-2402↪sms:trx-lms↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32110)] FAIL: nitb_ussd:trx-lms (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=32119): Process ended prematurely: osmo-nitb_10.42.42.2(pid=32119) [trial-2402↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=32119)] FAIL: ussd:trx-lms (fail: 1) FAIL: assert_extension.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=32130): Process ended prematurely: osmo-stp_10.42.42.5(pid=32130) [trial-2402↪ussd:trx-lms↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32130)] FAIL: voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=32146): Process ended prematurely: osmo-stp_10.42.42.5(pid=32146) [trial-2402↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32146)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=32157): Process ended prematurely: osmo-stp_10.42.42.5(pid=32157) [trial-2402↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32157)] FAIL: voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=32172): Process ended prematurely: osmo-stp_10.42.42.5(pid=32172) [trial-2402↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32172)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=32183): Process ended prematurely: osmo-stp_10.42.42.5(pid=32183) [trial-2402↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32183)] FAIL: voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=32197): Process ended prematurely: osmo-stp_10.42.42.5(pid=32197) [trial-2402↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32197)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=32208): Process ended prematurely: osmo-stp_10.42.42.5(pid=32208) [trial-2402↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32208)] FAIL: voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=32222): Process ended prematurely: osmo-stp_10.42.42.5(pid=32222) [trial-2402↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32222)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=32233): Process ended prematurely: osmo-stp_10.42.42.5(pid=32233) [trial-2402↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32233)] FAIL: voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=32247): Process ended prematurely: osmo-stp_10.42.42.5(pid=32247) [trial-2402↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32247)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=32258): Process ended prematurely: osmo-stp_10.42.42.5(pid=32258) [trial-2402↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32258)] FAIL: voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=32272): Process ended prematurely: osmo-stp_10.42.42.5(pid=32272) [trial-2402↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32272)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=32283): Process ended prematurely: osmo-stp_10.42.42.5(pid=32283) [trial-2402↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32283)] FAIL: voice:trx-lms+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=32297): Process ended prematurely: osmo-stp_10.42.42.5(pid=32297) [trial-2402↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32297)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=32308): Process ended prematurely: osmo-stp_10.42.42.5(pid=32308) [trial-2402↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32308)] FAIL: emergency:trx-lms (fail: 2) FAIL: emergency_mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=32322): Process ended prematurely: osmo-stp_10.42.42.5(pid=32322) [trial-2402↪emergency:trx-lms↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32322)] FAIL: emergency_preemptive_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=32333): Process ended prematurely: osmo-stp_10.42.42.5(pid=32333) [trial-2402↪emergency:trx-lms↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32333)] FAIL: gprs:trx-lms (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=32351): Process ended prematurely: osmo-stp_10.42.42.5(pid=32351) [trial-2402↪gprs:trx-lms↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32351)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=32363): Process ended prematurely: osmo-stp_10.42.42.5(pid=32363) [trial-2402↪gprs:trx-lms↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32363)] FAIL: iperf3m4.py (11.1 sec) Error: osmo-stp_10.42.42.5(pid=32381): Process ended prematurely: osmo-stp_10.42.42.5(pid=32381) [trial-2402↪gprs:trx-lms↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32381)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=32391): Process ended prematurely: osmo-stp_10.42.42.5(pid=32391) [trial-2402↪gprs:trx-lms↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32391)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=32401): Process ended prematurely: osmo-stp_10.42.42.5(pid=32401) [trial-2402↪gprs:trx-lms↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32401)] FAIL: gprs:trx-lms+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=32419): Process ended prematurely: osmo-stp_10.42.42.5(pid=32419) [trial-2402↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32419)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=32434): Process ended prematurely: osmo-stp_10.42.42.5(pid=32434) [trial-2402↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32434)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=32452): Process ended prematurely: osmo-stp_10.42.42.5(pid=32452) [trial-2402↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32452)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=32462): Process ended prematurely: osmo-stp_10.42.42.5(pid=32462) [trial-2402↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32462)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=32472): Process ended prematurely: osmo-stp_10.42.42.5(pid=32472) [trial-2402↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32472)] FAIL: gprs:trx-lms+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.4 sec) Error: osmo-stp_10.42.42.5(pid=32493): Process ended prematurely: osmo-stp_10.42.42.5(pid=32493) [trial-2402↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32493)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=32506): Process ended prematurely: osmo-stp_10.42.42.5(pid=32506) [trial-2402↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32506)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=32524): Process ended prematurely: osmo-stp_10.42.42.5(pid=32524) [trial-2402↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32524)] FAIL: ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=32534): Process ended prematurely: osmo-stp_10.42.42.5(pid=32534) [trial-2402↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32534)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=32544): Process ended prematurely: osmo-stp_10.42.42.5(pid=32544) [trial-2402↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32544)] FAIL: gprs:trx-lms+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=32561): Process ended prematurely: osmo-stp_10.42.42.5(pid=32561) [trial-2402↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32561)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=32576): Process ended prematurely: osmo-stp_10.42.42.5(pid=32576) [trial-2402↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32576)] FAIL: iperf3m4.py (10.5 sec) Error: osmo-stp_10.42.42.5(pid=32594): Process ended prematurely: osmo-stp_10.42.42.5(pid=32594) [trial-2402↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32594)] FAIL: ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=32604): Process ended prematurely: osmo-stp_10.42.42.5(pid=32604) [trial-2402↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32604)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=32614): Process ended prematurely: osmo-stp_10.42.42.5(pid=32614) [trial-2402↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32614)] FAIL: dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=32627): Process ended prematurely: osmo-stp_10.42.42.5(pid=32627) [trial-2402↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32627)] FAIL: dynts:trx-lms+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=32640): Process ended prematurely: osmo-stp_10.42.42.5(pid=32640) [trial-2402↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32640)] FAIL: nitb_sms:trx-lms-limenet-micro (fail: 1) FAIL: mo_mt_sms.py (3.4 sec) Error: osmo-nitb_10.42.42.2(pid=32649): Process ended prematurely: osmo-nitb_10.42.42.2(pid=32649) [trial-2402↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=32649)] FAIL: sms:trx-lms-limenet-micro (fail: 1) FAIL: mo_mt_sms.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=32659): Process ended prematurely: osmo-stp_10.42.42.5(pid=32659) [trial-2402↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32659)] FAIL: nitb_ussd:trx-lms-limenet-micro (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=32668): Process ended prematurely: osmo-nitb_10.42.42.2(pid=32668) [trial-2402↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=32668)] FAIL: ussd:trx-lms-limenet-micro (fail: 1) FAIL: assert_extension.py (5.8 sec) Error: osmo-stp_10.42.42.5(pid=32678): Process ended prematurely: osmo-stp_10.42.42.5(pid=32678) [trial-2402↪ussd:trx-lms-limenet-micro↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32678)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=32693): Process ended prematurely: osmo-stp_10.42.42.5(pid=32693) [trial-2402↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32693)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=32704): Process ended prematurely: osmo-stp_10.42.42.5(pid=32704) [trial-2402↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32704)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=32718): Process ended prematurely: osmo-stp_10.42.42.5(pid=32718) [trial-2402↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32718)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=32729): Process ended prematurely: osmo-stp_10.42.42.5(pid=32729) [trial-2402↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32729)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=32743): Process ended prematurely: osmo-stp_10.42.42.5(pid=32743) [trial-2402↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32743)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=32754): Process ended prematurely: osmo-stp_10.42.42.5(pid=32754) [trial-2402↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32754)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=300): Process ended prematurely: osmo-stp_10.42.42.5(pid=300) [trial-2402↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=300)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=311): Process ended prematurely: osmo-stp_10.42.42.5(pid=311) [trial-2402↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=311)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=328): Process ended prematurely: osmo-stp_10.42.42.5(pid=328) [trial-2402↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=328)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=339): Process ended prematurely: osmo-stp_10.42.42.5(pid=339) [trial-2402↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=339)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=361): Process ended prematurely: osmo-stp_10.42.42.5(pid=361) [trial-2402↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=361)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=377): Process ended prematurely: osmo-stp_10.42.42.5(pid=377) [trial-2402↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=377)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=392): Process ended prematurely: osmo-stp_10.42.42.5(pid=392) [trial-2402↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=392)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=403): Process ended prematurely: osmo-stp_10.42.42.5(pid=403) [trial-2402↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=403)] FAIL: emergency:trx-lms-limenet-micro (fail: 2) FAIL: emergency_mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=418): Process ended prematurely: osmo-stp_10.42.42.5(pid=418) [trial-2402↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=418)] FAIL: emergency_preemptive_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=429): Process ended prematurely: osmo-stp_10.42.42.5(pid=429) [trial-2402↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=429)] FAIL: gprs:trx-lms-limenet-micro (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=447): Process ended prematurely: osmo-stp_10.42.42.5(pid=447) [trial-2402↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=447)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=459): Process ended prematurely: osmo-stp_10.42.42.5(pid=459) [trial-2402↪gprs:trx-lms-limenet-micro↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=459)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=477): Process ended prematurely: osmo-stp_10.42.42.5(pid=477) [trial-2402↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=477)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=494): Process ended prematurely: osmo-stp_10.42.42.5(pid=494) [trial-2402↪gprs:trx-lms-limenet-micro↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=494)] FAIL: ping_idle_ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=504): Process ended prematurely: osmo-stp_10.42.42.5(pid=504) [trial-2402↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=504)] FAIL: gprs:trx-lms-limenet-micro+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.4 sec) Error: osmo-stp_10.42.42.5(pid=521): Process ended prematurely: osmo-stp_10.42.42.5(pid=521) [trial-2402↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=521)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=533): Process ended prematurely: osmo-stp_10.42.42.5(pid=533) [trial-2402↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=533)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=551): Process ended prematurely: osmo-stp_10.42.42.5(pid=551) [trial-2402↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=551)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=561): Process ended prematurely: osmo-stp_10.42.42.5(pid=561) [trial-2402↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=561)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=571): Process ended prematurely: osmo-stp_10.42.42.5(pid=571) [trial-2402↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=571)] FAIL: gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=589): Process ended prematurely: osmo-stp_10.42.42.5(pid=589) [trial-2402↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=589)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=601): Process ended prematurely: osmo-stp_10.42.42.5(pid=601) [trial-2402↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=601)] FAIL: iperf3m4.py (11.5 sec) Error: osmo-stp_10.42.42.5(pid=910): Process ended prematurely: osmo-stp_10.42.42.5(pid=910) [trial-2402↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=910)] FAIL: ping.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=922): Process ended prematurely: osmo-stp_10.42.42.5(pid=922) [trial-2402↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=922)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=932): Process ended prematurely: osmo-stp_10.42.42.5(pid=932) [trial-2402↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=932)] FAIL: gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=951): Process ended prematurely: osmo-stp_10.42.42.5(pid=951) [trial-2402↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=951)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=965): Process ended prematurely: osmo-stp_10.42.42.5(pid=965) [trial-2402↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=965)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=986): Process ended prematurely: osmo-stp_10.42.42.5(pid=986) [trial-2402↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=986)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=1001): Process ended prematurely: osmo-stp_10.42.42.5(pid=1001) [trial-2402↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1001)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=1011): Process ended prematurely: osmo-stp_10.42.42.5(pid=1011) [trial-2402↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1011)] FAIL: dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=1024): Process ended prematurely: osmo-stp_10.42.42.5(pid=1024) [trial-2402↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1024)] FAIL: dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=1037): Process ended prematurely: osmo-stp_10.42.42.5(pid=1037) [trial-2402↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1037)] FAIL: nitb_sms:nanobts (fail: 1) FAIL: mo_mt_sms.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=1048): Process ended prematurely: osmo-nitb_10.42.42.2(pid=1048) [trial-2402↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=1048)] FAIL: sms:nanobts+band-1900 (fail: 1) FAIL: mo_mt_sms.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=1058): Process ended prematurely: osmo-stp_10.42.42.5(pid=1058) [trial-2402↪sms:nanobts+band-1900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1058)] FAIL: nitb_ussd:nanobts+band-1900 (fail: 1) FAIL: assert_extension.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=1068): Process ended prematurely: osmo-nitb_10.42.42.2(pid=1068) [trial-2402↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=1068)] FAIL: ussd:nanobts+band-1900 (fail: 1) FAIL: assert_extension.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=1079): Process ended prematurely: osmo-stp_10.42.42.5(pid=1079) [trial-2402↪ussd:nanobts+band-1900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1079)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=1093): Process ended prematurely: osmo-stp_10.42.42.5(pid=1093) [trial-2402↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1093)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=1104): Process ended prematurely: osmo-stp_10.42.42.5(pid=1104) [trial-2402↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1104)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=1120): Process ended prematurely: osmo-stp_10.42.42.5(pid=1120) [trial-2402↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1120)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=1140): Process ended prematurely: osmo-stp_10.42.42.5(pid=1140) [trial-2402↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1140)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=1155): Process ended prematurely: osmo-stp_10.42.42.5(pid=1155) [trial-2402↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1155)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=1166): Process ended prematurely: osmo-stp_10.42.42.5(pid=1166) [trial-2402↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1166)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=1182): Process ended prematurely: osmo-stp_10.42.42.5(pid=1182) [trial-2402↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1182)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=1193): Process ended prematurely: osmo-stp_10.42.42.5(pid=1193) [trial-2402↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1193)] FAIL: voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=1207): Process ended prematurely: osmo-stp_10.42.42.5(pid=1207) [trial-2402↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1207)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=1218): Process ended prematurely: osmo-stp_10.42.42.5(pid=1218) [trial-2402↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1218)] FAIL: emergency:nanobts+band-1900 (fail: 2) FAIL: emergency_mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=1233): Process ended prematurely: osmo-stp_10.42.42.5(pid=1233) [trial-2402↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1233)] FAIL: emergency_preemptive_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=1244): Process ended prematurely: osmo-stp_10.42.42.5(pid=1244) [trial-2402↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1244)] FAIL: gprs:nanobts+band-1900 (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=1262): Process ended prematurely: osmo-stp_10.42.42.5(pid=1262) [trial-2402↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1262)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=1274): Process ended prematurely: osmo-stp_10.42.42.5(pid=1274) [trial-2402↪gprs:nanobts+band-1900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1274)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=1292): Process ended prematurely: osmo-stp_10.42.42.5(pid=1292) [trial-2402↪gprs:nanobts+band-1900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1292)] FAIL: ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=1302): Process ended prematurely: osmo-stp_10.42.42.5(pid=1302) [trial-2402↪gprs:nanobts+band-1900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1302)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=1312): Process ended prematurely: osmo-stp_10.42.42.5(pid=1312) [trial-2402↪gprs:nanobts+band-1900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1312)] FAIL: gprs:nanobts+band-1900+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=1330): Process ended prematurely: osmo-stp_10.42.42.5(pid=1330) [trial-2402↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1330)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=1343): Process ended prematurely: osmo-stp_10.42.42.5(pid=1343) [trial-2402↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1343)] FAIL: iperf3m4.py (10.3 sec) Error: osmo-stp_10.42.42.5(pid=1364): Process ended prematurely: osmo-stp_10.42.42.5(pid=1364) [trial-2402↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1364)] FAIL: ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=1374): Process ended prematurely: osmo-stp_10.42.42.5(pid=1374) [trial-2402↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1374)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=1384): Process ended prematurely: osmo-stp_10.42.42.5(pid=1384) [trial-2402↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1384)] FAIL: gprs:nanobts+band-1900+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=1402): Process ended prematurely: osmo-stp_10.42.42.5(pid=1402) [trial-2402↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1402)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=1415): Process ended prematurely: osmo-stp_10.42.42.5(pid=1415) [trial-2402↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1415)] FAIL: iperf3m4.py (10.5 sec) Error: osmo-stp_10.42.42.5(pid=1433): Process ended prematurely: osmo-stp_10.42.42.5(pid=1433) [trial-2402↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1433)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=1443): Process ended prematurely: osmo-stp_10.42.42.5(pid=1443) [trial-2402↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1443)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=1454): Process ended prematurely: osmo-stp_10.42.42.5(pid=1454) [trial-2402↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1454)] FAIL: dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=1467): Process ended prematurely: osmo-stp_10.42.42.5(pid=1467) [trial-2402↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1467)] FAIL: sms:nanobts+band-900 (fail: 1) FAIL: mo_mt_sms.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=1480): Process ended prematurely: osmo-stp_10.42.42.5(pid=1480) [trial-2402↪sms:nanobts+band-900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1480)] FAIL: nitb_ussd:nanobts+band-900 (fail: 1) FAIL: assert_extension.py (3.1 sec) Error: osmo-nitb_10.42.42.2(pid=1489): Process ended prematurely: osmo-nitb_10.42.42.2(pid=1489) [trial-2402↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=1489)] FAIL: ussd:nanobts+band-900 (fail: 1) FAIL: assert_extension.py (5.7 sec) Error: osmo-stp_10.42.42.5(pid=1499): Process ended prematurely: osmo-stp_10.42.42.5(pid=1499) [trial-2402↪ussd:nanobts+band-900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1499)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=1513): Process ended prematurely: osmo-stp_10.42.42.5(pid=1513) [trial-2402↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1513)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=1524): Process ended prematurely: osmo-stp_10.42.42.5(pid=1524) [trial-2402↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1524)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=1538): Process ended prematurely: osmo-stp_10.42.42.5(pid=1538) [trial-2402↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1538)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=1549): Process ended prematurely: osmo-stp_10.42.42.5(pid=1549) [trial-2402↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1549)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=1564): Process ended prematurely: osmo-stp_10.42.42.5(pid=1564) [trial-2402↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1564)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=1575): Process ended prematurely: osmo-stp_10.42.42.5(pid=1575) [trial-2402↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1575)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=1589): Process ended prematurely: osmo-stp_10.42.42.5(pid=1589) [trial-2402↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1589)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=1600): Process ended prematurely: osmo-stp_10.42.42.5(pid=1600) [trial-2402↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1600)] FAIL: voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=1614): Process ended prematurely: osmo-stp_10.42.42.5(pid=1614) [trial-2402↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1614)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=1625): Process ended prematurely: osmo-stp_10.42.42.5(pid=1625) [trial-2402↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1625)] FAIL: voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=1639): Process ended prematurely: osmo-stp_10.42.42.5(pid=1639) [trial-2402↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1639)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=1650): Process ended prematurely: osmo-stp_10.42.42.5(pid=1650) [trial-2402↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1650)] FAIL: emergency:nanobts+band-900 (fail: 2) FAIL: emergency_mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=1665): Process ended prematurely: osmo-stp_10.42.42.5(pid=1665) [trial-2402↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1665)] FAIL: emergency_preemptive_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=1676): Process ended prematurely: osmo-stp_10.42.42.5(pid=1676) [trial-2402↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1676)] FAIL: gprs:nanobts+band-900 (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=1694): Process ended prematurely: osmo-stp_10.42.42.5(pid=1694) [trial-2402↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1694)] FAIL: iperf3.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=1709): Process ended prematurely: osmo-stp_10.42.42.5(pid=1709) [trial-2402↪gprs:nanobts+band-900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1709)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=1727): Process ended prematurely: osmo-stp_10.42.42.5(pid=1727) [trial-2402↪gprs:nanobts+band-900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1727)] FAIL: ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=1737): Process ended prematurely: osmo-stp_10.42.42.5(pid=1737) [trial-2402↪gprs:nanobts+band-900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1737)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=1747): Process ended prematurely: osmo-stp_10.42.42.5(pid=1747) [trial-2402↪gprs:nanobts+band-900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1747)] FAIL: gprs:nanobts+band-900+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.3 sec) Error: osmo-stp_10.42.42.5(pid=1767): Process ended prematurely: osmo-stp_10.42.42.5(pid=1767) [trial-2402↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1767)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=1780): Process ended prematurely: osmo-stp_10.42.42.5(pid=1780) [trial-2402↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1780)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=1798): Process ended prematurely: osmo-stp_10.42.42.5(pid=1798) [trial-2402↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1798)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=1808): Process ended prematurely: osmo-stp_10.42.42.5(pid=1808) [trial-2402↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1808)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=1821): Process ended prematurely: osmo-stp_10.42.42.5(pid=1821) [trial-2402↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1821)] FAIL: gprs:nanobts+band-900+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=1838): Process ended prematurely: osmo-stp_10.42.42.5(pid=1838) [trial-2402↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1838)] FAIL: iperf3.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=1853): Process ended prematurely: osmo-stp_10.42.42.5(pid=1853) [trial-2402↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1853)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=1871): Process ended prematurely: osmo-stp_10.42.42.5(pid=1871) [trial-2402↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1871)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=1881): Process ended prematurely: osmo-stp_10.42.42.5(pid=1881) [trial-2402↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1881)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=1891): Process ended prematurely: osmo-stp_10.42.42.5(pid=1891) [trial-2402↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1891)] FAIL: gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=1908): Process ended prematurely: osmo-stp_10.42.42.5(pid=1908) [trial-2402↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1908)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=1920): Process ended prematurely: osmo-stp_10.42.42.5(pid=1920) [trial-2402↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1920)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=1940): Process ended prematurely: osmo-stp_10.42.42.5(pid=1940) [trial-2402↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1940)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=1950): Process ended prematurely: osmo-stp_10.42.42.5(pid=1950) [trial-2402↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1950)] FAIL: ping_idle_ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=1960): Process ended prematurely: osmo-stp_10.42.42.5(pid=1960) [trial-2402↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1960)] FAIL: dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=1974): Process ended prematurely: osmo-stp_10.42.42.5(pid=1974) [trial-2402↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1974)] FAIL: nitb_smpp (fail: 4) FAIL: esme_connect_policy_acceptall.py (2.5 sec) Error: osmo-nitb_10.42.42.2(pid=1982): Process ended prematurely: osmo-nitb_10.42.42.2(pid=1982) [trial-2402↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=1982)] FAIL: esme_connect_policy_closed.py (2.3 sec) Error: osmo-nitb_10.42.42.2(pid=2253): Process ended prematurely: osmo-nitb_10.42.42.2(pid=2253) [trial-2402↪nitb_smpp↪esme_connect_policy_closed.py:24↪esme_connect_policy_closed.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=2253)] FAIL: esme_ms_sms_storeforward.py (2.8 sec) Error: osmo-nitb_10.42.42.2(pid=2259): Process ended prematurely: osmo-nitb_10.42.42.2(pid=2259) [trial-2402↪nitb_smpp↪esme_ms_sms_storeforward.py:23↪esme_ms_sms_storeforward.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=2259)] FAIL: esme_ms_sms_transaction.py (3.5 sec) Error: osmo-nitb_10.42.42.2(pid=2261): Process ended prematurely: osmo-nitb_10.42.42.2(pid=2261) [trial-2402↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=2261)] FAIL: smpp (fail: 4) FAIL: esme_connect_policy_acceptall.py (6.6 sec) Error: osmo-hlr_10.42.42.2(pid=2270): Process ended prematurely: osmo-hlr_10.42.42.2(pid=2270) [trial-2402↪smpp↪esme_connect_policy_acceptall.py:23↪esme_connect_policy_acceptall.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2270)] FAIL: esme_connect_policy_closed.py (6.2 sec) Error: osmo-hlr_10.42.42.2(pid=2281): Process ended prematurely: osmo-hlr_10.42.42.2(pid=2281) [trial-2402↪smpp↪esme_connect_policy_closed.py:31↪esme_connect_policy_closed.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2281)] FAIL: esme_ms_sms_storeforward.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=2294): Process ended prematurely: osmo-stp_10.42.42.5(pid=2294) [trial-2402↪smpp↪esme_ms_sms_storeforward.py:30↪esme_ms_sms_storeforward.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2294)] FAIL: esme_ms_sms_transaction.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=2305): Process ended prematurely: osmo-stp_10.42.42.5(pid=2305) [trial-2402↪smpp↪esme_ms_sms_transaction.py:28↪esme_ms_sms_transaction.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2305)] FAIL: encryption (fail: 4) FAIL: register_a5_0_authopt.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=2320): Process ended prematurely: osmo-stp_10.42.42.5(pid=2320) [trial-2402↪encryption↪register_a5_0_authopt.py:8↪register_a5_0_authopt.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2320)] FAIL: register_a5_0_authreq.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=2331): Process ended prematurely: osmo-stp_10.42.42.5(pid=2331) [trial-2402↪encryption↪register_a5_0_authreq.py:8↪register_a5_0_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2331)] FAIL: register_a5_1_authreq.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=2345): Process ended prematurely: osmo-stp_10.42.42.5(pid=2345) [trial-2402↪encryption↪register_a5_1_authreq.py:8↪register_a5_1_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2345)] FAIL: register_a5_3_authreq.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=2356): Process ended prematurely: osmo-stp_10.42.42.5(pid=2356) [trial-2402↪encryption↪register_a5_3_authreq.py:8↪register_a5_3_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2356)] FAIL: 4g:srsenb-rftype@zmq+srsue-rftype@zmq (fail: 7) FAIL: handover.py (19.7 sec) Error: srsepc(pid=2378): Process ended prematurely: srsepc(pid=2378) [trial-2402↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=2378)] FAIL: iperf3_bidir.py (19.1 sec) Error: srsepc(pid=2394): Process ended prematurely: srsepc(pid=2394) [trial-2402↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=2394)] FAIL: iperf3_dl.py (18.8 sec) Error: srsepc(pid=2410): Process ended prematurely: srsepc(pid=2410) [trial-2402↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=2410)] FAIL: iperf3_ul.py (18.6 sec) Error: srsepc(pid=2426): Process ended prematurely: srsepc(pid=2426) [trial-2402↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=2426)] FAIL: ping.py (18.5 sec) Error: srsepc(pid=2443): Process ended prematurely: srsepc(pid=2443) [trial-2402↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=2443)] FAIL: rrc_idle_mo_ping.py (18.5 sec) Error: srsepc(pid=2464): Process ended prematurely: srsepc(pid=2464) [trial-2402↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=2464)] FAIL: rrc_idle_mt_ping.py (18.7 sec) Error: srsepc(pid=2480): Process ended prematurely: srsepc(pid=2480) [trial-2402↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=2480)] FAIL: handover_2G:nanobts+bts1-oc2g (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=2493): Process ended prematurely: osmo-stp_10.42.42.5(pid=2493) [trial-2402↪handover_2G:nanobts+bts1-oc2g↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2493)] FAIL: handover_2G:nanobts+bts1-octphy (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=2507): Process ended prematurely: osmo-stp_10.42.42.5(pid=2507) [trial-2402↪handover_2G:nanobts+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2507)] FAIL: handover_2G:nanobts+bts1-trx-lms (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=2521): Process ended prematurely: osmo-stp_10.42.42.5(pid=2521) [trial-2402↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2521)] FAIL: handover_2G:nanobts+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=2535): Process ended prematurely: osmo-stp_10.42.42.5(pid=2535) [trial-2402↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2535)] FAIL: handover_2G:nanobts+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=2549): Process ended prematurely: osmo-stp_10.42.42.5(pid=2549) [trial-2402↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2549)] FAIL: handover_2G:nanobts+bts1-sysmo (fail: 1) FAIL: handover.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=2563): Process ended prematurely: osmo-stp_10.42.42.5(pid=2563) [trial-2402↪handover_2G:nanobts+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2563)] FAIL: handover_2G:nanobts+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=2577): Process ended prematurely: osmo-stp_10.42.42.5(pid=2577) [trial-2402↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2577)] FAIL: handover_2G:nanobts+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=2591): Process ended prematurely: osmo-stp_10.42.42.5(pid=2591) [trial-2402↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2591)] FAIL: handover_2G:oc2g+bts1-octphy (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=2605): Process ended prematurely: osmo-stp_10.42.42.5(pid=2605) [trial-2402↪handover_2G:oc2g+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2605)] FAIL: handover_2G:oc2g+bts1-trx-lms (fail: 1) FAIL: handover.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=2623): Process ended prematurely: osmo-stp_10.42.42.5(pid=2623) [trial-2402↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2623)] FAIL: handover_2G:oc2g+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=2638): Process ended prematurely: osmo-stp_10.42.42.5(pid=2638) [trial-2402↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2638)] FAIL: handover_2G:oc2g+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=2652): Process ended prematurely: osmo-stp_10.42.42.5(pid=2652) [trial-2402↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2652)] FAIL: handover_2G:oc2g+bts1-sysmo (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=2670): Process ended prematurely: osmo-stp_10.42.42.5(pid=2670) [trial-2402↪handover_2G:oc2g+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2670)] FAIL: handover_2G:oc2g+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=2684): Process ended prematurely: osmo-stp_10.42.42.5(pid=2684) [trial-2402↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2684)] FAIL: handover_2G:oc2g+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=2698): Process ended prematurely: osmo-stp_10.42.42.5(pid=2698) [trial-2402↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2698)] FAIL: handover_2G:octphy+bts1-trx-lms (fail: 1) FAIL: handover.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=2712): Process ended prematurely: osmo-stp_10.42.42.5(pid=2712) [trial-2402↪handover_2G:octphy+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2712)] FAIL: handover_2G:octphy+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=2727): Process ended prematurely: osmo-stp_10.42.42.5(pid=2727) [trial-2402↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2727)] FAIL: handover_2G:octphy+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=2741): Process ended prematurely: osmo-stp_10.42.42.5(pid=2741) [trial-2402↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2741)] FAIL: handover_2G:octphy+bts1-sysmo (fail: 1) FAIL: handover.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=2755): Process ended prematurely: osmo-stp_10.42.42.5(pid=2755) [trial-2402↪handover_2G:octphy+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2755)] FAIL: handover_2G:octphy+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=2769): Process ended prematurely: osmo-stp_10.42.42.5(pid=2769) [trial-2402↪handover_2G:octphy+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2769)] FAIL: handover_2G:octphy+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=2783): Process ended prematurely: osmo-stp_10.42.42.5(pid=2783) [trial-2402↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2783)] FAIL: handover_2G:trx-lms+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=2797): Process ended prematurely: osmo-stp_10.42.42.5(pid=2797) [trial-2402↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2797)] FAIL: handover_2G:trx-lms+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=2811): Process ended prematurely: osmo-stp_10.42.42.5(pid=2811) [trial-2402↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2811)] FAIL: handover_2G:trx-lms+bts1-sysmo (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=2826): Process ended prematurely: osmo-stp_10.42.42.5(pid=2826) [trial-2402↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2826)] FAIL: handover_2G:trx-lms+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=2840): Process ended prematurely: osmo-stp_10.42.42.5(pid=2840) [trial-2402↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2840)] FAIL: handover_2G:trx-lms+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=2854): Process ended prematurely: osmo-stp_10.42.42.5(pid=2854) [trial-2402↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2854)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=2868): Process ended prematurely: osmo-stp_10.42.42.5(pid=2868) [trial-2402↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2868)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-sysmo (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=2882): Process ended prematurely: osmo-stp_10.42.42.5(pid=2882) [trial-2402↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2882)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=2896): Process ended prematurely: osmo-stp_10.42.42.5(pid=2896) [trial-2402↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2896)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=2910): Process ended prematurely: osmo-stp_10.42.42.5(pid=2910) [trial-2402↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2910)] FAIL: handover_2G:trx-sysmocell5000+bts1-sysmo (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=2924): Process ended prematurely: osmo-stp_10.42.42.5(pid=2924) [trial-2402↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2924)] FAIL: handover_2G:trx-sysmocell5000+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=2938): Process ended prematurely: osmo-stp_10.42.42.5(pid=2938) [trial-2402↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2938)] FAIL: handover_2G:trx-sysmocell5000+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=2952): Process ended prematurely: osmo-stp_10.42.42.5(pid=2952) [trial-2402↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2952)] FAIL: handover_2G:sysmo+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=2966): Process ended prematurely: osmo-stp_10.42.42.5(pid=2966) [trial-2402↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2966)] FAIL: handover_2G:sysmo+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=2980): Process ended prematurely: osmo-stp_10.42.42.5(pid=2980) [trial-2402↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2980)] FAIL: handover_2G:trx-b200+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=3005): Process ended prematurely: osmo-stp_10.42.42.5(pid=3005) [trial-2402↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3005)] + rm -rf trial-2402/inst + cd trial-2402 + command -v journalctl + [ ! -z /bin/journalctl ] + readlink last_run + journalctl -u ofono -o short-precise --since 2022-12-14 08:25:10 + readlink last_run + tar czf /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402-run.tgz run.2022-12-14_08-25-21 + tar czf /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2402-bin.tgz checksums.md5 open5gs.build-8.tgz osmo-bsc.build-17688.tgz osmo-bts-oc2g.build-5542.tgz osmo-bts-sysmo.build-8046.tgz osmo-bts.build-7515.tgz osmo-ggsn.build-6694.tgz osmo-hlr.build-8719.tgz osmo-hnbgw.build-2997.tgz osmo-mgw.build-8964.tgz osmo-msc.build-29317.tgz osmo-nitb.build-12995.tgz osmo-pcu-oc2g.build-3912.tgz osmo-pcu-sysmo.build-5195.tgz osmo-pcu.build-5156.tgz osmo-sgsn.build-30103.tgz osmo-stp.build-9261.tgz osmo-trx.build-4686.tgz osmocom-bb.build-4714.tgz srslte.build-19.tgz + exit 1 Build step 'Execute shell' marked build as failure Archiving artifacts Recording test results [Checks API] No suitable checks publisher found. Sending e-mails to: pespin@sysmocom.de Finished: FAILURE